ChatDA: Agentic NL2SQL, Automated Data Visualization and Analysis with LLM #698
ruohuawang
started this conversation in
project
Replies: 1 comment
-
请问项目地址在哪 |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
We propose a LLM-based agent system that perform a pipeline of data fetching, visualization and analysis.
The procedure is described as follows: 1. the system first accepts the user's natural language query; 2. NL2Metric: a encoder-only/encoder-decoder LLM (e.g., BERT or T5 ) then perform natural language understanding (NLU) tasks, e.g. named entity recognition and intention idetification, transforming user's query into metrics in json format; 3.retrieval augmented generation (RAG): borrowing ideas from Huixiangdou, we use bce-reranker as retrieval module to do field-level RAG; 4.Metric2SQL: a decoder-only LLM (e.g. InternLM2 14B) then generats SQL; 5. multiple conversations: reflection and revision; 6. excecution of SQL; 7. data visualization and analysis using InternLM2's agent skills. In the last, we get a report with charts and tables based on the given user's query.
We use the following inference/deployment framework: lmdeploy, gradio, and lagent (xtuner if needed).
Beta Was this translation helpful? Give feedback.
All reactions