feat(table-selection): add LLM-based table selection for SQL generation #679
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add a new LLM-based table selection feature that can replace or work alongside the existing RAG-based table embedding. Key changes: - New table selection module (backend/apps/datasource/llm_select/) - New config option TABLE_LLM_SELECTION_ENABLED (default: true) - Add table_select_answer field to ChatRecord for logging LLM selections - Add SELECT_TABLE operation type for tracking in chat logs - Skip foreign key relation table completion when using LLM selection (LLM already sees table relations and can decide which tables to include) 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
- Add MULTI_TURN_EMBEDDING_ENABLED and MULTI_TURN_HISTORY_COUNT config - Add get_chat_history_questions() to retrieve recent questions from same chat - Add build_context_query() to concatenate history questions with current question - Update calc_table_embedding() to use context query for better table matching - Pass history_questions through get_table_schema() to LLMService This improves table structure retrieval accuracy by considering the full conversation context instead of just the latest question. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary
Changes
backend/apps/datasource/llm_select/table_selection.py: 新增 LLM 表选择核心逻辑backend/apps/template/select_table/generator.py: 表选择 prompt 生成器backend/apps/datasource/crud/datasource.py: 集成 LLM 表选择到表 schema 获取流程backend/apps/chat/task/llm.py: 延迟 schema 获取以支持日志记录backend/common/core/config.py: 添加 LLM 表选择配置项backend/alembic/versions/054_add_table_select_answer.py: 数据库迁移脚本