This manual provides simple instructions on operating the GUI of this tool. The manual will be updated accordingly.
- In the text box, type in your query (question for Generative AI tool) and press
Enter.
- Check or uncheck the
Use Knowledgebasecheckbox.
- Under
KnowledgeBase Mode, select the mode from the pulldown menu. - This function will only work when you attach more than 1 Knowledge Base to the tool.
- Check or uncheck the
Prompt-Weightingcheckbox. - Adjust the slider to increase or decrease the weight.
- In the text boxes, edit the content, then click the
Update Promptsbutton.
- In the text boxes, edit the content, then click the
Save Promptsbutton. - Prompts will be saved in the subdirectory of
prompts/in separate files.
- In the text box, edit the content, then click the
Update Configbutton. Note that you can also directly modify the config fileconfigs/default_release.jsonbefore running the tool. However, update configs through GUI is a convenient way in experimenting with the tool. - Changing knowledge bases, LLMs etc. can be done through this Tab.
Selected items in configs:
- To use another LLM, modify the row of
"model_type": "ehartford/Wizard-Vicuna-13B-Uncensored",. It is compatible with many models available on Hugging Face. - To use another Dense Retriever, modify the row of
"encoder": "intfloat/multilingual-e5-base",. It is compatible with many retrievers available on Hugging Face. - To limit maximum length of generated response, modify the row of
"max_new_tokens": 512,. - To change the number of passages retrieved from knowledge base, modify the row of
"npassage": 5.
- In the text box, edit the content, then click the
Save Configbutton. - Config will be saved in the subdirectory of
configs/in separate file. You can change theSave Pathnext to the Save Config button.
- Click the
Load Logsbutton to display the query-response history and analytical info. - Click the
Save Logsbutton to save the query-response history and analytical info. - Logs will be saved in the subdirectory of
analysis/. You can change theSave Log Pathnext to the Save Logs button.
Drag and dropnew documents (pdf etc.), then click theCreate Knowledgebutton to create knowledge base on-the-fly directly from GUI. Support multiple documents.- If same Knowledgebase Filename existed, new knowledge will be automatically appended to that knowledge base.
- After knowledge base creation, Chat Tab will be automatically updated to include the new knowledge. New knowledge can be selected from the dropdown menu of knowledgebase under Chat Tab. For appended knowledge, current knowledge base used will be automatically updated.
- To make the newly created knowledge base permanent even after reloading the tool, click the
Save Configbutton under Config Tab to save a copy of the automatically updated configs.