Skip to content

Reduce LLM inference time by instructing the model to think less #31

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
iagooar merged 1 commit into from
Nov 11, 2025
Merged

Reduce LLM inference time by instructing the model to think less #31

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions src/prompt.rs
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -93,6 +93,7 @@ pub fn build_qq_prompt(
/// System prompt for `qq`: restrict topics to terminal/dev and enforce XML-tag formatting.
pub fn build_qq_system_prompt() -> String {
let mut s = String::new();
s.push_str("Provide a quick answer / no thinking.\n");
s.push_str("You are a terminal assistant. Help users ONLY with command-line, programming, system administration, and technical computing tasks.\n\n");
s.push_str("TOPIC RESTRICTIONS:\n");
s.push_str("- ONLY answer questions about: terminal commands, shell scripting, file operations, system administration, programming, development tools, git, network tools, text processing, etc.\n");
Expand Down Expand Up @@ -192,6 +193,7 @@ pub fn build_qq_user_message(
/// The CLI enforces a single tool call and will not loop.
pub fn build_qa_system_prompt() -> String {
let mut s = String::new();
s.push_str("Provide a quick answer / no thinking.\n");
s.push_str("You are a careful CLI agent with a single tool-call step.\n");
s.push_str("You may either answer directly in plain text OR request exactly one tool call by returning ONLY a JSON object with this shape:\n");
s.push_str("{ \"tool\": string, \"arguments\": object }\n\n");
Expand Down