diff --git a/docs/providers/chutes-ai.md b/docs/providers/chutes-ai.md new file mode 100644 index 0000000..2834741 --- /dev/null +++ b/docs/providers/chutes-ai.md @@ -0,0 +1,32 @@ +--- +sidebar_label: Chutes AI +--- + +# Using Chutes AI With Kilo Code + +Chutes.ai offers free API access to several large language models (LLMs), allowing developers to integrate and experiment with these models without immediate financial commitment. They provide access to a curated set of open-source and proprietary language models, often with a focus on specific capabilities or regional language support. + +**Website:** [https://chutes.ai/](https://chutes.ai/) + +## Getting an API Key + +To use Chutes AI with Kilo Code, obtain an API key from the [Chutes AI platform](https://chutes.ai/). After signing up or logging in, you should find an option to generate or retrieve your API key within your account dashboard or settings. + +## Supported Models + +Kilo Code will attempt to fetch the list of available models from the Chutes AI API. The specific models available will depend on Chutes AI's current offerings. + +Always refer to the official Chutes AI documentation or your dashboard for the most up-to-date list of supported models. + +## Configuration in Kilo Code + +1. **Open Kilo Code Settings:** Click the gear icon () in the Kilo Code panel. +2. **Select Provider:** Choose "Chutes AI" from the "API Provider" dropdown. +3. **Enter API Key:** Paste your Chutes AI API key into the "Chutes AI API Key" field. +4. **Select Model:** Choose your desired model from the "Model" dropdown. + +## Tips and Notes + +* **Free Access:** Chutes AI provides free API access, making it an excellent option for experimentation and development without immediate costs. +* **Model Variety:** The platform offers access to both open-source and proprietary models, giving you flexibility in choosing the right model for your needs. +* **Rate Limits:** As with any free service, be aware of potential rate limits or usage restrictions that may apply to your API key. \ No newline at end of file diff --git a/docs/providers/groq.md b/docs/providers/groq.md index f6e8ac3..871c9e8 100644 --- a/docs/providers/groq.md +++ b/docs/providers/groq.md @@ -10,9 +10,33 @@ Groq provides ultra-fast inference for various AI models through their high-perf ## Getting an API Key -1. **Sign Up/Sign In:** Go to [Groq Console](https://console.groq.com/). Create an account or sign in. -2. **Create API Key:** Navigate to the API Keys section and create a new API key. -3. **Copy API Key:** Copy the generated API key for use in Kilo Code. +To use Groq with Kilo Code, you'll need an API key from the [GroqCloud Console](https://console.groq.com/). After signing up or logging in, navigate to the API Keys section of your dashboard to create and copy your key. + +## Supported Models + +Kilo Code will attempt to fetch the list of available models from the Groq API. Common models available via Groq include: + +* `llama3-8b-8192` +* `llama3-70b-8192` +* `mixtral-8x7b-32768` +* `gemma-7b-it` +* `moonshotai/kimi-k2-instruct` (Kimi K2 model) + +**Note:** Model availability and specifications may change. Refer to the [Groq Documentation](https://console.groq.com/docs/models) for the most up-to-date list of supported models and their capabilities. + +## Configuration in Kilo Code + +1. **Open Kilo Code Settings:** Click the gear icon () in the Kilo Code panel. +2. **Select Provider:** Choose "Groq" from the "API Provider" dropdown. +3. **Enter API Key:** Paste your Groq API key into the "Groq API Key" field. +4. **Select Model:** Choose your desired model from the "Model" dropdown. + +## Tips and Notes + +* **High-Speed Inference:** Groq's LPUs provide exceptionally fast response times, making it ideal for interactive development workflows. +* **Token Limits:** Some models have specific `max_tokens` limits that are automatically handled by Kilo Code (e.g., the `moonshotai/kimi-k2-instruct` model). +* **Cost Efficiency:** Groq often provides competitive pricing for high-speed inference compared to other providers. +* **Model Selection:** Choose models based on your specific needs - larger models like `llama3-70b-8192` for complex reasoning tasks, or smaller models like `llama3-8b-8192` for faster, simpler operations. ## Supported Models @@ -65,4 +89,4 @@ The `moonshotai/kimi-k2-instruct` model includes optimized configuration: ## Pricing -Groq offers competitive pricing based on input and output tokens. Visit the [Groq pricing page](https://groq.com/pricing/) for current rates and plan options. \ No newline at end of file +Groq offers competitive pricing based on input and output tokens. Visit the [Groq pricing page](https://groq.com/pricing/) for current rates and plan options. diff --git a/docs/providers/vertex.md b/docs/providers/vertex.md index 41ceaa5..77c96db 100644 --- a/docs/providers/vertex.md +++ b/docs/providers/vertex.md @@ -16,12 +16,14 @@ Kilo Code supports accessing models through Google Cloud Platform's Vertex AI, a * **Application Default Credentials (ADC):** Kilo Code uses Application Default Credentials to authenticate with Vertex AI. The easiest way to set this up is to: 1. Install the Google Cloud CLI: [https://cloud.google.com/sdk/docs/install](https://cloud.google.com/sdk/docs/install) 2. Authenticate using: `gcloud auth application-default login` +* **Service Account Key (Alternative):** Alternatively, you can authenticate using a Google Cloud Service Account key file. You'll need to generate this key in your GCP project. See the [Google Cloud documentation on creating service account keys](https://cloud.google.com/iam/docs/creating-managing-service-account-keys). ## Supported Models Kilo Code supports the following models through Vertex AI (based on source code): * **Google Gemini Models:** + * `gemini-2.5-flash-preview-05-20` * `gemini-2.0-flash-001` * `gemini-2.5-pro-exp-03-25` * `gemini-2.0-pro-exp-02-05` @@ -30,6 +32,10 @@ Kilo Code supports the following models through Vertex AI (based on source code) * `gemini-1.5-flash-002` * `gemini-1.5-pro-002` * **Anthropic Claude Models:** + * `claude-opus-4@20250514:thinking` + * `claude-opus-4@20250514` + * `claude-sonnet-4@20250514:thinking` + * `claude-sonnet-4@20250514` * `claude-3-7-sonnet@20250219:thinking` * `claude-3-7-sonnet@20250219` * `claude-3-5-sonnet-v2@20241022` @@ -44,9 +50,14 @@ Refer to the [Google Cloud documentation on Vertex AI Models](https://cloud.goog 1. **Open Kilo Code Settings:** Click the gear icon () in the Kilo Code panel. 2. **Select Provider:** Choose "GCP Vertex AI" from the "API Provider" dropdown. -3. **Enter Project ID:** Enter your Google Cloud Project ID. -4. **Select Region:** Choose the region where your Vertex AI resources are located (e.g., `us-east5`). -5. **Select Model:** Choose your desired model from the "Model" dropdown. +3. **Configure Authentication:** + * **If using Application Default Credentials (ADC):** No further action is needed here. ADC will be used automatically if configured correctly (see Prerequisites). + * **If *not* using ADC (Service Account Key):** + * **Option A: Paste JSON Content:** Paste the entire content of your Service Account JSON key file into the **Google Cloud Credentials** field. + * **Option B: Provide File Path:** Enter the absolute path to your downloaded Service Account JSON key file in the **Google Cloud Key File Path** field. +4. **Enter Project ID:** Enter your Google Cloud Project ID. +5. **Select Region:** Choose the region where your Vertex AI resources are located (e.g., `us-east5`). +6. **Select Model:** Choose your desired model from the "Model" dropdown. ## Tips and Notes diff --git a/docs/providers/xai.md b/docs/providers/xai.md new file mode 100644 index 0000000..80501cb --- /dev/null +++ b/docs/providers/xai.md @@ -0,0 +1,81 @@ +--- +sidebar_label: xAI (Grok) +--- + +# Using xAI (Grok) With Kilo Code + +xAI is the company behind Grok, a large language model known for its conversational abilities and large context window. Grok models are designed to provide helpful, informative, and contextually relevant responses. + +**Website:** [https://x.ai/](https://x.ai/) + +## Getting an API Key + +1. **Sign Up/Sign In:** Go to the [xAI Console](https://console.x.ai/). Create an account or sign in. +2. **Navigate to API Keys:** Go to the API keys section in your dashboard. +3. **Create a Key:** Click to create a new API key. Give your key a descriptive name (e.g., "Kilo Code"). +4. **Copy the Key:** **Important:** Copy the API key *immediately*. You will not be able to see it again. Store it securely. + +## Supported Models + +Kilo Code supports the following xAI Grok models: + +### Grok-3 Models +* `grok-3-beta` (Default) - xAI's Grok-3 beta model with 131K context window +* `grok-3-fast-beta` - xAI's Grok-3 fast beta model with 131K context window +* `grok-3-mini-beta` - xAI's Grok-3 mini beta model with 131K context window +* `grok-3-mini-fast-beta` - xAI's Grok-3 mini fast beta model with 131K context window + +### Grok-2 Models +* `grok-2-latest` - xAI's Grok-2 model - latest version with 131K context window +* `grok-2` - xAI's Grok-2 model with 131K context window +* `grok-2-1212` - xAI's Grok-2 model (version 1212) with 131K context window + +### Grok Vision Models +* `grok-2-vision-latest` - xAI's Grok-2 Vision model - latest version with image support and 32K context window +* `grok-2-vision` - xAI's Grok-2 Vision model with image support and 32K context window +* `grok-2-vision-1212` - xAI's Grok-2 Vision model (version 1212) with image support and 32K context window +* `grok-vision-beta` - xAI's Grok Vision Beta model with image support and 8K context window + +### Legacy Models +* `grok-beta` - xAI's Grok Beta model (legacy) with 131K context window + +## Configuration in Kilo Code + +1. **Open Kilo Code Settings:** Click the gear icon () in the Kilo Code panel. +2. **Select Provider:** Choose "xAI" from the "API Provider" dropdown. +3. **Enter API Key:** Paste your xAI API key into the "xAI API Key" field. +4. **Select Model:** Choose your desired Grok model from the "Model" dropdown. + +## Reasoning Capabilities + +Grok 3 Mini models feature specialized reasoning capabilities, allowing them to "think before responding" - particularly useful for complex problem-solving tasks. + +### Reasoning-Enabled Models + +Reasoning is only supported by: +* `grok-3-mini-beta` +* `grok-3-mini-fast-beta` + +The Grok 3 models `grok-3-beta` and `grok-3-fast-beta` do not support reasoning. + +### Controlling Reasoning Effort + +When using reasoning-enabled models, you can control how hard the model thinks with the `reasoning_effort` parameter: + +* `low`: Minimal thinking time, using fewer tokens for quick responses +* `high`: Maximum thinking time, leveraging more tokens for complex problems + +Choose `low` for simple queries that should complete quickly, and `high` for harder problems where response latency is less important. + +### Key Features + +* **Step-by-Step Problem Solving**: The model thinks through problems methodically before delivering an answer +* **Math & Quantitative Strength**: Excels at numerical challenges and logic puzzles +* **Reasoning Trace Access**: The model's thinking process is available via the `reasoning_content` field in the response completion object + +## Tips and Notes + +* **Context Window:** Most Grok models feature large context windows (up to 131K tokens), allowing you to include substantial amounts of code and context in your prompts. +* **Vision Capabilities:** Select vision-enabled models (`grok-2-vision-latest`, `grok-2-vision`, etc.) when you need to process or analyze images. +* **Pricing:** Pricing varies by model, with input costs ranging from $0.3 to $5.0 per million tokens and output costs from $0.5 to $25.0 per million tokens. Refer to the xAI documentation for the most current pricing information. +* **Performance Tradeoffs:** "Fast" variants typically offer quicker response times but may have higher costs, while "mini" variants are more economical but may have reduced capabilities. \ No newline at end of file diff --git a/sidebars.ts b/sidebars.ts index 295d5bf..15671b9 100644 --- a/sidebars.ts +++ b/sidebars.ts @@ -107,12 +107,13 @@ const sidebars: SidebarsConfig = { items: [ 'providers/kilocode', 'providers/anthropic', - 'providers/claude-code', 'providers/bedrock', + 'providers/chutes-ai', + 'providers/claude-code', 'providers/deepseek', 'providers/vertex', - 'providers/gemini', 'providers/glama', + 'providers/gemini', 'providers/groq', 'providers/human-relay', 'providers/lmstudio', @@ -125,6 +126,7 @@ const sidebars: SidebarsConfig = { 'providers/unbound', 'providers/v0', 'providers/vscode-lm', + 'providers/xai', ] }, 'advanced-usage/local-models',