@runcrate/ai

Runcrate provider for the Vercel AI SDK.

Installation

npm install @runcrate/ai ai

Setup

Set your Runcrate API key:

export RUNCRATE_API_KEY=rc_live_...

Or pass it directly when creating the provider.

Usage

Text Generation

import { runcrate } from '@runcrate/ai';
import { generateText } from 'ai';

const { text } = await generateText({
  model: runcrate('deepseek-ai/DeepSeek-V3'),
  prompt: 'Explain quantum computing in simple terms.',
});

console.log(text);

Streaming

import { runcrate } from '@runcrate/ai';
import { streamText } from 'ai';

const result = streamText({
  model: runcrate('deepseek-ai/DeepSeek-V3'),
  prompt: 'Write a short story about a robot.',
});

for await (const chunk of result.textStream) {
  process.stdout.write(chunk);
}

Chat Messages

import { runcrate } from '@runcrate/ai';
import { generateText } from 'ai';

const { text } = await generateText({
  model: runcrate('meta-llama/Llama-3.3-70B-Instruct'),
  messages: [
    { role: 'system', content: 'You are a helpful assistant.' },
    { role: 'user', content: 'What is the capital of France?' },
  ],
});

Structured Output

import { runcrate } from '@runcrate/ai';
import { generateText, Output } from 'ai';
import { z } from 'zod';

const { output } = await generateText({
  model: runcrate('deepseek-ai/DeepSeek-V3'),
  output: Output.object({
    schema: z.object({
      name: z.string(),
      ingredients: z.array(z.string()),
      steps: z.array(z.string()),
    }),
  }),
  prompt: 'Generate a recipe for chocolate chip cookies.',
});

console.log(output);

Image Generation

import { runcrate } from '@runcrate/ai';
import { generateImage } from 'ai';

const { image } = await generateImage({
  model: runcrate.imageModel('black-forest-labs/FLUX.1-schnell'),
  prompt: 'A futuristic cityscape at sunset',
  size: '1024x768',
});

console.log(image.base64); // base64 encoded image

Embeddings

import { runcrate } from '@runcrate/ai';
import { embed } from 'ai';

const { embedding } = await embed({
  model: runcrate.embeddingModel('BAAI/bge-large-en-v1.5'),
  value: 'The quick brown fox jumps over the lazy dog',
});

console.log(embedding); // float array

Custom Configuration

import { createRuncrate } from '@runcrate/ai';

const runcrate = createRuncrate({
  apiKey: 'rc_live_...',
  baseURL: 'https://api.runcrate.ai/v1', // default
  headers: {
    'X-Custom-Header': 'value',
  },
});

Available Models

Chat Models

Model ID	Description
deepseek-ai/DeepSeek-V3	DeepSeek V3
deepseek-ai/DeepSeek-R1	DeepSeek R1 (reasoning)
meta-llama/Llama-3.3-70B-Instruct	Llama 3.3 70B
meta-llama/Llama-3.1-405B-Instruct	Llama 3.1 405B
Qwen/Qwen2.5-72B-Instruct	Qwen 2.5 72B
Qwen/QwQ-32B	QwQ 32B (reasoning)
mistralai/Mistral-Large-Instruct-2411	Mistral Large
microsoft/phi-4	Phi-4

Image Models

Model ID	Description
black-forest-labs/FLUX.1-schnell	FLUX.1 Schnell (fast)
black-forest-labs/FLUX.1-dev	FLUX.1 Dev
black-forest-labs/FLUX.1-pro	FLUX.1 Pro
ideogram-ai/ideogram-v2	Ideogram V2
recraft-ai/recraft-v3	Recraft V3
stabilityai/sd3.5-large	Stable Diffusion 3.5 Large

Embedding Models

Model ID	Description
BAAI/bge-large-en-v1.5	BGE Large English
BAAI/bge-base-en-v1.5	BGE Base English
sentence-transformers/all-MiniLM-L6-v2	MiniLM L6 v2

See the full model catalog at runcrate.ai/models.

Model Settings

const { text } = await generateText({
  model: runcrate('deepseek-ai/DeepSeek-V3', {
    maxTokens: 1000,
    temperature: 0.7,
    topP: 0.9,
  }),
  prompt: 'Hello!',
});

License

MIT