-
Notifications
You must be signed in to change notification settings - Fork 0
Expand file tree
/
Copy pathdoc.go
More file actions
29 lines (29 loc) · 1.29 KB
/
Copy pathdoc.go
File metadata and controls
29 lines (29 loc) · 1.29 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
// Package llmgate is a provider-agnostic LLM gateway for Go, built on
// top of github.com/tmc/langchaingo.
//
// langchaingo handles the per-provider wire protocols; llmgate wraps
// them behind one small Client interface and adds the production
// concerns langchaingo doesn't ship — retries, router/fallback, cost
// tracking, capability flags, budget + cache middleware, and error
// classification.
//
// The root package declares only the shared contract: Client, Request,
// Response, Usage, Message, Role, Provider, Streamer, Tool types,
// Middleware, ErrNotImplemented, and the Mock client. Concrete provider
// factories, middleware, router, pricing, and capability helpers live in
// subpackages:
//
// - github.com/hallelx2/llmgate/provider/anthropic
// - github.com/hallelx2/llmgate/provider/openai
// - github.com/hallelx2/llmgate/provider/gemini
// - github.com/hallelx2/llmgate/middleware/retry
// - github.com/hallelx2/llmgate/middleware/budget
// - github.com/hallelx2/llmgate/middleware/cache
// - github.com/hallelx2/llmgate/router
// - github.com/hallelx2/llmgate/pricing
// - github.com/hallelx2/llmgate/capabilities
//
// Forthcoming:
// - Streaming + tool-use concrete provider implementations.
// - Native count_tokens via each provider's counting endpoint.
package llmgate