APR-207: Scaffold MCP plugin interface for 3rd-party model data sources#54
Open
JacobSampson wants to merge 1 commit into
Open
APR-207: Scaffold MCP plugin interface for 3rd-party model data sources#54JacobSampson wants to merge 1 commit into
JacobSampson wants to merge 1 commit into
Conversation
…(APR-207) Add @aprovan/model-sources package that defines the plugin interface contract for external model performance data sources (Artificial Analysis, Chatbot Arena, etc.) and wires a hook point for the upcoming model selection engine (APR-205). - ModelDataPlugin interface: listModels() / getModel() / getRecommendations() - ModelSourceRegistry: manages registered plugins, aggregates results - noopSelectionHook / createRegistryHook: APR-205 integration site - ArtificialAnalysisPlugin: reference stub implementation (no live API calls) - 38 unit tests covering all public surfaces Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
@aprovan/model-sources— a new workspace package that defines the MCP plugin interface contract for external model performance data sources (Artificial Analysis, Chatbot Arena, Hugging Face Leaderboard, etc.)noopSelectionHook/createRegistryHook) where APR-205 (model selection engine) will inject plugin data when ready — no plugin data enters selection decisions yetArtificialAnalysisPluginstub so future implementors have a concrete example to followChanges
packages/model-sources/src/types.ts:ModelDataPlugininterface (listModels,getModel,getRecommendations), supporting types (ModelInfo,ModelPricing,ModelBenchmarks,RecommendationQuery,ModelRecommendation,PluginConfig,ComplexityTier)packages/model-sources/src/registry.ts:ModelSourceRegistryclass andregistrysingleton; aggregates across multiple plugins, deduplicates by model ID, skips failing plugins gracefullypackages/model-sources/src/selection-hook.ts:ModelSelectionHooktype,noopSelectionHook(default no-op),createRegistryHookfactory (activates real plugin queries for APR-205)packages/model-sources/src/plugins/artificial-analysis.ts: Reference stub with static model data; TODO comments mark exactly where real API calls go when APR-205 activatespackages/model-sources/src/__tests__/: 38 unit tests covering registry, plugin, and hook surfacesTest Plan
pnpm --filter @aprovan/model-sources test— 38 tests pass (3 test files)pnpm --filter @aprovan/model-sources typecheck— zero type errorspnpm --filter @aprovan/model-sources build— ESM + CJS +.d.tsoutputs generated successfullypnpm --filter @aprovan/model-sources lint— blocked by pre-existingtypescript-eslintmissing from@aprovan/eslint-config(affects all packages includingdevtools; not introduced by this PR)Closes: APR-207
🤖 Generated with Claude Code