A new model launches
The competitive set can change immediately, even if your workload stays exactly the same.
ModelShortlist gives your AI assistant independent Artificial Analysis benchmark evidence plus current OpenRouter facts—price, context, capabilities, providers, and optional ZDR—so it can recommend the best fit for the workload you actually have.
“Long-running coding agent. Tools required. At least 100k context. Quality matters most, but I care about value.”
Why freshness matters
Static comparison content gets stale because the model market is not static. ModelShortlist is built to put current evidence inside the assistant that already understands your workload.
The competitive set can change immediately, even if your workload stays exactly the same.
A price cut can turn a previously expensive model into the best-value option.
Independent evaluations can change the quality picture as new results appear.
Tool support and other parameters can appear, disappear, or differ across model variants.
Endpoint availability and provider options move independently of a model’s benchmark quality.
Privacy-sensitive workloads need current endpoint evidence, not assumptions about a model family.
Evidence, with clear attribution
ModelShortlist keeps those evidence types conceptually separate, then lets the host AI reason across them for the workload you described.
Independent performance evidence
Artificial Analysis supplies the independent benchmark and performance evidence. ModelShortlist does not create those benchmarks and only attaches them when it can confidently reconcile the exact model identity.
Current operational facts
OpenRouter supplies the current catalog and deployment-relevant facts that can make a benchmark-strong model the wrong operational choice for a specific job.
How it works
ModelShortlist is a read-only context layer, not a model router. It retrieves evidence; your AI assistant makes the recommendation.
State what you are building, what matters, and any hard constraints such as tools, context, budget, creator, or ZDR.
ModelShortlist starts from the current OpenRouter catalog and applies explicit hard constraints rather than a hand-picked leaderboard.
Operational facts are combined with Artificial Analysis evidence when the exact model identity can be matched confidently.
Your host AI explains best-fit, best-value, and constraint-driven tradeoffs using the evidence returned by the MCP.
Ask naturally
No special prompt syntax is required. Be explicit about hard constraints; let the assistant reason about everything else.
“I need a long-running coding agent. Tool use is required, I need at least 100k context, and I care about quality-per-dollar.”
“What is the strongest current model under $10 per million output tokens for this workload?”
“I need strict structured output from long documents. Which current models are the best fit?”
“Compare these OpenRouter models and separate benchmark evidence from price, context, and provider facts.”
“I need 200k context and reliable tool use. What are my best current options?”
“Same workload, but ZDR is mandatory. Which real endpoints still satisfy every hard constraint?”
Guides
The guides explain what criteria matter and how to ask for a current answer without hard-coding today’s model ranking into tomorrow’s advice.
A practical framework for hard constraints, quality evidence, economics, and current operational fit.
Read guideTool use, context, coding and agentic evidence, and long-running token economics.
Read guideExtraction reliability, structured output, context, and high-volume cost tradeoffs.
Read guideApply a hard price ceiling, then compare the strongest capable models that remain.
Read guideWhy independent benchmarks are important evidence but not the whole deployment decision.
Read guideRecommendation and runtime inference routing solve different problems.
Read guideInstall
ModelShortlist is a local stdio MCP server. You supply Artificial Analysis and OpenRouter credentials; there is no ModelShortlist account or hosted key vault in the middle.
Use your own Artificial Analysis and OpenRouter API keys. ModelShortlist does not issue or proxy either credential.
Use the npm package directly in your MCP client or follow the guided install page for client-specific config.
Describe the workload, hard constraints, and what you value. Your assistant can call ModelShortlist when it needs current evidence.
{
"mcpServers": {
"modelshortlist": {
"command": "npx",
"args": ["-y", "@agentic.artists/modelshortlist"],
"env": {
"ARTIFICIAL_ANALYSIS_API_KEY": "YOUR_KEY",
"OPENROUTER_API_KEY": "YOUR_KEY"
}
}
}
}Supported setup guidance includes Claude Desktop, Claude Code, Cursor, Hermes Desktop, and VS Code / Copilot. Windows configurations use npx.cmd where appropriate.
Local + open source
The project is intentionally a local BYOK context layer. It stays out of the inference path and keeps the architecture inspectable.
Your local MCP process calls upstream APIs directly.
ModelShortlist does not add product telemetry to the local MCP runtime.
Inspect the code, package contents, matching logic, and release workflow yourself.
The MCP retrieves and compares evidence; it does not place model calls or mutate external systems.
FAQ
A local evidence layer for model selection, with explicit attribution and current operational context.
No. The host AI weighs current evidence against your workload and constraints. Coding, extraction, long-context, latency-sensitive, budget-sensitive, and privacy-sensitive work can produce different shortlists.
Artificial Analysis supplies independent benchmark and performance evidence. ModelShortlist uses that evidence when it can confidently reconcile the exact model identity; it does not create or claim ownership of those benchmarks.
OpenRouter supplies the current model catalog plus operational facts such as context, supported parameters, pricing, providers, and ZDR endpoint information.
ModelShortlist tracks source freshness separately. It can use explicitly stale last-known-good evidence where appropriate, marks unavailable sources, and fails closed when a required source or hard privacy constraint cannot be verified.
No. The full OpenRouter catalog is considered by default. Zero Data Retention becomes a hard eligibility requirement only when you explicitly request ZDR.
No. ModelShortlist is a local stdio MCP server. Your local process uses the API credentials you provide to call the upstream services directly; there is no hosted ModelShortlist backend or MCP telemetry.
Install the local MCP, add your Artificial Analysis and OpenRouter keys, and let your assistant reason from current evidence for the workload in front of you.