From oh-my-daily-skills
Tests LLM models via OpenRouter using bash script, measuring latency, cost, token usage, and outputs. Supports model ID formats, :nitro/:online modifiers, rankings, and provider comparisons for optimal selection.
npx claudepluginhub shiqkuangsan/oh-my-daily-skillsThis skill uses the workspace's default tool permissions.
Quickly test LLM models and find the best one for your task.
Queries OpenRouter for 300+ AI models' pricing, context lengths, capabilities, throughput, provider latency/uptime. Scripts to list, search, compare, resolve names, find optimal providers.
Queries OpenRouter's 400+ LLM catalog API to list, filter by pricing/context/tools, and compare models/providers. Use for model selection in AI apps.
Compares AI and LLM models on benchmarks, capabilities, cost, latency, context window, and task-specific fit to help select optimal models for production use cases and budgets.
Share bugs, ideas, or general feedback.
Quickly test LLM models and find the best one for your task.
export OPENROUTER_API_KEY="sk-or-v1-xxxx"
Use scripts/call_openrouter.sh:
# Basic test
bash scripts/call_openrouter.sh \
--model "anthropic/claude-sonnet-4" \
--prompt "Explain quantum computing in one sentence" \
--json
# With parameters
bash scripts/call_openrouter.sh \
--model "openai/gpt-4o" \
--prompt "Write a haiku about code" \
--max-tokens 100 \
--temperature 0.7 \
--json
Output includes: response time (ms), cost ($), token usage, full response
Parameters:
--model: Model ID (required)--prompt: Prompt text (required)--system: System prompt (optional)--max-tokens: Max tokens--temperature: Temperature 0.0-2.0--json: JSON outputprovider/model-name[:modifier]
Common models:
anthropic/claude-sonnet-4openai/gpt-4oopenai/gpt-4o-minigoogle/gemini-2.0-flash-001deepseek/deepseek-chatModifiers:
:nitro - Use fastest provider:online - Enable web searchanthropic/claude-sonnet-4:nitro:onlinehttps://openrouter.ai/rankings?category=<category>#categories
| Category | URL |
|---|---|
| Programming | https://openrouter.ai/rankings?category=programming#categories |
| Translation | https://openrouter.ai/rankings?category=translation#categories |
| Science | https://openrouter.ai/rankings?category=science#categories |
| Finance | https://openrouter.ai/rankings?category=finance#categories |
| Legal | https://openrouter.ai/rankings?category=legal#categories |
| Academia | https://openrouter.ai/rankings?category=academia#categories |
| Marketing | https://openrouter.ai/rankings?category=marketing#categories |
| SEO | https://openrouter.ai/rankings?category=marketing/seo#categories |
https://openrouter.ai/<model-slug>/providers?sort=<sort>
Sort options:
throughput - By throughput (tokens/sec)latency - By latencyprice - By priceExample: Find fastest provider for claude-sonnet-4
https://openrouter.ai/anthropic/claude-sonnet-4/providers?sort=throughput
curl -s https://openrouter.ai/api/v1/models \
-H "Authorization: Bearer $OPENROUTER_API_KEY" \
| jq '.data | sort_by(.pricing.prompt) | .[:10] | .[].id'
# Output: top 10 cheapest models
# Test Claude
bash scripts/call_openrouter.sh --model "anthropic/claude-sonnet-4" --prompt "Explain microservices architecture" --json > claude.json
# Test GPT-4o
bash scripts/call_openrouter.sh --model "openai/gpt-4o" --prompt "Explain microservices architecture" --json > gpt4o.json
# Compare results
jq -s '[.[0], .[1]] | map({model, response_time_ms, cost})' claude.json gpt4o.json
https://openrouter.ai/rankings?category=programming#categoriesConsiderations:
:nitro modifiergpt-4o-mini or deepseek-chatclaude-sonnet-4 or gpt-4oFor API details, query OpenRouter documentation via Context7.