Agent Comparer
Compare AI agent price, performance, and capabilities with comprehensive analytics and real-time data. Building application-specific efficient routing logic. Alpha release focuses on single agent decision process
12
Providers
182
Models
API Call
curl -X 'POST' \
'http://localhost:8000/api/agents/compare' \
-H 'accept: application/json' \
-H 'X-API-Key: '' \
-H 'Content-Type: application/json' \
-d '{
"models": [
{
"provider": "openai",
"model_family": "o1",
"model_name": "o1-preview-2024-09-12"
}
],
"input_tokens": 129291,
"output_tokens": 2818,
"metadata": {
"agent_id": "fin_analysis_1",
"task_id": "10K_analyzer_step2"
}
}'
API Response
{
"comparisons": [
{
"provider": "openai",
"model_family": "o1",
"model_name": "o1-preview-2024-09-12",
"input_cost": 1.939365,
"output_cost": 0.16908,
"total_cost": 2.108445
}
],
"cheapest_option": {
"provider": "openai",
"model_family": "o1",
"model_name": "o1-preview-2024-09-12",
"input_cost": 1.939365,
"output_cost": 0.16908,
"total_cost": 2.108445
},
"token_counts": {
"input_tokens": 129291,
"output_tokens": 2818
},
"metadata": {
"agent_id": "fin_analysis_1",
"task_id": "10K_analyzer_step2"
},
"transaction_id": "k1BbquD7U8W5-_h9_XlKQw"
}
Price & Performance
Track and compare agent and model price and performance metrics
Real-time Data
Access up-to-date performance metrics and comparison data through our API.
Notification
Get notification of important changes and trends
Agent Model Optionality (2025-01-25)
| PROVIDER | MODEL FAMILY | MODEL NAME | CONTEXT LENGTH (K) | INPUT PRICE ($/MTK) | OUTPUT PRICE ($/MTK) | ... |
|---|---|---|---|---|---|---|
| together | deepseek | DeepSeek-V3 | 8 | 1.25 | 1.25 | ... |
| cohere | command | command_r_03_2024 | 128 | 0.5 | 1.5 | ... |
| hyperbolic | text_to_text | qwen2_5_coder_32b | 128 | 0.2 | 0.2 | ... |
| openai | gpt4o | gpt-4o | 128 | 2.5 | 10.0 | ... |
| deepinfra | 7_8_billion_parameters | Llama-3.1-8B-Instruct | 128 | 0.03 | 0.05 | ... |
| Login to access full dataset and API key for free | ||||||