BenchGecko

Tools

Token cost is the o200k count of the tools list JSON, including schemas, before any tool is called.

• search_models

  Find AI models in the BenchGecko catalog by name, slug or lab. Returns slugs to use with get_model, cheapest_provider and compare_models, with BenchGecko score and list price.

• get_model

  Core facts for one AI model: BenchGecko score and rank, list price, price at every provider, benchmark scores with their original sources, Gecko Tests grades and as-of dates.

• cheapest_provider

  Every provider serving a model, sorted by input price per 1M tokens (refreshed daily from provider endpoints), with output price, quantization and 1 day uptime.

• compare_models

  Side by side: BenchGecko score, list price, cheapest provider, context window, shared benchmark scores and Gecko Tests grades for two models.

• get_gecko_test

  Results of one of BenchGecko's own tests (own measurements, CC BY 4.0): who-are-you (Does the model know which lab made it?) world-map (How well does the model draw the world map from memory?) censors

• get_scorecard

  BenchGecko Gecko Scorecard: every model across BenchGecko's own profile tests with a letter grade per test and an overall Gecko Score (behavior, not intelligence).

• latest_findings

  Latest notable results detected in the Gecko Tests and price data (fixed rules, numbers and quotes from stored results).

• search

  Search BenchGecko models and Gecko Tests. Returns ids for fetch.

• fetch

  Fetch the full record for an id returned by search (model:<slug>, gecko-test:<slug> or scorecard).