# MCP Tool Selection Benchmark

> Test agent tool-selection behaviour with a versioned synthetic MCP benchmark and documented evaluation expectations.

## Product

- [Product page](https://zentrafoundry.com/product/mcp-tool-selection-benchmark/)
- [Catalogue guide](https://zentrafoundry.com/llms.txt)

## Description

Create a repeatable baseline for the tool-selection scenarios supplied in this MCP-focused benchmark. The dataset is intended for developers evaluating how their own agent workflow chooses among the tool options represented by the fixtures. What this download contains Synthetic cases are not an independently validated model leaderboard or a universal measure of safe tool use. The benchmark’s documented task definitions and expected outcomes determine what a result can legitimately demonstrate. Working with this edition Review the supported scenarios, map them to your test harness and retain the case version with each run. Keep evaluation isolated from real external side effects and compare changes against the same documented expectations. Product questions Does the package run an MCP server for me? No hosted service is promised. The product is a benchmark dataset; use the included documentation to identify any supplied local tooling. Does a passing score prove an agent chooses tools safely? No. It describes performance on the included synthetic cases, not every possible real-world situation.

## Dataset edition

- Edition: zf-030-2026-1-535959e9d69a
- Files: CHANGELOG.md; LICENSE.md; README.md; REFUND.md; SUPPORT.md; artifacts/changelog-CHANGELOG.md; artifacts/checksums-checksums.json; artifacts/data-dictionary-DATA-DICTIONARY.md; artifacts/full-full.csv; artifacts/full-full.jsonl; artifacts/full-full.parquet; artifacts/known-limitations-KNOWN-LIMITATIONS.md; artifacts/license-LICENSE.md; artifacts/manifest-manifest.json; artifacts/provenance-provenance.json; artifacts/quality-report-quality-report.json; artifacts/readme-README.md; artifacts/sample-sample.csv; artifacts/schema-schema.json; artifacts/source-policy-source-policy.json; checksums.json; cover.svg; download-manifest.json; gumroad-product.json; health-check.json; output-contract.json; quality-manifest.json; rollback.json; sample-data.json; smoke-fixture.json
- Formats: CSV; JSON; JSONL; MD; PARQUET; SVG
- Archive size in bytes: 21813
- Row counts by table: all_records: 8
- Row units by table: all_records: synthetic test cases
- Coverage: Immutable, clearly labelled synthetic benchmark cases for deterministic regression and release-gate evaluation.
- Geographic scope: Immutable, clearly labelled synthetic benchmark cases for deterministic regression and release-gate evaluation.
- Publisher: Zentra-authored synthetic benchmark cases
- Publisher/source update: Explicitly unknown; see immutable provenance for the recorded source retrieval.
- Source retrieved/checked for this edition: 2026-07-14T18:22:46+02:00
- Edition published: 2026-07-14T18:22:46+02:00
- Schema version: https://json-schema.org/draft/2020-12/schema
- Licence and attribution: # Marketplace licence Use is governed by the licence and terms shown on the canonical marketplace listing. Source provenance and third-party source rights remain attached to delivered artifacts. No custom or negotiated licence is implied.
- Source basis: Zentra-authored synthetic benchmark cases (synthetic; no external source)

## Schema

- case_id (string): 
- benchmark (string): 
- category (string): 
- title (string): 
- input (string): 
- expected_result (string): 
- severity (string): 
- rationale (string): 
- synthetic (boolean): 

## Public preview

- [Bounded dataset sample](https://zentrafoundry-public-media.fsn1.your-objectstorage.com/media/samples/zf-030-2026-1-535959e9d69a.json)

## Purchase and delivery

- Price: EUR 29
- Price and tax basis: Owner-inventory EUR list price migrated to WooCommerce; checkout tax treatment follows the live WooCommerce configuration.
Your purchase includes the edition described on this page. Later releases are separate unless this offer explicitly includes an update entitlement.

## Maintenance

Source checks and new-release publication do not change the historical coverage or automatically add future editions to an earlier purchase.
Scheduled checks reconcile approved publisher editions. A check date does not change the dataset coverage or imply new records. Fixed historical and synthetic editions retain their documented scope.

Purchased archives are delivered through [My Library](https://zentrafoundry.com/my-account/). Public samples do not grant access to the full paid dataset.

Publisher edition index last reconciled: 2026-10-12 09:29:46 UTC. This is not a source-data update date.