Dataset Quality Failure Benchmark

What this product does

Immutable, clearly labelled synthetic benchmark cases for deterministic regression and release-gate evaluation.

Who it is for

Not published yet.

Problems solved

Not published yet.

Update cadence

9 minutes ago

Pricing and access note

Not published yet. Pricing will appear on the verified external marketplace listing.

Source and provenance note

Foundry product package: ProductStudio public-safe metadata

Limitations

Review the sample, schema, source notes, marketplace availability, and cadence before depending on this product in production.

Delivery options

Not published yet. A link appears only after a verified external marketplace destination exists.

Sample and schema preview

• case_id (string)
• benchmark (string)
• category (string)
• title (string)
• input (string)
• expected_result (string)
• severity (string)
• rationale (string)
• synthetic (boolean)

{
  "rows": [
    {
      "input": "Synthetic evaluation input exercising Duplicate logical identifiers across rows under a bounded deterministic test harness.",
      "title": "Duplicate logical identifiers across rows",
      "case_id": "dataset_quality_failure-001",
      "category": "duplicate_keys",
      "severity": "high",
      "benchmark": "Dataset Quality Failure Benchmark",
      "rationale": "This authored case verifies duplicate_keys without representing a real buyer, source record, or model run.",
      "synthetic": true,
      "expected_result": "Report the duplicate group and retain one deterministic canonical row."
    },
    {
      "input": "Synthetic evaluation input exercising Required identifier is missing under a bounded deterministic test harness.",
      "title": "Required identifier is missing",
      "case_id": "dataset_quality_failure-002",
      "category": "missing_required",
      "severity": "high",
      "benchmark": "Dataset Quality Failure Benchmark",
      "rationale": "This authored case verifies missing_required without representing a real buyer, source record, or model run.",
      "synthetic": true,
      "expected_result": "Reject the affect

Related products and use cases

Related products and use-case links are not published yet.