jevrecipes

Recipe catalog / verify

Verify claims

Check each supplied claim against its paired evidence.

You need to know whether a claim is supported by its supplied evidence.

Explore this recipe interactively ยท Source and implementation guide

Use verify in TypeScript

Install with npm install jev-recipes. Requires Node.js 22.9 or newer and ES modules. Set TYPESAFE_API_KEY in your server environment for live calls, which send input to TypeSafe and use API quota. See the installation guide.

import { verify } from 'jev-recipes/verify';

const result = await verify({
  "claims": [
    {
      "id": "refund-window",
      "claim": "Customers can request a refund within 60 days.",
      "evidence": "Refunds are available only within 30 days of purchase."
    },
    {
      "id": "support-hours",
      "claim": "Support is available on weekdays.",
      "evidence": "Contact our support team Monday through Friday, 9 am to 5 pm."
    }
  ],
  "minConfidence": 0.8
});
console.log(result);

Input contract

FieldTypeNeeded
claimsarrayRequired
minConfidencenumberOptional
Full input and result schemas
{
  "input": {
    "$schema": "https://json-schema.org/draft/2020-12/schema",
    "type": "object",
    "properties": {
      "claims": {
        "minItems": 1,
        "maxItems": 100,
        "type": "array",
        "items": {
          "type": "object",
          "properties": {
            "id": {
              "type": "string"
            },
            "claim": {
              "type": "string"
            },
            "evidence": {
              "type": "string"
            }
          },
          "required": [
            "id",
            "claim",
            "evidence"
          ]
        }
      },
      "minConfidence": {
        "type": "number",
        "minimum": 0,
        "maximum": 1
      }
    },
    "required": [
      "claims"
    ]
  },
  "result": {
    "$schema": "https://json-schema.org/draft/2020-12/schema",
    "type": "object",
    "properties": {
      "model": {
        "type": "string"
      },
      "usage": {
        "type": "object",
        "properties": {
          "input_tokens": {
            "type": "integer",
            "minimum": 0,
            "maximum": 9007199254740991
          },
          "output_tokens": {
            "type": "integer",
            "minimum": 0,
            "maximum": 9007199254740991
          }
        },
        "required": [
          "input_tokens",
          "output_tokens"
        ],
        "additionalProperties": false
      },
      "checks": {
        "type": "array",
        "items": {
          "type": "object",
          "properties": {
            "id": {
              "type": "string"
            },
            "status": {
              "type": "string",
              "enum": [
                "ready",
                "review"
              ]
            },
            "verdict": {
              "type": "string",
              "enum": [
                "supported",
                "contradicted",
                "unsupported"
              ]
            },
            "confidence": {
              "type": "number",
              "minimum": 0,
              "maximum": 1
            },
            "probabilities": {
              "type": "object",
              "propertyNames": {
                "type": "string",
                "enum": [
                  "supported",
                  "contradicted",
                  "unsupported"
                ]
              },
              "additionalProperties": {
                "type": "number",
                "minimum": 0,
                "maximum": 1
              },
              "required": [
                "supported",
                "contradicted",
                "unsupported"
              ]
            }
          },
          "required": [
            "id",
            "status",
            "verdict",
            "confidence",
            "probabilities"
          ],
          "additionalProperties": false
        }
      },
      "allSupported": {
        "type": "boolean"
      }
    },
    "required": [
      "model",
      "usage",
      "checks",
      "allSupported"
    ],
    "additionalProperties": false
  }
}

Saved example result

This hand-authored response demonstrates the contract. It is not a model accuracy measurement. Run it without an API key: npx jev-recipes demo verify.

{
  "model": "demo-fixture",
  "usage": {
    "input_tokens": 0,
    "output_tokens": 0
  },
  "checks": [
    {
      "id": "refund-window",
      "status": "ready",
      "verdict": "contradicted",
      "confidence": 0.94,
      "probabilities": {
        "supported": 0.01,
        "contradicted": 0.97,
        "unsupported": 0.02
      }
    },
    {
      "id": "support-hours",
      "status": "ready",
      "verdict": "supported",
      "confidence": 0.92,
      "probabilities": {
        "supported": 0.96,
        "contradicted": 0.01,
        "unsupported": 0.03
      }
    }
  ],
  "allSupported": false
}

Evaluation evidence

Unknown response origin

No verified live accuracy measurement is available. Evaluate representative cases before using this decision in your workflow.

Use the evaluation guide to measure this decision on your own labeled cases.

Limitations

Related recipes