Get Score Run

Hand off to an LLM

Get the status and per-pair results of a score run.

Returns aggregate only once status reaches completed. perPair is populated incrementally — each pair's fieldResults appears as its underlying function call terminates.

GET
/v3/eval/score/{scoreRunID}
x-api-key<token>

Authenticate using API Key in request header

In: header

Path Parameters

scoreRunID*string

The scoreRunID returned by POST /v3/eval/score.

Response Body

application/json

application/json

curl -X GET "https://api.bem.ai/v3/eval/score/string"
{
  "scoreRunID": "evalrun_2a8f...",
  "status": "completed",
  "functionName": "invoice-extractor",
  "functionVersionNum": 3,
  "matchConfig": {
    "numericTolerance": 0.01,
    "stringMatch": "exact"
  },
  "progress": {
    "total": 1,
    "completed": 1,
    "failed": 0
  },
  "aggregate": {
    "precision": 1,
    "recall": 1,
    "f1": 1,
    "exactMatches": 2,
    "withinTolerance": 0,
    "fuzzyMatches": 0,
    "misses": 0,
    "extras": 0,
    "totalFieldsExpected": 2,
    "totalFieldsActual": 2
  },
  "perPair": [
    {
      "pairIndex": 0,
      "callID": "call_xxx",
      "status": "completed",
      "fieldResults": [
        {
          "path": "/invoiceNumber",
          "match": "exact"
        },
        {
          "path": "/total",
          "match": "exact"
        }
      ]
    }
  ]
}
{
  "message": "string",
  "code": 0,
  "details": {}
}

See also