Evaluation event

Delivered when a function-accuracy evaluation completes for a transformation. The evaluator's scores and per-field judgments are in result; check status for terminal success/failure.

For signing-secret setup and retry semantics that apply to every variant, see the Webhooks overview.

Request Body

application/json

TypeScript Definitions

Use the request body type in TypeScript.

functionCallTryNumber?integer

The attempt number of the function call that created this event. 1 indexed.

eventID*string

Unique ID generated by bem to identify the event.

createdAt?string

Timestamp indicating when the event was created.

Formatdate-time

referenceID*string

The unique ID you use internally to refer to this data point, propagated from the original function input.

inboundEmail?

The inbound email that triggered this event.

metadata?

eventType?string

Value in"evaluation"

functionCallID?string

Unique identifier of function call that this event is associated with.

functionID*string

Unique identifier of function that this event is associated with.

functionName*string

Unique name of function that this event is associated with.

functionVersionNum?integer

Version number of function that this event is associated with.

callID?string

Unique identifier of workflow call that this event is associated with.

workflowID?string

Unique identifier of workflow that this event is associated with.

workflowName?string

Name of workflow that this event is associated with.

workflowVersionNum?integer

Version number of workflow that this event is associated with.

transformId*string

Unique ID of the transformation that was evaluated.

evaluationVersion*string

Version identifier of the evaluation logic that produced this result.

result*object

Evaluator output. Shape depends on evaluationVersion and includes confidence scores, per-field hallucination flags, and relevance metrics.

status*string

Terminal status of the evaluation run.

Value in"success" | "failed"

errorMessage?string

Failure reason populated when status is failed.

Response Body

Example Requests

Emitted when a function-accuracy evaluation completes for a transformation. Evaluations are scheduled by POST /v3/eval and run asynchronously; this event reports the terminal result.

POST/evaluation

Evaluation event

Request Body

Response Body

2XX

Request Bodyapplication/json

See also