Accuracy

The Accuracy dashboard provides various metrics to track the accuracy of your bem functions, with a dedicated editor for submitting feedback to improve their performance.

• You can filter by the exact functionName of the function, using the search bar on the left⁽¹⁾;
• Use the Label button⁽²⁾ (visible on hover) or click on the function' table row to open the function in the correction editor.

Correction Editor

The correction editor is composed of three resizable panels:

• The Inputs panel⁽¹⁾ on the left, where you can select one of the function's transformations to correct; You can filter the transformations by the exact referenceID using the search bar in the panel's header;
• The Preview panel⁽²⁾ in the middle, showing a preview of the selected transformation's input data for supported file types;
• The Output panel⁽³⁾ on the right, where you can edit and correct the transformation's output.

Using the Output Panel

The Output panel is where you can actually correct the transformation's output. It has two modes which you can switch between using the Switch to... editor button⁽¹⁾ in the top-right corner:

• Tree Editor - available for functions with simple JSON schemas, allows you to edit the output using a set of user-friendly input fields in a tree-like structure;
• Code Editor - allows you to edit the output as JSON in a code editor, with syntax highlighting and auto-completion.

Both modes show you eval results for every field⁽³⁾ - a confidence score the LLM judge assigned to the field and the reasoning behind it. You can use it to easily identify the fields that might need correction.

You can move between the least confident fields using the ⌘/Ctrl + ←/→ (arrow keys)

Submitting Corrections

To submit a correction:

1. Select the transformation you want to correct in the Inputs panel;
2. Using the Preview panel and eval results, correct the transformation's output in the Output panel;
3. Click the Submit correction button⁽²⁾ in the top-right corner, or use the ⌘/Ctrl + Enter keyboard shortcut to submit the correction and move to the next transformation from the inputs list.

Learn More