Confidence Scores
How to generate and access confidence scores
Confidence Scores are in Alpha and execute only for enums smaller than 1000. Reach out with feedback or questions regarding your confidence scoring.
If your enum size is greater than 1000, you may leverage a Filtering task (see below) where the limit is larger.
Overview
Lume generates confidence scores for lookup tables, allowing users to review lookup tables more easily. Confidence values are categorized into Confident, Very High, High, Medium, Low, Very Low, and Incorrect.
Triggering Confidence Score Generation
To manually trigger confidence score generation for a finished job:
- Click Generate Confidence Scores in the App Workshop
- Call the Generate Confidence Score Endpoint via the API
Confidence scores are automatically generated for Filtering tasks.
Classification vs Filtering
Confidence scores apply to both classification and filtering lookup tasks. Below are the differences in relation to confidence score generation:
Limit of 1000 enums.
Generates classification confidence based on semantic similarity of key-value pairs.
Confidence scores are accessible via the API through the Spec of the result object.
Accessing Confidence Scores
Confidence scores are accessible via the API through the Spec of the result object. Example: