Evaluation Scoring Issue Identified and Being Resolved

Incident Report for Level AI Status

Resolved

This incident has been resolved. All evaluation scores that were affected from today's bug have been fixed. Please reach out to support for any further assistance.
Posted May 21, 2025 - 17:10 UTC

Monitoring

The root cause has been fixed. Any evaluations done henceforth should have correct scores. Evaluations done earlier today which had the bug, are currently being fixed.
Posted May 21, 2025 - 16:20 UTC

Identified

We’ve identified an issue affecting the scoring of evaluations—both Instascore and Manual QA—across all customers. As a result, you may notice discrepancies in scores (e.g., getting all questions correct but not receiving 100%).

The root cause has been identified, and a fix is currently being deployed. Users can continue to evaluate conversations as usual; total scores will be corrected automatically.

We expect the issue to be fully resolved by the end of the day.
Posted May 21, 2025 - 15:02 UTC
This incident affected: Conversations List, Conversation Details, and Analytics.