Release date
28th June 2026
Changes
Added 3,417 Active Learning images to the dataset. These samples were collected from our field devices based on model uncertainty signals (e.g., low confidence scores and ambiguous predictions) from previous model versions. They are intended to improve overall model performance.
Added 2,744 Reactive Learning images to the dataset. These are false positives and false negatives identified by customers and internal algorithms. Adding them follows a human-in-the-loop approach to address recurrent field issues and improve model robustness.
Model evaluation
Evaluation metrics
Model 4.31.0 is evaluated against the baseline model 4.30.0 on the same test set. The table below reports AP@0.5 and F0.45 for the person, safety cone and vehicle classes.
AI Model Version | AP@0.5 (person) | AP@0.5 (safety cone) | AP@0.5 (vehicle) | F0.45 (person) | F0.45 (safety cone) | F0.45 (vehicle) |
4.30.0 | 0.9280 | 0.8517 | 0.8080 | 0.9485 | 0.9108 | 0.8858 |
4.31.0 | 0.9276 | 0.8608 | 0.8091 | 0.9480 | 0.9150 | 0.8871 |
QA metrics
Both the current and baseline models are evaluated on 817 videos (roughly 261,000 labeled frames) to simulate real-world performance for the person class.
Classification accuracy measures the proportion of frames that were correctly identified as containing people or not containing people.
| 4.30.0 | 4.31.0 | %change |
False positive occurrences | 57 | 45 | -21.05% |
Classification accuracy | 0.9675 | 0.9677 | +0.02% |