Correct calls
0%
- Talos 1.183%
- Claude Opus 5.580%
- GPT-6.1 Sol74%
- Claude Sonnet 5.572%
Scale: 70% to 83%
The most accurate of the four
On Security-Bench 1.3, Knolt-Talos 1.1 made the right call 83% of the time and caught 75% of incidents. Claude Opus 5.5: 80% and 69%. It decides in 0.24 s, on your own GPU.
Each lane runs for its model’s real median time to one decision. Knolt decides 7× faster than the fastest of the rest, Claude Opus 5.5.
On incidents caught, the frontier models trail far behind Knolt. Only on correct calls do they come close.
| Measure | Knolt-Talos 1.1Knolt | Claude Opus 5.5Anthropic | GPT-6.1 SolOpenAI | Claude Sonnet 5.5Anthropic |
|---|---|---|---|---|
| Correct incident calls | 83% | 80% | 74% | 72% |
| Incidents caught | 75% | 69% | 54% | 51% |
| Alerts that were real | 88% | 85% | 86% | 86% |
| Ordinary moments left alone | 91% | 89% | 92% | 92% |
| Ranking quality (AUC) | 91% | 87% | 85% | 84% |
| Time to one decision | 0.24 s | 1.71 s | 2.81 s | 1.91 s |
| Runs on your own GPU | Yes | No | No | No |
Security-Bench 1.3: real security-camera frames and staged security scenes, with incidents and ordinary or lookalike moments. Every model got the same images and the same question.
Each scale runs from the pack to Knolt’s score, so the gaps are easy to see.
Correct calls
0%
Scale: 70% to 83%
The most accurate of the four
Incidents caught
0%
Scale: 45% to 75%
The most incidents caught
Ranking quality (AUC)
0%
Scale: 80% to 91%
Closest to a perfect ranking
Alerts that were real
0%
Scale: 80% to 88%
The most alerts that were real
Security-Bench 1.3 is Knolt’s test of one question: is this a security incident?
It mixes real security-camera frames, taken during robberies and ordinary moments, with short staged scenes filmed the way a security camera sees them: real incidents, and moments that only look like one, such as a hug or a handful of dropped papers.
We count correct calls, incidents caught, alerts that were real, ordinary moments left alone, and AUC: how well each model ranks every incident above every ordinary moment.