Vendors and modelsDeployer
Proctorio AI failures
Every documented AI failure involving Proctorio on the AI Failure Index, classified by the mechanism that broke.
- Failures
- 2
- Highest severity
- High
- Span
- 2020
- Failure modes
- 2
Proctorio accused of racial bias in AI proctoring during online exams
Multiple news outlets reported in mid to late 2020 that Proctorio’s AI-based remote proctoring and facial-recognition tools were alleged to have discriminated against students, particularly students of color. Coverage and campus protests raised questions about biased detection and identity-verification failures in automated proctoring systems.
- Confidence
- Medium (multi-source)
Proctorio's face detector failed to recognize Black faces 57% of the time, flagging students
Proctorio's remote proctoring software relied on OpenCV's Haar Cascade face detection model, which failed to detect Black faces 57 percent of the time according to testing by student researcher Akash Satheesan. The undetected faces triggered automated 'missing from frame' and 'low facial detection' flags that were reported to instructors as potential cheating indicators, disproportionately harming students of color. The bias was publicly exposed in press reports in April 2021 and prompted a US Senate inquiry led by Senator Richard Blumenthal.
- Confidence
- High (multi-source, primary)
See how Realm catches these failure modes at runtime, before they reach production.
Book a Demo