AI Mistake: Student Handcuffed

An artificial intelligence (AI) security system at a Maryland high school misidentified a student’s snack bag as a firearm, leading to a police response and the student being handcuffed. The incident has prompted calls for a review of AI technology deployment in schools.

Story Highlights:

  • An Omnilert AI system at Kenwood High School in Baltimore County flagged a Doritos bag as a firearm.
  • The alert resulted in a police response, during which student Taki Allen was handcuffed and searched.
  • The AI vendor stated the system “worked as intended,” despite the false positive.
  • Baltimore County officials have requested a review of AI implementation in schools.

Incident Details

At Kenwood High School in Baltimore County, Maryland, a student, Taki Allen, was reportedly eating snacks when the Omnilert AI gun detection system mistakenly identified his Doritos bag as a firearm. The system, which utilizes computer vision, issued an emergency alert. This led to law enforcement officers arriving at the school. Allen was subsequently handcuffed and searched.

Initial review by school security personnel reportedly led to the cancellation of the alert, recognizing it as a false positive. However, Principal Katie Smith was reportedly not informed of the cancellation and proceeded to notify the school resource officer, which initiated the police response.

Vendor Response and System Concerns

Omnilert, the company responsible for the AI detection system, issued a statement acknowledging the incident. The company maintained that the system “functioned as intended,” emphasizing the role of human review in the alert process.

Security technology analysts have expressed concerns regarding the susceptibility of AI systems to false positives, particularly in dynamic environments such as schools. These systems can reportedly misclassify objects with similar shapes or those held at unusual angles.

Deployment and Review

Baltimore County Public Schools implemented Omnilert’s AI system as part of broader security enhancements. Following the incident, Baltimore County leaders have called for a comprehensive review of the AI system and its deployment protocols. Principal Katie Smith has acknowledged a communication breakdown and apologized to parents.

Watch the report: Student handcuffed after Doritos bag mistaken for a gun by school’s AI security system

Source: