A 22-year-old student teacher in Illinois sent a frustrated message to a private Snapchat group chat with her boyfriend and two roommates. A student had just walked up to her laptop and deleted her lesson plan mid-class. She typed something like “should I shoot him” with a gun emoji. Venting. Four people. Private group chat.
An hour later, police walked into her school and arrested her.
🔍 THE BOTTOM LINE
Snapchat scans private messages. Not just public posts or stories — private group chats between you and your closest contacts. Automated AI, no human reviewed it first. The AI flagged the message as a potential threat, automatically reported it to the FBI, the FBI forwarded it to local law enforcement, and deputies arrived at the school within the hour. The message was private. It wasn’t.
What Happened
According to multiple reports, Kristen Volpe was a student teacher at John L. Hensey Elementary School in Illinois when a pupil interfered with her laptop and caused her to lose a lesson plan. Frustrated, she sent a message to a private Snapchat group of three people — her boyfriend and two roommates — that included a remark about shooting the pupil, which she later described as a joke made out of frustration.
Snapchat’s AI scanned the private message. Flagged it as a potential threat. Automatically reported it to the FBI. The FBI forwarded it to local law enforcement. Deputies arrived at the school within the hour.
Volpe cooperated immediately. She handed over her phone. When shown the message, bodycam footage captures her saying: “Oh yes. Okay. Yeah. I’m realising that was a bad joke. I did not mean it at all serious at all.”
Police determined she was not a threat. School officials determined she was not a threat. Prosecutors reviewed and issued a disorderly conduct charge. She was released the next morning. She lost her student teaching placement.
The Chain: AI → FBI → Police → Arrest
The sequence is worth laying out plainly:
- Private message sent — to three people in a private group chat
- Snapchat AI scanned it — automated, no human at Snapchat reviewed it first
- AI flagged it — as a potential threat based on language detection
- Snapchat reported it to the FBI — under its safety policy
- FBI forwarded to local law enforcement — within minutes
- Police arrived at the school — within the hour
- Arrest — disorderly conduct charge
- Consequences — lost her student teaching placement
No human at any point in this chain reviewed the message in context. No human determined whether it was a genuine threat or a frustrated joke. The determination of “risk of harm” was made by an algorithm.
Snapchat’s Privacy Policy
Snapchat’s privacy policy says the platform may share user information with law enforcement when it believes there is a risk of harm. The key phrase: “it believes.” The “it” is Snapchat’s AI, not a human reviewer.
The policy does not say:
- That private messages are scanned by AI
- What thresholds trigger a flag
- How the AI determines what constitutes a “risk of harm”
- Whether users are notified when a report is filed
Users are not told when a message is flagged. Users are not told when a report is filed. You find out when the police arrive.
The Broader Pattern
This is not an isolated case. It is part of a pattern where platforms deploy AI monitoring across private communications — and the monitoring is designed to err on the side of reporting rather than discretion.
Snapchat is not the only platform scanning private messages. Meta scans WhatsApp and Messenger. Google scans Gmail. Microsoft scans Outlook. The difference is that Snapchat’s case produced an arrest — making the surveillance visible in a way that metadata collection and ad targeting are not.
The question is not whether platforms should detect genuine threats. The question is whether an algorithm, with no human review, should be able to initiate a law enforcement response to a private message — and whether the person who sent the message has any right to know it happened before the police show up.
The NZ Angle
New Zealand’s Office of the Privacy Commissioner has flagged social media monitoring as a privacy concern, noting that it “can chill personal and political expression and other core democratic rights.” The Privacy Act 2020 governs how personal information is collected and shared, but it does not specifically address AI scanning of private messages by offshore platforms.
The practical question for NZ users: Snapchat, Meta, Google, and Microsoft all operate under US law. Their AI scanning practices are governed by US corporate policy, not NZ privacy law. When Snapchat’s AI flags a message from a NZ user and reports it to the FBI, the FBI can and does share that information with NZ Police through existing intelligence-sharing arrangements.
NZ users have no domestic legal protection against this. The Privacy Commissioner can investigate how NZ-based companies handle personal information, but Snapchat, Meta, and Google are not NZ-based companies. The Privacy Act’s reach ends at the border.
❓ FAQ
Does Snapchat scan all private messages? Snapchat’s privacy policy says it may share information with law enforcement when it believes there is a risk of harm. The case of Kristen Volpe confirms that private group chats are included in this scanning. Snapchat has not publicly disclosed what percentage of private messages are scanned or what thresholds trigger a flag.
Was Kristen Volpe convicted? She was charged with disorderly conduct and released the next morning. She lost her student teaching placement. The outcome of the charge has not been widely reported.
Can this happen in New Zealand? Yes. Snapchat operates under US law and its AI scanning applies to all users globally. If Snapchat’s AI flags a message from a NZ user, it can report it to the FBI, which can share it with NZ Police through intelligence-sharing arrangements. NZ’s Privacy Act does not govern offshore platforms.
Do other platforms scan private messages? Yes. Meta scans WhatsApp and Messenger. Google scans Gmail for child exploitation content. Microsoft scans Outlook. The practice is standard across major platforms, though the thresholds and reporting mechanisms vary.
Was a human involved in the decision to report? According to the available reporting, no. Snapchat’s AI flagged the message and reported it automatically. The first human in the chain was law enforcement.
🔍 THE BOTTOM LINE
The definition of “private” has changed. A message sent to three friends in a closed group chat is now scanned by AI, evaluated for threat potential, and potentially reported to federal law enforcement — all without the sender’s knowledge or consent, and without any human review. Kristen Volpe lost her teaching placement over a frustrated joke. The next person might not be joking. But the system that caught them is the same system that caught her, and it cannot tell the difference.
📰 Sources
- We Got This Covered — Illinois teacher picks up her phone in ‘exasperation,’ police march in and arrest her
- NIPH Pulse — Private Snapchat Message Leads to Arrest of Illinois Student Teacher
- Reddit r/privacy — Does the arrest of people for ‘joke’ private messages change your habits?
- Snapchat Privacy Policy
- NZ Office of the Privacy Commissioner — Social media monitoring
— CJ Murden, editor of Singularity.Kiwi. Former digital technologies teacher, author of AI-focused books. Writing with a New Zealand focus.
