WorkSeptember 4, 2026via The Verge AI

Instagram’s AI detection is a mess (again)

Why it matters

Instagram's AI content labeling system is producing false positives and false negatives at scale, undermining trust in platform detection systems and raising questions about the reliability of automated AI detection in production.

Key signals

  • Instagram applying 'AI Content' labels to images created with non-generative tools (Canva Background Remover, etc.)
  • Actual AI-generated imagery escaping detection
  • System failure affecting user trust and platform integrity
  • Detection mechanism precision problems in production deployment
  • Instagram applying 'AI Content' labels to non-AI images (false positives)
  • Actual AI imagery not being caught (false negatives)
  • Label appearing on images edited with Canva Background Remover and similar non-generative tools
  • System failure happening 'over the last few weeks' (ongoing, not isolated)
  • Root causes described as 'vary' — suggesting no single source or quick fix

The hook

Meta's AI detection is labeling non-AI images while missing actual AI content—a cautionary tale on detection reliability at scale.

Instagram's visible AI labels are supposed to help people quickly spot synthetically generated content at a glance. Over the last few weeks, however, users have been reporting that the system has gone haywire. They say Meta has been automatically applying an "AI Content" label to images that they di

The week's key stories, every Friday.

ONE BRIEFING · EVERY FRIDAY · FREE

Free. Unsubscribe anytime.