Discord: AI error blocks thousands of accounts because of chessboard images
Due to an error in AI moderation, Discord has incorrectly blocked over 8,000 user accounts in the past few months. The triggers were harmless images and raster graphics. A software error also prevented human control from being carried out.
Faulty AI bans thousands of users
Between May and July 2026, the communications platform Discord permanently blocked around 8,200 accounts worldwide without authorization. The reason for the measure was an error in the service’s automated security system. Affected users had previously uploaded harmless graphics, but the internal software incorrectly classified them as malicious material. The objectionable content included everyday motifs. Users shared images of simple chessboards, screenshots of spreadsheets or inventory views from the computer game Minecraft. Simple transparent image backgrounds with the familiar gray and white checkered pattern also triggered the filter. The fact that such raster images were targeted by the control systems has a concrete technical background in the prosecution of crimes.
“Grid banned” for posting a game texture
by
u/Flynny__ in
BannedFromDiscord
Like the online magazine The Verge reported, malicious actors often use special grid patterns to obscure illegal material from detection systems and evade automated deletion. In order to detect and sort out illegal or abusive content on a large scale, platforms rely on an established process called perceptual hashing. The process first converts uploaded images into grayscale and greatly reduces the resolution. The system then divides the graphic into small square sections. Each area is assigned a specific brightness value, creating a unique digital fingerprint of the image. The security system then compares the result with known databases to automatically block prohibited content.
Human control failed
At Discord, the system is actually designed in such a way that if there is a suspected case, only the upload of the image is initially paused. A human moderator from the security team should then review the material in question. However, a program error in recent months led to accounts being immediately and permanently blocked. The system did not wait for the employees’ final decision. Even when human reviewers unblocked the accounts after a manual review, the internal error prevented the ban from being automatically lifted.
Discord technical director Stanislav Vishnevskiy explained that all affected accounts have now been unblocked. The company is currently working on better protective measures to reliably prevent similar incidents in the future. The incident shows the limits of automated moderation. While hashing processes are used effectively by technology companies such as Microsoft or Apple to prevent the spread of depictions of abuse, they carry the risk of false assessments. For users who use the platform every day for work or to exchange ideas in communities, a sudden exclusion has direct consequences.
