Discord admits AI moderation bug wrongfully banned users over harmless images

Discord confirmed that an AI moderation bug had been wrongly banning users over harmless images since May. The company said another 200 accounts were banned over the weekend before its team identified and fixed the issue.

The incident highlights the risks of automated enforcement when moderation systems misclassify benign content. As platforms expand AI safety tools, they will face more pressure to improve auditing, appeals, and transparency around wrongful bans.