Instagram wrongly accuses some users of breaching child sex abuse rules

Instagram, owned by the tech giant Meta, has recently come under fire after wrongly banning several users for allegedly breaking rules related to child sexual exploitation. The BBC spoke to multiple people who experienced extreme stress and anxiety after their accounts were suddenly disabled. These users were accused of serious violations, but after their cases were brought to the attention of journalists, their accounts were quickly restored. One man, David from Aberdeen, described losing sleep and feeling isolated because of the false accusation. He said it was terrible to have such a serious claim made against him, especially when he had done nothing wrong.

The issue appears to be widespread. Over 100 people have contacted the BBC, saying they were wrongly banned by Meta. Some lost access to business pages, which affected their income, while others lost years of personal photos and memories. Many people have also reported mental health struggles as a result. A petition with more than 27,000 signatures accuses Meta's moderation system, which relies heavily on artificial intelligence, of making mistakes and having a poor appeal process. Thousands of users have joined Reddit forums to discuss being banned, and many have shared their stories on social media.

David's experience is not unique. He was banned from Instagram and Facebook in early June, accused of breaking community standards. He appealed, but his accounts were permanently disabled. He found a Reddit thread where many others shared similar stories. David said he lost over ten years of messages, photos, and posts. He described Meta's responses as embarrassing, with automated replies that did not address his concerns. After the BBC contacted Meta, his account was restored within hours, and he received an apology. David said it was a huge relief, but the experience left a lasting impact.

Faisal, a student in London, faced a similar situation. He was building a career in the creative arts and had started earning money through Instagram commissions. When his account was banned, he felt lost and upset. He said the false accusation damaged his mental health and left him feeling isolated. After the BBC intervened, his accounts were restored, and he received the same apology as David. Faisal is now cautious about using Instagram and worries the ban could affect future background checks.

Salim, another user, also had his accounts banned for the same reason. He said the appeal process was mostly ignored and that the AI system was labeling innocent people as criminals. After a week, his accounts were restored. Meta declined to comment on these specific cases or explain why the mistakes happened. Experts suggest the problem could be due to recent changes in community guidelines or a lack of a proper appeal process. Meta says it uses both people and technology to enforce its rules and that people can appeal if they think a mistake has been made. The company also reports any suspected child exploitation to authorities. However, many users feel the system is flawed and hope Meta will make improvements to prevent innocent people from being wrongly banned.