Deepfake deception: Indian woman's identity stolen for erotic AI content

In India, a shocking case has come to light involving a woman named Sanchi, whose identity was stolen and used to create a fake Instagram influencer called Babydoll Archi. The account quickly gained popularity, reaching 1. 4 million followers after a few viral posts, including a video of Babydoll Archi dancing in a red sari and a photo with a well-known American adult film star. The internet buzzed with curiosity about this new influencer, and her name trended on Google, spawning memes and fan pages. However, the truth was that Babydoll Archi was not a real person. The face on the account was created using artificial intelligence and looked almost exactly like Sanchi, a homemaker from Assam who had no social media presence. Sanchi only learned about the account when news outlets began reporting on Babydoll Archi, speculating about her possible future in the US adult film industry. The situation came to light when Sanchi’s brother filed a police complaint, providing printouts of the fake photos and videos as evidence. The police investigation revealed that Sanchi’s ex-boyfriend, Pratim Bora, was behind the account. Bora, a mechanical engineer with a strong interest in artificial intelligence, used Sanchi’s private photos to create the fake profile. At first, he posted real photos that had been altered, but as time went on, he used AI tools like ChatGPT and Dzine to generate deepfake images and videos. The account started to gain attention last year, but it really took off in April. Sanchi and her family were completely unaware of the account until it became a viral sensation. The police, led by officer Sizal Agarwal, contacted Instagram to find out who created the account. Once they learned it was Pratim Bora, they arrested him and seized his electronic devices and bank documents. The investigation showed that Bora had monetized the account, earning about one million rupees, with 300,000 rupees made in just five days before his arrest. Sanchi was devastated by the situation, but she and her family are now receiving counseling and support. Officer Agarwal said that it is very difficult to prevent these kinds of incidents, especially when the victim is not active on social media. Sanchi’s family only discovered the account after it went viral, and they had been blocked from seeing it. Instagram’s parent company, Meta, has not commented on the case, but the platform generally does not allow explicit content. Recently, Meta announced that it had removed ads promoting AI tools used to create sexually explicit deepfakes. AI expert and lawyer Meghna Bal commented that what happened to Sanchi is terrible but almost impossible to prevent. She explained that Sanchi could go to court to have her name and images removed from the internet, but it is very hard to erase all traces. Bal pointed out that women’s photos and videos have often been shared online as a form of revenge, and AI has made it even easier. She also noted that many cases may go unreported because of stigma or because victims are unaware, as in Sanchi’s case. The police have charged Bora with several crimes, including sexual harassment, distribution of obscene material, defamation, forgery, and cybercrime. If convicted, he could face up to ten years in prison. The case has sparked outrage on social media, with many people calling for tougher laws to address such crimes. However, Bal believes that while there are already laws in place, lawmakers need to be careful when creating new regulations for AI companies, as overly strict laws could limit free speech.

This incident highlights the dangers of new technology and the importance of protecting personal information online. It also shows the challenges faced by law enforcement in dealing with crimes involving artificial intelligence and social media.

As technology continues to advance, it is crucial for individuals to be aware of the risks and for companies and governments to work together to protect people from harm. Sanchi’s story serves as a reminder to be cautious with personal photos and to seek help if you suspect your identity is being misused online.