Meta's Instagram has been in the news recently, and it's not for any good reason. An investigation by the BBC found that the platform has been running paid advertisements promoting child sexual abuse imagery (CSAM) in India.
These ads connected users to channels on the Telegram messaging app, with the materials being sold for a minimum of 99 rupees — a little over $1, or about P64. The BBC investigation revealed that these Instagram ads are only published after an approval using Meta's moderation technology.
And yet, when the BBC reported its findings to Meta, the company said in a statement that the ads did not violate its community guidelines. It wasn't until after the story was published that Meta took action, disabling several ads and suspending the accounts making the posts and ads.
But that's not all
- Meta's new AI tool, Muse Image, has sparked even more concerns. The tool allows users to generate images using public-facing photos from Instagram. While there might be wholesome ways to use this feature, it's the potential for bad actors to generate deepfakes that's causing alarm.
Worse still, Meta required people who don't want to have their Instagram photos used for AI to opt out rather than give them the choice to opt into the service. This has sparked criticism from privacy advocates, who say that this is a clear case of exploiting users' personal information without their consent.
"Unfortunately, we've reached a point where many technology companies treat every piece of our personal information—our photos, our voices, our biometric identifiers, even our relationships—as raw material to fuel their AI ambitions," said J.B. Branch, director of federal AI governance and technology policy at the consumer nonprofit organization Public Citizen.
The company has since scrapped Muse Image due to the feedback from various groups, including SAG-AFTRA, the union representing actors and other media professionals. Meta has said in a statement that it was aware of the reports about the Indian Instagram ads and was taking a zero-tolerance approach to the issue while improving its defenses against such offenses.
The incident highlights the need for tech companies to prioritize user safety and consent. With the rise of AI and deepfakes, it's more important than ever for companies to take a proactive approach to protecting their users.
But what does this say about Meta's commitment to safety? The company has a history of pushing the boundaries of what's acceptable in the name of innovation, and this incident raises serious questions about its priorities.
The Muse Image debacle is just the latest in a string of incidents that highlight the need for greater accountability in the tech industry. As AI continues to evolve, it's time for companies to take a step back and consider the consequences of their actions.
“Our intent was to provide a useful creative tool and to give people control over whether their public content could be referenced in this way.”
— Meta statement
This is not a new issue, as the Indian government has been cracking down on the distribution of CSAM and adult pornography for years. But the fact that Instagram was still running paid ads promoting these materials is a clear indication of the company's negligence.
The Indian government has since issued a statement condemning the ads and promising to take action against those responsible. The incident has also sparked a wider debate about the role of social media in the spread of CSAM and the need for greater regulation.
Meta's AI Nightmare: What Does It Mean?
The incident highlights the need for tech companies to prioritize user safety and consent. It also raises serious questions about Meta's commitment to safety and its willingness to push the boundaries of what's acceptable in the name of innovation.
As the tech industry continues to evolve, it's time for companies to take a step back and consider the consequences of their actions. The future of AI and deepfakes will be shaped by the choices we make today, and it's up to companies like Meta to get it right.