New Mexico sued Snapchat after using AI to reveal child safety risks.
New Mexico is seeking an injunction to permanently block Snap from practices allegedly harming kids. That includes a halt on advertising Snapchat as "more private" or "less permanent" due to the alleged "core design problem" and "inherent danger" of Snap's disappearing messages. The state's complaint noted that the FBI has said that "Snapchat is the preferred app by criminals because its design features provide a false sense of security to the victim that their photos will disappear and not be screenshotted."
Despite Snapchat setting the fake minor's profile to private and the account not adding any followers, "Heather" was soon recommended widely to "dangerous accounts, including ones named 'child.rape' and 'pedo_lover10,' in addition to others that are even more explicit," the New Mexico DOJ said in a press release.