SF Orders Apple & Google to Pull 'Nudify' Apps — Stores Profited Millions

The San Francisco City Attorney’s Office has ordered Apple and Google to remove 13 artificial intelligence apps from their platforms that are used to generate non-consensual nude images. In cease-and-desist letters sent this week, City Attorney David Chiu accused the companies of hosting and profiting from apps that violate California state law.

These so-called “nudify” apps often market themselves as harmless “face-swap” tools. In reality, they allow users to upload a photo of a person and use AI to digitally undress them, creating fabricated explicit images. According to Wired, the letters specifically call out that the apps are overwhelmingly used to target women and girls, facilitating a modern form of sexual harassment and abuse.

A Failure of the Walled Garden

For years, Apple and Google have justified their control over the app ecosystem by claiming their review processes protect users from harm. These letters challenge that entire premise. The City Attorney’s office alleges this isn't just an oversight. TechCrunch reports that the letters claim both companies have “long been aware” that they are hosting apps in violation of the law. This suggests a willful ignorance driven by financial incentives.

The financial motive is significant. According to Ars Technica, an official estimated that Apple and Google have likely made millions of dollars in fees from these apps. This transforms the narrative from a simple failure of moderation into a story about profiting from harm. Every transaction for a “nudify” app or an in-app purchase put a cut of the money directly into Apple’s and Google’s pockets. It raises a blunt question: how can an app store be considered a safe, curated space if it’s profitable to look the other way on apps that enable abuse?

From Terms of Service to Legal Action

While user complaints about these apps have existed for some time, this action by a major city government escalates the issue dramatically. It moves the conflict from the court of public opinion and terms-of-service violations to one of legal and financial liability. Engadget confirmed that the letters demand the companies stop distributing and profiting from the 13 named apps.

The pattern indicates a growing impatience with tech self-regulation. When platforms fail to enforce their own policies on obviously harmful content, legal authorities are beginning to step in. The core of the argument from San Francisco is that these apps are not a gray area; they facilitate illegal activity. By hosting them, Apple and Google are not neutral platforms but active participants who share responsibility—and profits.

The response from Apple and Google will be a critical test. A swift removal of the apps would be an admission that their review process failed. A delayed or defiant response could lead to a protracted legal battle that further damages their reputation as stewards of a safe digital environment. For the millions of users who trust these stores, the outcome will show whether safety is a feature or just a marketing slogan.