Apple and Google Ordered to Remove ‘Nudify’ Apps from Their Stores

San Francisco's City Attorney, David Chiu, has issued a forceful directive to tech behemoths Apple and Google, demanding the immediate removal of "nudify" applications from their respective app stores. This decisive action, announced today, July 17, 2026, marks a significant escalation in the ongoing battle against AI-generated non-consensual intimate images (NCII) and places immense pressure on the industry giants to actively police their digital marketplaces. The move is predicated on robust California state laws, particularly those enacted in 2025, which criminalize the knowing facilitation or reckless aiding of deepfake pornography and empower victims to pursue civil action against third-party enablers.

Chiu's office contends that both Apple and Google have been acutely aware of these illicit applications operating within their ecosystems for nearly a year, yet have continued to host and, crucially, profit from them. Letters sent to the companies, reviewed by TechCrunch, underscore that this isn't a new oversight. The Tech Transparency Project (TTP) had previously issued detailed reports and warnings in January and April of 2026, explicitly identifying dozens of apps that facilitated the creation and sale of deepfake NCII, with payments processed directly through the platforms. Chiu further revealed to Wired that these companies have likely amassed "millions of dollars in fees" from these services, painting a stark picture of profit over user safety.

Why It Matters

This isn't merely a localized regulatory skirmish; it's a critical inflection point in the broader narrative of AI governance and platform accountability. For years, tech companies have grappled with moderating harmful content, from hate speech to misinformation. The advent of sophisticated generative AI has introduced a new, particularly insidious frontier: the effortless creation of highly convincing, non-consensual explicit imagery. San Francisco's direct order, backed by specific state legislation, sets a powerful precedent. It unequivocally signals that lawmakers are no longer content with reactive measures or self-regulation; they are prepared to use legal leverage to compel tech giants to adopt a proactive stance. This legal challenge forces Apple and Google to confront their dual role as powerful gatekeepers and complicit facilitators, potentially reshaping their app review processes globally and increasing the onus on them to invest significantly more in AI safety and content moderation technologies. The financial implications, while perhaps not crippling, highlight the uncomfortable truth that these platforms have inadvertently—or perhaps negligently—monetized profound digital harm.

The challenge for Apple and Google extends beyond mere compliance; it's about trust and ethical leadership in the AI era. As the primary distributors of mobile applications, their policies and enforcement mechanisms dictate what digital tools are accessible to billions. This directive forces them to re-evaluate the fine line between enabling innovation and preventing exploitation. It also sends a clear message to developers: the legal and ethical landscape for AI-powered content creation is rapidly solidifying, and tools facilitating harm will face swift and decisive action. The expectation is now for these companies to not just react to complaints, but to anticipate and prevent the spread of such abusive technologies through more rigorous vetting and advanced detection systems.

Ultimately, San Francisco’s bold move serves as a bellwether for what is likely to become a global trend. As AI capabilities advance, the ethical frameworks and legal guardrails must evolve at an equally rapid pace. This order is a powerful reminder that while technology offers incredible potential, unchecked innovation can also open doors to new forms of abuse. The world will be watching closely to see how Apple and Google respond, and whether this marks the beginning of a more accountable era for platform responsibility in the age of generative AI.