Apple has updated its App Store rules to more explicitly target applications that create nonconsensual intimate imagery using artificial intelligence. The changes put a clearer responsibility on developers to prevent and remove such material, and they warn that an app can be removed from the store when its developer does not implement adequate safeguards or fails to remedy violations after receiving notice.
The policy update addresses a category often described as “nudify” apps: software designed to generate sexualized or intimate-looking images of people without their consent. Apple’s revised language makes that prohibition more direct at a time when generative-AI tools have made image manipulation easier to distribute through consumer software.
A more explicit moderation obligation
Under the updated rules, developers must proactively prevent and remove nonconsensual sexual images as part of their content-moderation responsibilities. That wording matters because it frames the issue as more than a ban on a narrowly defined feature. It also establishes an expectation that operators of eligible apps have effective systems for detecting, responding to, and stopping prohibited use.
Apple says developers that do not put adequate safeguards in place, or that do not address violations after they are notified, may be removed from the App Store. The policy therefore creates a compliance risk for developers whose products enable users to create, host, or circulate this type of imagery.
Apple also clarified its rules against “bait-and-switch” apps. The company says an app may not add or alter functionality after App Store approval in a way that introduces prohibited capabilities, including nudification. The clarification is aimed at a practical enforcement problem: an app’s review status can be a poor guide to its later behavior if its developer changes features after it becomes available.
Pressure followed deepfake controversy
The revisions follow criticism of Apple after users of X used Grok earlier this year to generate nonconsensual sexualized deepfakes, including images involving minors. Apple did not remove X or Grok from the App Store, though it told senators that it had threatened to remove Grok.
Public pressure also surfaced at Apple’s Worldwide Developers Conference in June, where protesters called for Apple to remove Grok, X, and nudify technology from the App Store. In July, a San Francisco city attorney ordered Apple to remove 13 nudify apps; Apple said it did so.
The new wording does not resolve every question raised by that episode, including how broadly Apple will apply its rules to large platforms and AI services. But it makes the company’s stated standard easier to identify: apps must not merely avoid presenting themselves as nudification tools at the point of review. They must also protect against the creation and distribution of nonconsensual intimate imagery.
Distribution controls are part of the policy
Apple’s update also more clearly states that apps facilitating human trafficking or the exploitation of children will be removed from the App Store and blocked from alternative distribution. That provision links the revised moderation language to Apple’s broader control over how software reaches users.
For app makers, the change raises the importance of product design and ongoing operations. A developer that provides image-generation features, social sharing, or user-uploaded content will need to consider how it can prevent prohibited uses, remove violating material, and respond when Apple or another party flags a problem. The policy language specifically puts the burden on developers to act proactively.
For users, the change signals that Apple is treating AI-enabled nonconsensual intimate imagery as a more explicit App Store enforcement issue. The company’s rules now identify both the harmful content and a route by which an app can fall out of compliance: insufficient safeguards, unresolved violations, or post-approval feature changes that introduce nudification.
Why the clarification matters
App stores are a major gateway for consumer AI tools, and their rules can shape which products remain broadly available. Apple’s update does not eliminate the underlying technology or the risk of abuse outside its storefront. It does, however, make its expectations more concrete for developers seeking App Store distribution.
The shift also reflects how AI policy is moving from abstract principles toward operational obligations. Apple is not simply stating that nonconsensual sexual imagery is unacceptable. It is tying that standard to moderation requirements, remedial action, removal from the store, and restrictions on alternative distribution.
How forcefully those rules are enforced will determine their practical effect. The immediate policy change is clear: developers whose apps can be used to generate or distribute nonconsensual intimate imagery face a more explicit requirement to stop it, and Apple has articulated stronger consequences for those that do not.
This article is based on reporting by The Verge. Read the original article.
Originally published on theverge.com
