Google Play outlines its policies and enforcement measures against apps that facilitate non-consensual intimate imagery (NCII), including 'nudify' and deepfake generation tools. It describes multi-layered defenses such as lifecycle testing of apps, cutting off monetization and ad pathways for violators, and partnerships with NCII-defense organizations through its Priority Flagger Program. Developers are given practical guidance for app review, including giving reviewers full access to AI features, documenting safety testing against adversarial prompts, building custom input/output moderation beyond model-native filters, monitoring ad campaigns for compliance, and using user feedback signals to strengthen guardrails over time.
Table of contents
How we’re safeguarding our shared ecosystemPractical best practices for your Generative AI featuresBuilding responsibly, togetherQuestions this post answers
What does Google Play require from apps with generative AI features to prevent non-consensual intimate imagery?
Google Play requires developers to give app reviewers full access to premium AI features without paywalls or geo-fencing, and to keep documentation showing how their app's underlying models reject requests for nudify prompts, deepfakes, and explicit image edits. Apps found facilitating NCII creation or distribution are removed and blocked from monetization and advertising across Google's platforms. Developers shipping generative AI features can track platform policy shifts like this on daily.dev.