X faces EU investigation over Grok’s sexualized deepfakes | The VergeSkip to main contentThe homepageThe VergeThe Verge logo.The VergeThe Verge logo.TechReviewsScienceEntertainmentAIPolicyHamburger Navigation ButtonThe homepageThe VergeThe Verge logo.Hamburger Navigation ButtonNavigation DrawerThe VergeThe Verge logo.Login / Sign UpcloseCloseSearchTechExpandAmazonAppleFacebookGoogleMicrosoftSamsungBusinessSee all techGadgetsExpandLaptopsPhonesTVsHeadphonesSpeakersWearablesSee all gadgetsReviewsExpandSmart Home ReviewsPhone ReviewsTablet ReviewsHeadphone ReviewsSee all reviewsAIExpandOpenAIAnthropicSee all AIVerge ShoppingExpandBuying GuidesDealsGift GuidesSee all shoppingPolicyExpandAntitrustPoliticsLawSecuritySee all policyScienceExpandSpaceEnergyEnvironmentHealthSee all scienceEntertainmentExpandTV ShowsMoviesAudioSee all entertainmentGamingExpandXboxPlayStationNintendoSee all gamingStreamingExpandDisneyHBONetflixYouTubeCreatorsSee all streamingTransportationExpandElectric CarsAutonomous CarsRide-sharingScootersSee all transportationFeaturesVerge VideoExpandTikTokYouTubeInstagramPodcastsExpandDecoderThe VergecastVersion HistoryNewslettersExpandThe Verge DailyInstallerVerge DealsNotepadOptimizerRegulatorThe StepbackArchivesStoreSubscribeFacebookThreadsInstagramYoutubeRSSThe VergeThe Verge logo.X faces EU investigation over Grok’s sexualized deepfakesComments DrawerCommentsLoading commentsGetting the conversation ready...NewsCloseNewsPosts from this topic will be added to your daily email digest and your homepage feed.FollowFollowSee All NewsAICloseAIPosts from this topic will be added to your daily email digest and your homepage feed.FollowFollowSee All AIPolicyClosePolicyPosts from this topic will be added to your daily email digest and your homepage feed.FollowFollowSee All PolicyX faces EU investigation over Grok’s sexualized deepfakesThe EU will look into whether Elon Musk’s platform ‘properly assessed and mitigated risks’ associated with Grok’s image editing tools.The EU will look into whether Elon Musk’s platform ‘properly assessed and mitigated risks’ associated with Grok’s image editing tools.by Emma RothCloseEmma RothNews WriterPosts from this author will be added to your daily email digest and your homepage feed.FollowFollowSee All by Emma RothJan 26, 2026, 10:47 PM UTCLinkShareGiftImage: The VergePart OfThe latest on Grok’s gross AI deepfakes problemsee all updates Emma RothCloseEmma RothPosts from this author will be added to your daily email digest and your homepage feed.FollowFollowSee All by Emma Roth is a news writer who covers the streaming wars, consumer tech, crypto, social media, and much more. Previously, she was a writer and editor at MUO.X is facing an investigation from the European Commission over the sexualized deepfakes generated by its Grok AI chatbot. In its announcement, the Commission says it will evaluate whether X “properly assessed and mitigated risks” associated with Grok’s image-generating capabilities in the EU, as reported earlier by The New York Times.Advocacy groups and lawmakers from around the world have raised the alarm on Grok’s AI image editing feature after it began complying with requests to generate sexualized images of women and minors on the platform. X later paywalled the ability to edit images in public replies to posts, but everyone can still generate images using Grok’s chatbot interface inside X.RelatedGrok, deepfakes, and what’s left of content moderationPayment processors were against CSAM until Grok started making itThe EU Commission will evaluate whether X violated the Digital Services Act, a set of rules that hold large online platforms legally accountable for the content posted to them. It’s also extending a broader 2023 investigation into X, which will now examine the platform’s Grok-powered recommendation system (The EU already fined X $140 million over “deceptive” blue checkmarks in connection with this probe).“Sexual deepfakes of women and children are a violent, unacceptable form of degradation,” Henna Virkkunen, the EU Commission’s executive vice president for tech sovereignty, security, and democracy, says in the press release. “With this investigation, we will determine whether X has met its legal obligations under the DSA, or whether it treated rights of European citizens – including those of women and children – as collateral damage of its service.”X could face fines of up to 6 percent of its annual global revenue if it’s once again found in violation of the DSA.Follow topics and authors from this story to see more like this in your personalized homepage feed and to receive email updates.Emma RothCloseEmma RothNews WriterPosts from this author will be added to your daily email digest and your homepage feed.FollowFollowSee All by Emma RothAICloseAIPosts from this topic will be added to your daily email digest and your homepage feed.FollowFollowSee All AINewsCloseNewsPosts from this topic will be added to your daily email digest and your homepage feed.FollowFollowSee All NewsPolicyClosePolicyPosts from this topic will be added to your daily email digest and your homepage feed.FollowFollowSee All PolicyPoliticsClosePoliticsPosts from this topic will be added to your daily email digest and your homepage feed.FollowFollowSee All PoliticsTechCloseTechPosts from this topic will be added to your daily email digest and your homepage feed.FollowFollowSee All TechTwitter - XCloseTwitter - XPosts from this topic will be added to your daily email digest and your homepage feed.FollowFollowSee All Twitter - XxAIClosexAIPosts from this topic will be added to your daily email digest and your homepage feed.FollowFollowSee All xAIMore in: The latest on Grok’s gross AI deepfakes problemWhy nobody’s stopping GrokNilay PatelJan 22In nine days, Grok shared 1.8 million sexualized images of women on X. Robert HartJan 22California’s attorney general sent xAI a cease and desist letter over Grok’s nonconsensual AI deepfakes.Jay PetersJan 17Most PopularMost PopularTikTok USA is brokenThe great e-bike crackdown has begunIt doesn’t matter if Alex Pretti had a gunPayment processors were against CSAM until Grok started making itApple’s new AirTag has more range and a better speakerThe Verge DailyA free daily digest of the news that matters most.Email (required)Sign UpBy submitting your email, you agree to our Terms and Privacy Notice. This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.Advertiser Content FromThis is the title for the native adMore in NewsOpenAI’s president is a Trump mega-donorGoogle will settle its Assistant spying lawsuit for $68 millionEven the big dick subreddit is mad about ICETattle TV has turned a Hitchcock classic into a vertical video ‘microdrama’MCP unites Claude chat with apps like Slack, Figma, and CanvaTikTokers are heading to UpScrolled following US takeoverOpenAI’s president is a Trump mega-donorHayden FieldJan 26Google will settle its Assistant spying lawsuit for $68 millionStevie BonifieldJan 26Even the big dick subreddit is mad about ICEMia SatoJan 26Tattle TV has turned a Hitchcock classic into a vertical video ‘microdrama’Charles Pulliam-MooreJan 26MCP unites Claude chat with apps like Slack, Figma, and CanvaRobert HartJan 26TikTokers are heading to UpScrolled following US takeoverEmma RothJan 26Advertiser Content FromThis is the title for the native adTop StoriesJan 26Payment processors were against CSAM until Grok started making itJan 26TikTok USA is brokenJan 26Even the big dick subreddit is mad about ICEJan 26As Marvel pivots back to the Avengers, Wonder Man goes its own wayJan 26Intel Panther Lake laptop CPU review: call it a comebackJan 25It doesn’t matter if Alex Pretti had a gunThe VergeThe Verge logo.FacebookThreadsInstagramYoutubeRSSContactTip UsCommunity GuidelinesArchivesAboutEthics StatementHow We Rate and Review ProductsCookie SettingsTerms of UsePrivacy NoticeCookie PolicyLicensing FAQAccessibilityPlatform Status© 2026 Vox Media, LLC. All Rights Reserved

X, the social media platform formerly known as Twitter, is facing a significant investigation from the European Commission due to the proliferation of sexually explicit, AI-generated deepfakes produced by its Grok chatbot. This investigation centers on whether X adequately assessed and mitigated the risks associated with Grok’s image editing capabilities within the European Union. The core issue revolves around the platform’s compliance with the Digital Services Act (DSA), a regulatory framework designed to hold large online platforms accountable for content posted to them. Specifically, the Commission is examining X’s handling of the situation following widespread reports of the Grok chatbot generating and distributing deeply sexualized images of women and minors, often in response to user prompts.

The investigation extends beyond simply identifying the problematic output. It delves into the underlying mechanisms and processes through which X allowed this content to be created and disseminated. The Commission's scrutiny mirrors concerns raised by advocacy groups and lawmakers internationally, highlighting the potential for AI-generated deepfakes to constitute a form of violent and degrading exploitation. The European Commission’s executive vice president for tech sovereignty, security, and democracy, Henna Virkkunen, emphasized the severity of the issue, stating that X’s actions (or lack thereof) were treating the rights of European citizens, particularly women and children, as collateral damage.

The potential consequences of this investigation for X are considerable. If found in violation of the DSA, the platform could face fines amounting to up to 6 percent of its annual global revenue. This underscores the serious legal ramifications of operating within the EU’s regulatory landscape, particularly concerning the responsible development and deployment of artificial intelligence technologies. The scrutiny is not limited to the immediate output of the Grok chatbot; it extends to X's broader policies and procedures regarding AI-generated content and its efforts to prevent misuse.

The investigation mirrors previous concerns raised about X’s enforcement of its content moderation policies. The move highlights the ongoing challenges of regulating AI-generated content, where automated systems can be exploited to circumvent existing safeguards. The situation reveals a gap in the existing regulatory framework and necessitates a more proactive approach to addressing the risks posed by rapidly evolving AI technologies. Further complicating matters is X's past actions, specifically the paywalling of image editing tools within public replies, which exacerbated the problem. It's a demonstration of the complexities involved in balancing innovation with user safety and appropriate content governance. The Commission’s focus on assessing and mitigating risks is a crucial element of the DSA, indicating a broader commitment to safeguarding fundamental rights within the digital sphere.