Gov. Gavin Newsom (D-CA) called for an “investigation” into Elon Musk’s artificial intelligence app Grok over the creation of fake pornographic content.
Grok is an increasingly popular app that allows users to alter uploaded photos. A trend on X, the social media app that also integrates Grok, has involved removing clothing from users who have shared photos online. These pornographic images are often referred to as “deepfakes,” which Newsom condemned in an X post on Wednesday.
OPINION: GROK, CAN YOU STOP PUTTING WOMEN IN BIKINIS?
“xAI’s decision to create and host a breeding ground for predators to spread nonconsensual sexually explicit AI deepfakes, including images that digitally undress children, is vile,” Newsom wrote. “I am calling on the Attorney General to immediately investigate the company and hold xAI accountable.”
California Attorney General Rob Bonta implied he would investigate the issue in an X post on Wednesday following Newsom’s.
“This is unacceptable. We’re demanding immediate answers from xAI on their plan to stop the creation & spread of this content,” Bonta wrote. “We’ll use all tools at our disposal to keep Californians safe.”
These posts come as the United Kingdom is considering a ban on X over the Grok function. As X owner, Musk has alleged that the potential ban is about “censorship” as other AI chatbots also alter photos.
“Anyone using Grok to make illegal content will suffer the same consequences as if they upload illegal content,” Musk wrote on X earlier this month. These consequences include the removal of the image and permanent bans against accounts that share the content.
Still, Musk’s attitude toward sexually explicit content appears lukewarm, as he has joked about AI photos of himself. Musk insists he is “not aware of any naked underage images generated by Grok.”
Meanwhile, California strengthened its regulations on artificial intelligence. The most recent bill signed by Newsom bans AI chatbots from sharing explicit content with minor users.
“Emerging technology like chatbots and social media can inspire, educate, and connect — but without real guardrails, technology can also exploit, mislead, and endanger our kids,” Newsom said in a statement at the time.
NEWSOM RISKS ALIENATING BIG TECH, AGRICULTURE BY SIGNING BILLS
“We can continue to lead in AI and technology, but we must do it responsibly — protecting our children every step of the way. Our children’s safety is not for sale,” Newsom added.
Grok was created in November 2023, shortly after Musk purchased Twitter, which he renamed X. The image and video generation tool Grok Imagine was released in July 2025.
