The AI service Grok, owned by XAI, part of Elon Musk's corporate empire, has run into trouble since its launch. Among other things, it has been used to create fake images and videos that make it look like real people, even minors, are having sex.
In Sweden, for example, Minister of Energy and Industry Ebba Busch (KD) has been the target of AI-manipulated images.
The European Commission has now launched another investigation into Grok, in addition to an already ongoing review of the X platform. The Commission said in a press release that the investigation will, among other things, look at how the company assessed and managed various risks prior to its launch in the EU.
"We will not hand over consent and the protection of children to tech companies so that they can violate and profit from it. The harm caused by illegal images is very real," said Commission President Ursula von der Leyen in a statement.
According to EU Commissioner for Digital Affairs Henna Virkkunen, the investigation will determine whether X has violated the EU's Digital Services Act (DSA).
"Sexual deepfakes of women and children without consent are a violent, unacceptable form of humiliation," she said in the press release.
Just over a week ago, XAI said on Elon Musk's social network X that the company had taken technical measures to prevent the manipulation of images and videos showing real people in sexual situations.
“This restriction applies to all users, including paying subscribers,” XAI wrote.
