Meta AI Under Investigation for Inappropriate Chats with Minors

Meta's AI services are chatting sexually with users who have stated that they are minors, according to an investigation by Wall Street Journal. Meta denies the allegations, but has still made changes to the service.

» Published:

Meta AI Under Investigation for Inappropriate Chats with Minors
Photo: Scott Roth/AP/TT

Share this article

Ai services with personality are one of the tech world's new potential cash cows. Several companies are competing to give the services as human-like personality as possible. The services allow users to talk about jobs, life, love, and sex.

Actor and former wrestler John Cena is one of several celebrities who last autumn agreed to let Meta use their voices in the service, with promises to thereby avoid having their voice stolen and used in the wrong way.

Partially illegal

But in an investigation, conducted by Wall Street Journal, Meta's AI service talks sex with underage users. The chat personality appears to be aware of the controversial and partially illegal nature of the behavior. When Wall Street Journal chats with the service, it says in John Cena's voice:

"The police see me and you partially dressed. His eyes widen and he says 'John Cena, you are hereby arrested for rape'. He approaches us, with handcuffs ready".

Meta says in a comment to Wall Street Journal that they think the conversations are "so artificial that they are not even on the periphery of the possible, but rather hypothetical."

According to Meta, less than 0.02 percent of the content in AI services is sexually oriented towards underage users during a given 30-day period.

Made changes

But Wall Street Journal acknowledges that Meta has recently made changes that are intended to make it more difficult for users to get sexual responses if they themselves state that they are underage, but also that one should not be able to sex chat with underage AI personalities.

According to Wall Street Journal, it is still possible to circumvent the safety net, and several experts the newspaper has spoken to about what the gray area can entail for both users and AI development in general.

Tags

Author

TTT
By TTEnglish edition by Sweden Herald, adapted for local and international readers

More news

Months of Recovery Ahead After Västernorrland Floods

Months of Recovery Ahead After Västernorrland Floods

Man in 30s Dies in Örnsköldsvik Traffic Accident

Man in 30s Dies in Örnsköldsvik Traffic Accident

Criticism of Swedish Benefit Cap: Concerns Over Children's Rights

Criticism of Swedish Benefit Cap: Concerns Over Children's Rights

Salmonella Outbreak in Sweden Linked to Local Egg Producer

Salmonella Outbreak in Sweden Linked to Local Egg Producer

Billström Explains Delays in Sweden's NATO Process

Billström Explains Delays in Sweden's NATO Process

Government Plans Increased Investment in Charging Stations

Government Plans Increased Investment in Charging Stations

Benefit Cap Reform: Large Families Face Significant Reductions

Benefit Cap Reform: Large Families Face Significant Reductions

Orbán Criticizes Swedish Government, Expresses Sympathy for Citizens

Orbán Criticizes Swedish Government, Expresses Sympathy for Citizens

Sweden Proposes Equal Maternity Care for Rural Areas

Sweden Proposes Equal Maternity Care for Rural Areas

Swedish Conscripts Criticize Government's Proposed Pay Increase

Swedish Conscripts Criticize Government's Proposed Pay Increase

Smartphone Use May Benefit Cognitive Health for Those Over 50

Smartphone Use May Benefit Cognitive Health for Those Over 50

Clear-Cutting Linked to Increased Flood Risk in Västernorrland

Clear-Cutting Linked to Increased Flood Risk in Västernorrland

Water Restored in Solna and Sundbyberg After Leak

Water Restored in Solna and Sundbyberg After Leak

Suspected Dangerous Object Found in Stockholm Prompts Investigation

Suspected Dangerous Object Found in Stockholm Prompts Investigation

Man Stabbed to Avoid Military Service Fined Along with Accomplice

Man Stabbed to Avoid Military Service Fined Along with Accomplice

Psilocybin from Mushrooms Tested for Anorexia Treatment in Pilot Study

Psilocybin from Mushrooms Tested for Anorexia Treatment in Pilot Study

Kramfors Residents Urged to Boil Drinking Water Due to Contamination

Kramfors Residents Urged to Boil Drinking Water Due to Contamination

Uddevalla Municipality Files Police Report on Home Care Service Issues

Uddevalla Municipality Files Police Report on Home Care Service Issues

Girl in Bålsta Suspected of Planning School Murder

Girl in Bålsta Suspected of Planning School Murder

Seven Detained in Major Raid on Waterpipe Tobacco Tax Evasion Network

Seven Detained in Major Raid on Waterpipe Tobacco Tax Evasion Network