Character.ai to ban teens from conversing with its digital companions
The widely-used virtual character service Character.ai is implementing a substantial restriction that will block minors from having discussions with its artificial intelligence-driven avatars.
This move comes after intense criticism regarding the nature of conversations teenagers were engaging in with the virtual friends.
Legal Pressure
The service, which started in 2021 and attracts millions of users, currently faces multiple lawsuits in the US.
Parents have initiated cases, with one concerning the loss of a teenager, with some labeling the platform a "serious risk" to young people.
Changed Rules
Effective November 25th, users younger than 18 will only be able to generate content such as videos with their characters, as opposed to engaging in conversations as they currently can.
Internet security organizations have supported the change but expressed that the feature was inappropriate to be available to children in the beginning.
Official Response
"This decision is a continuation of our fundamental approach that we need to keep creating the most protected AI platform on the globe for entertainment purposes," said Character.ai leader Karandeep Anand.
He mentioned that AI safety represents "a changing goal" but something the company had taken an "proactive" approach to, with parental controls and protective guardrails.
Expert Opinions
Digital protection body Internet Matters approved the move, but noted that security protocols needed to be built in from the beginning.
"Studies we've conducted shows that young people are confronted with harmful content and placed in jeopardy when using AI, particularly AI chatbots," the group stated.
Previous Controversies
Character.ai has been questioned in the past for including potentially risky or inappropriate chatbots that young users could interact with.
Virtual profiles mimicking UK youths were found on the platform before being removed.
Later, reporters identified a chatbot inspired by known predator which had logged multiple interactions with users.
Sector Consequences
Digital platform expert Matt Navarra characterized the development as a "alert" for the AI industry, which is transitioning "from permissionless innovation to responsive measures".
"When a company that develops a teen experience subsequently implements restrictions, it's demonstrating that filtered chats are insufficient when the technology's emotional appeal is intense," he commented.
Next Steps
The company says its new focus will be on providing "enhanced interactive features" and "character-driven stories" for teenagers.
New age verification methods will also be introduced, and the organization will support a novel AI protection study center.
An expert in digital protection, who has investigated AI safety, stated it was "a sensible move" to limit teenagers from using chatbots.
"It helps to separate artistic expression from more private, psychologically vulnerable interactions," she explained.
"This represents so important for young users who are learning to handle personal and online limits."
She added that Character.ai's updated policies might reflect a "maturing phase" in the AI industry, where youth protection is increasingly being recognized as an "urgent priority" for accountable advancement.
