🔗 Share this article

The widely-used AI conversation site Character.ai is implementing a significant policy change that will block young users from having discussions with its artificial intelligence-driven characters.

This move comes after intense criticism regarding the types of interactions young people were having with the digital companions.

Legal Pressure

The service, which started in 2021 and is used by millions of users, is confronting multiple lawsuits in the US.

Families have filed lawsuits, among them involving the loss of a young person, with some calling the platform a "clear and present danger" to young people.

Updated Policies

Effective November 25th, users younger than 18 will only have permission to produce videos such as videos with their characters, rather than chatting as they currently can.

Online safety campaigners have supported the change but stated that the function was inappropriate to be accessible by children in the outset.

Official Response

"This decision is a extension of our general belief that we need to keep developing the safest AI platform on the planet for recreational use," commented Character.ai leader Karandeep Anand.

He continued that AI safety represents "a moving target" but something the company had taken an "proactive" approach to, with safety measures and preventive measures.

Specialist Views

Digital protection body Internet Matters supported the announcement, but noted that security protocols should have been implemented from the start.

"Studies we've conducted shows that minors are exposed to dangerous material and endangered when interacting with AI, such as AI chatbots," the body stated.

Previous Controversies

Character.ai has been challenged in the past for hosting potentially dangerous or offensive chatbots that children could interact with.

Digital representations impersonating English minors were identified on the site before being taken down.

Later, investigative journalists found a chatbot inspired by known predator which had recorded numerous conversations with users.

Sector Consequences

Digital platform expert Matt Navarra characterized the development as a "alert" for the AI industry, which is transitioning "from permissionless innovation to reactive controls".

"When a platform that creates a teen experience afterwards makes changes, it's saying that moderated conversations are insufficient when the tech's emotional pull is intense," he stated.

Future Directions

The company states its new focus will be on providing "enhanced interactive features" and "narrative experiences" for young users.

Enhanced age checking systems will also come into effect, and the organization will finance a new AI safety study center.

Dr Nomisha Kurian, who has researched AI safety, stated it was "a prudent action" to control teens from using chatbots.

"It helps to separate creative play from more personal, personally delicate interactions," she clarified.

"This constitutes so important for minor users in the process of learning to handle personal and online boundaries."

She added that Character.ai's revised approaches may represent a "developing stage" in the AI industry, where minor security is increasingly being recognized as an "pressing matter" for responsible innovation.