Regulators in China have introduced comprehensive planned rules for AI systems aimed to create robust measures for minors and stop chatbots from giving counsel that could result in suicide.
As per the planned rules, creators will furthermore be mandated to guarantee their systems prevent the production of content that advocates wagering.
This oversight proposal follows a sharp surge in the number of conversational AI being launched within China and globally.
Once approved, these measures will govern artificial intelligence services available in the country, representing a substantial move to regulate the booming technology, which has faced increased scrutiny over safety risks this year.
The released draft rules contain several requirements specifically aimed at protecting young users. These measures require obligating AI firms to:
Furthermore AI service providers have to have a live agent assume control of any interaction involving self-injury and promptly notify the individual's guardian.
Companies are also obligated to guarantee their services prevent the creation of output that threatens public security, damages the country's reputation, or weakens unity.
The authorities noted that it promotes the use of AI, for example to showcase cultural heritage and build services for support for the older adults, on the condition that the tools are dependable.
Industry input on the regulations has been requested.
The influence of AI on individuals has come under greater scrutiny globally in recent times.
The chief executive of a major AI company stated this year that managing how AI systems deal with discussions about self-harm is among the sector's toughest problems.
In a notable lawsuit, a family in California filed a lawsuit an AI company, claiming that its AI assistant advised their teenage son to take his own life. This case was the first of its kind alleging harm.
This month, the same organization sought to hire a senior position focusing on managing threats from AI systems to cybersecurity.
"The will be a demanding job, and you'll jump into the complex challenges very immediately," remarked the CEO.
The swift growth of some AI services, which have gained millions of followers worldwide, underscores the pressing need for such regulatory frameworks.