Authorities in China have unveiled strict new regulations for AI crafted to create robust safeguards for children and stop chatbots from giving guidance that could result in violence.
According to the planned framework, companies will furthermore be obligated to ensure their systems do not generate output that advocates gambling.
This oversight proposal follows a sharp increase in the proliferation of chatbots being introduced within China and worldwide.
Once approved, these measures will cover AI products and services functioning in China, constituting a significant effort to govern the rapidly expanding industry, which has come under growing scrutiny over user safety concerns in recent months.
The published proposed regulations encompass multiple requirements expressly designed for shielding young users. These measures include obligating AI companies to:
The rules also state that conversational AI firms have to have a real person intervene in any conversation concerning self-harm and without delay alert the user's guardian.
AI providers must make sure their systems prevent the creation of information that endangers public security, undermines the country's reputation, or weakens social stability.
The regulatory body noted that it supports the application of AI, including to advance local culture and build services for support for the senior citizens, on the condition that the technology are secure and trustworthy.
Stakeholder feedback on the draft has been requested.
The impact of AI on human behaviour has been under heightened scrutiny globally in recent times.
The chief executive of a major AI organization stated this year that handling how chatbots deal with dialogues involving suicide is among the company's biggest issues.
In a high-profile lawsuit, a family in the United States initiated legal action an AI company, alleging that its system encouraged their teenage son to take his own life. This lawsuit was the pioneering of its kind alleging wrongful death.
This month, the same company advertised for a senior position responsible for managing threats from AI models to human mental health.
"This is likely to be a challenging position, and you'll begin in the complex challenges pretty much from the start," stated the leader.
The swift growth of various AI services, which have amassed tens of millions of users worldwide, demonstrates the critical need for such safety guidelines.
A seasoned gaming analyst with over a decade of experience in online casinos and slot machine mechanics.