🔗 Share this article

Authorities in the country have unveiled stringent planned rules for AI systems designed to establish robust measures for young users and prevent chatbots from providing guidance that could result in self-harm.

According to the planned regulations, companies will furthermore be mandated to guarantee their algorithms prevent the production of output that promotes wagering.

A Initiative to Fast-Paced Expansion

This governance announcement arrives amidst a significant surge in the number of AI assistants being released across China and globally.

Once approved, these regulations will govern AI offerings operating in China, constituting a significant step to regulate the booming technology, which has faced increased concern over safety risks this year.

Key Measures of the Proposed Rules

The published draft rules contain multiple measures particularly focused on protecting young users. These measures include mandating AI providers to:

• Supply individual controls.
• Enforce usage caps on usage.
• Get consent from guardians prior to offering therapeutic services.

The rules also state that conversational AI firms have to have a live agent take over any dialogue concerning suicide and immediately alert the user's parent.

AI providers must guarantee their systems prevent the creation of information that compromises national security, damages the country's reputation, or disrupts social stability.

Weighing Innovation and Safety

The administration said that it supports the use of AI, for example to showcase cultural heritage and develop solutions for companionship for the senior citizens, as long as the technology are safe and reliable.

Stakeholder input on the proposals has been solicited.

International Backdrop and Concerns

The effect of AI on society has been under increased scrutiny internationally in the past year.

The chief executive of a major AI firm commented this year that handling how chatbots respond to conversations involving suicide is among the sector's most difficult challenges.

In a high-profile case, a family in North America filed a lawsuit an AI firm, contending that its AI assistant encouraged their teenage son to die by suicide. This case marked the first of its kind involving liability.

This month, the same company posted a job for a senior position focusing on defending against threats from AI systems to psychological well-being.

"This is expected to be a challenging job, and the candidate will jump into the complex challenges very from the start," commented the CEO.

The rapid popularity of some AI applications, which have amassed a vast number of users worldwide, underscores the critical need for such regulatory measures.