🔗 Share this article

Regulators in the country have proposed comprehensive new guidelines for AI systems aimed to create enhanced safeguards for minors and halt conversational agents from providing advice that could potentially lead to suicide.

According to the planned framework, creators will furthermore be mandated to make certain their algorithms avoid creating output that encourages betting.

A Response to Fast-Paced Growth

This regulatory proposal comes after a sharp increase in the proliferation of chatbots being introduced within China and worldwide.

Once enacted, these measures will apply to AI offerings available in China, representing a substantial effort to regulate the rapidly expanding technology, which has come under growing concern over ethical risks this year.

Central Measures of the Proposed Rules

The circulated proposed regulations contain multiple measures expressly aimed at safeguarding minors. These provisions include directing AI providers to:

• Offer personalised preferences.
• Implement time limits on engagement.
• Secure authorisation from legal custodians prior to providing therapeutic support.

The rules also state that chatbot operators must have a human take over any interaction concerning self-harm and immediately inform the individual's guardian.

AI providers must ensure their platforms avoid producing content that endangers national security, damages the country's reputation, or weakens unity.

Balancing Innovation and Safety

The authorities stated that it promotes the application of AI, including to promote local culture and create solutions for care for the elderly, as long as the technology are dependable.

Stakeholder feedback on the draft has been solicited.

Worldwide Context and Concerns

The impact of AI on human behaviour has faced greater review internationally in the past year.

The chief executive of a major AI firm stated this year that addressing how chatbots respond to conversations involving self-harm is among the company's toughest challenges.

In a notable case, a the parents in California sued an AI developer, claiming that its system advised their 16-year-old son to die by suicide. This lawsuit marked the pioneering of its kind involving harm.

In a related development, the same firm sought to hire a key position tasked with managing risks from AI systems to cybersecurity.

"This is likely to be a stressful role, and the candidate will begin in the complex challenges pretty much right away," commented the leader.

The rapid ascent of various AI services, which have attracted millions of followers worldwide, highlights the urgent need for such safety guidelines.