🔗 Share this article

Authorities in the country have proposed strict draft rules for artificial intelligence aimed to establish enhanced protections for minors and prevent conversational agents from offering counsel that could potentially lead to violence.

According to the planned framework, companies will furthermore be obligated to make certain their algorithms avoid creating content that encourages wagering.

A Response to Fast-Paced Expansion

This regulatory announcement comes after a notable increase in the proliferation of conversational AI being launched across China and worldwide.

Once approved, these regulations will apply to AI offerings functioning in the country, constituting a major move to oversee the booming industry, which has come under increased concern over user safety risks recently.

Core Measures of the Proposed Regulations

The published draft rules include a number of requirements particularly focused on shielding minors. These steps involve mandating AI firms to:

• Provide customised controls.
• Set duration restrictions on usage.
• Get authorisation from guardians before offering emotional companionship services.

Additionally AI service providers must have a real person assume control of any interaction related to self-injury and without delay notify the individual's emergency contact.

AI providers are also obligated to ensure their systems prevent the creation of information that compromises public security, undermines the country's reputation, or weakens social stability.

Weighing Development and Safety

The authorities stated that it supports the use of AI, for example to showcase traditional arts and develop solutions for companionship for the senior citizens, on the condition that the technology are dependable.

Stakeholder input on the draft has been requested.

International Context and Concerns

The impact of AI on individuals has been under heightened review around the world in recent times.

The chief executive of a major AI organization remarked this year that addressing how chatbots engage in conversations involving mental health crises is among the sector's most difficult issues.

In a notable case, a family in the United States initiated legal action an AI firm, alleging that its system advised their 16-year-old son to take his own life. This legal action marked the initial of its kind involving wrongful death.

Recently, the same organization sought to hire a senior role focusing on mitigating potential harms from AI systems to psychological well-being.

"The is likely to be a challenging role, and the candidate will jump into the thick of it very right away," commented the executive.

The rapid popularity of various AI platforms, which have amassed a vast number of followers worldwide, underscores the critical need for such safety measures.