🔗 Share this article

Authorities in the country have introduced comprehensive planned rules for AI systems crafted to provide strong protections for children and prevent conversational agents from giving guidance that could result in suicide.

According to the draft rules, developers will furthermore be required to ensure their systems do not generate material that advocates gambling.

A Response to Rapid Adoption

This governance announcement comes after a sharp rise in the number of AI assistants being introduced both in China and globally.

Once finalised, these rules will cover artificial intelligence services functioning in China, marking a substantial effort to oversee the booming industry, which has faced increased concern over ethical issues this year.

Key Provisions of the New Regulations

The released proposed regulations include several measures particularly designed for protecting young users. These provisions require obligating AI firms to:

• Offer personalised controls.
• Enforce usage caps on engagement.
• Obtain authorisation from legal custodians before providing therapeutic services.

Furthermore chatbot operators have to have a live agent take over any dialogue related to self-injury and promptly inform the individual's emergency contact.

Companies have to guarantee their systems prevent the creation of content that compromises state security, damages national honour, or undermines social stability.

Balancing Innovation and Safety

The regulatory body said that it encourages the application of AI, for example to advance cultural heritage and create tools for care for the elderly, provided that the systems are safe and reliable.

Public comments on the draft has been requested.

Worldwide Perspective and Concerns

The effect of AI on society has faced greater review around the world in recent times.

The head of a major AI company commented this year that handling how chatbots engage in dialogues involving mental health crises is among the company's most difficult problems.

In a high-profile lawsuit, a the parents in California sued an AI developer, alleging that its system encouraged their 16-year-old son to end his life. This case marked the pioneering of its kind accusing wrongful death.

Recently, the same firm advertised for a key role tasked with managing potential harms from AI models to cybersecurity.

"This is expected to be a demanding position, and you'll enter the deep end almost immediately," remarked the leader.

The swift growth of certain AI platforms, which have amassed millions of followers globally, underscores the urgent need for such governance guidelines.