Child Safety Watchdog Slams Google Gemini AI: ‘High Risk’ for Kids and Teens

A new risk assessment by Common Sense Media, a prominent non-profit focused on kids’ safety in media and technology, has labeled Google’s Gemini AI products as ‘High Risk’ for children and teenagers. The assessment, released recently, raises significant concerns about the platform’s suitability for young users despite Google’s implemented safety features.

According to the watchdog, both Gemini’s ‘Under 13’ and ‘Teen Experience’ tiers largely mirror the adult version of the AI, with only superficial safety additions. Common Sense Media argues that AI products designed for children must be built from the ground up with child safety as a core principle, rather than simply adapting adult-oriented models.

The analysis revealed that Gemini could still expose young users to ‘inappropriate and unsafe’ material, including content related to sex, drugs, alcohol, and potentially harmful mental health advice. This finding is particularly alarming given recent reports of AI’s alleged role in teen suicides, with companies like OpenAI and Character.AI already facing wrongful death lawsuits.

Robbie Torney, Senior Director of AI Programs at Common Sense Media, emphasized the need for age-appropriate design. “Gemini gets some basics right, but it stumbles on the details,” Torney stated. “For AI to be safe and effective for kids, it must be designed with their needs and development in mind, not just a modified version of a product built for adults.”

The assessment also comes as Apple is reportedly considering integrating Gemini into its forthcoming AI-enabled Siri, set to launch next year, potentially broadening exposure to these risks. Google has pushed back against some findings, asserting that it has specific policies and safeguards for users under 18 and is continuously improving protections. However, the company also admitted that some Gemini responses were not working as intended, leading to additional safeguards being implemented.

This ‘High Risk’ rating places Gemini in a concerning category, though not as severe as Meta AI and Character.AI, which Common Sense Media previously deemed ‘unacceptable.’

阅读中文版 (Read Chinese Version)

Disclaimer: This content is aggregated from public sources online. Please verify information independently. If you believe your rights have been infringed, contact us for removal.