California has placed itself at the forefront of child online safety with a sweeping new law that prohibits addictive social media features for users under 16 and introduces the nation's first regulatory framework for AI companion chatbots. The legislation, signed by Governor Gavin Newsom, targets the design of platforms and artificial intelligence tools that critics say exploit young users.
Social Media Rules Target Addictive Design
The law prohibits platforms from using design elements that encourage compulsive use among children under 16. Features such as automated video playback, endless news feeds, and algorithmic content recommendations are now restricted without explicit parental consent. Companies that violate the ban face fines and potential lawsuits from the state.
Supporters argue these changes reduce the reward loops that can lead to overuse and mental health issues. Tech companies, however, have pushed back, claiming the rules are vague and could undermine user experience.
AI Companion Chatbots Face New Oversight
The bill also imposes strict requirements on AI systems designed to form emotional bonds with users, known as companion chatbots. California is the first state to mandate independent third-party safety audits for such tools, assessing everything from data privacy to the risk of emotional manipulation. Annual risk reports must be filed with the state attorney general.
Critics of companion chatbots have warned that these systems can create unhealthy attachments in children or expose them to inappropriate content. The new law requires developers to regularly evaluate their models for potential harms and to disclose findings publicly. Failure to comply can result in fines and operational restrictions.
Why This Matters
California's law changes the compliance landscape for every major social media platform and AI chatbot operator doing business in the state. Companies must now redesign products for millions of young users, audit their AI systems annually and face public scrutiny for failures. The effect will likely ripple nationwide as other states consider similar legislation and as federal lawmakers weigh a national standard. For families, the law provides new tools to limit screen time and emotional risks from chatbots. For the tech industry, it signals that reactive design and unregulated AI will no longer be tolerated in the country's largest market.



