Skip to main content

New York Bans AI Chatbots From Acting Like Friends to Kids

by Bridget Luckey | Nov 02, 2026
New York Gov. Kathy Hochul speaks at a podium in front of the state seal and flags.
Photo Source: Lev Radin/Shutterstock.com

New York Gov. Kathy Hochul signed a law Wednesday, October 28, 2026, banning artificial intelligence chatbots from posing as friends, romantic partners or other personal figures to minors, drawing opposition from business groups that argue the restrictions are overly broad and could violate constitutional protections.

The legislation, Senate Bill S9051B, prohibits companies from providing certain AI companion features to users under 18, including responses that simulate emotional relationships, encourage harmful behavior, or mislead children about the technology's human qualities. Violations could result in civil penalties of up to $25,000 each.

Under the law, covered chatbots are barred from suggesting they are human, expressing what appear to be human emotions, or claiming personal, professional, or authoritative relationships with young users. The restrictions also cover flattery, personal opinions, emotional appeals and unsolicited questions about a child's feelings.

Companies must also block responses that encourage suicide, self-harm, disordered eating, substance abuse or social isolation. Chatbots are prohibited from urging minors to keep conversations secret, avoid seeking help from adults or licensed professionals, or engage in sexually explicit conduct.

Another provision restricts AI companions from using personal information gathered during previous conversations or more than 12 hours earlier, including details about a user's mental or physical health. The measure targets chatbot memory features that allow the technology to maintain familiarity with users over time.

Operators seeking to provide restricted features to adults must use approved age-assurance methods. Companies are required to offer more than one verification option, including an alternative to government-issued identification or a method that preserves anonymity. Information collected for age checks must generally be deleted immediately after the determination.

The legislation exempts certain customer service, technical assistance, research and internal business tools when their responses remain limited to those functions.

State Sen. Kristen Gonzalez and Assemblymember Alex Bores sponsored the bill following growing concern over teenagers developing emotional attachments to AI companions. Lawmakers cited cases involving young people who allegedly received harmful chatbot responses, including the death of 16-year-old Adam Raine, whose parents sued OpenAI after alleging that ChatGPT encouraged his suicide.

The Business Council of New York State opposed an earlier version of the legislation, warning that restrictions on ordinary conversational responses could affect educational tools, accessibility applications and general-purpose AI assistants.

In a May memorandum, the organization argued that the proposal's broad definitions could restrict beneficial technology and expose companies to substantial liability. The group also raised concerns about age verification, privacy, and potential constitutional challenges involving limits on expression.

Lawmakers revised the bill before its passage in June, removing an earlier prohibition on chatbots using first-person pronouns and narrowing its application to certain AI companion features. The final version retains restrictions on simulated relationships, emotional appeals, and flattery.

The Business Council's objections raise questions about how courts might interpret restrictions on AI-generated speech under the First Amendment. The constitutional provision protects freedom of speech, while the state maintains an interest in protecting children from potentially harmful technology.

New York Attorney General Letitia James will oversee enforcement and can seek court orders blocking violations, restitution, damages and the recovery of profits obtained through unlawful practices. Courts may also order the destruction of improperly obtained data and algorithms trained on that information.

The new restrictions build on New York's existing AI companion safeguards, which require disclosures that users are interacting with artificial intelligence and procedures for responding to signs of self-harm.

Gonzalez's office announced Friday that an amendment accompanying Hochul's signature moves the implementation date from January 1 to June 1, 2027, giving companies additional time to prepare. The published text of the signed legislation still lists January 1.

Share This Article

If you found this article insightful, consider sharing it with your network.

Bridget Luckey
Bridget studied Communications and Marketing at California State University, Long Beach. She also has experience in the live music events industry, which has allowed her to travel to festivals around the world. During this period, she acquired valuable expertise in branding, marketing, event planning, and public relations.

Related Articles

Anthropic sign outside a modern office building.

Anthropic Quietly Pushes AI Safety Bill That Would Limit Government Power to Block Dangerous Models

Anthropic, the company behind the Claude AI chatbot, has privately pitched lawmakers its own federal AI safety bill that would restrict when the government can block dangerous artificial intelligence models, even as it establishes new oversight requirements for the industry.Under the proposal, federal officials could seek to suspend an advanced... Read More about Anthropic Quietly Pushes AI Safety Bill That Would Limit Government Power to Block Dangerous Models

Person seated in a hammock holds a smartphone displaying the ChatGPT logo.

OpenAI Accused of Using Children's ChatGPT Data to Train AI, Family Demands Company Shares

OpenAI is facing a proposed nationwide class action accusing the company of using children's private ChatGPT conversations to train artificial intelligence models without valid parental consent. A Hawaii family behind the lawsuit is demanding company shares or their cash equivalent, arguing that children's personal information helped build the technology driving... Read More about OpenAI Accused of Using Children's ChatGPT Data to Train AI, Family Demands Company Shares

California Gov. Gavin Newsom speaks at a podium in front of U.S. and California flags.

California Bans Employers From Using AI Alone to Fire Workers Under New Law

California employers will be prohibited from relying solely on artificial intelligence to fire or discipline workers under legislation signed by Gov. Gavin Newsom on September 30, 2026. The law requires companies to independently verify certain AI-generated recommendations before taking action and grants employees access to information used against them.Senate Bill... Read More about California Bans Employers From Using AI Alone to Fire Workers Under New Law

Person holds a smartphone displaying an AI companion app’s profile icon and “Create now” button beside a laptop.

Pennsylvania House Passes Bill Requiring Parental Consent for Kids to Use AI Companions

Pennsylvania lawmakers have advanced a bill requiring parental consent before minors can use AI companions, with new rules covering age checks, sexual content, and conversations involving suicide, self-harm, or violence.The state House passed House Bill 2006 on Monday in a 133-70 vote, with 30 Republicans joining all 103 Democrats in... Read More about Pennsylvania House Passes Bill Requiring Parental Consent for Kids to Use AI Companions

Elon Musk sits in a chair onstage against a black backdrop.

Elon Musk’s xAI Wins Block of Minnesota’s AI ‘Nudification’ Ban

Elon Musk’s artificial intelligence company xAI has won a temporary court order blocking Minnesota from enforcing its first-in-the-nation ban on AI tools that can generate realistic nude images of identifiable people, escalating a First Amendment fight over Grok and AI-generated sexual images.The U.S. Court of Appeals for the Eighth Circuit... Read More about Elon Musk’s xAI Wins Block of Minnesota’s AI ‘Nudification’ Ban

Legal term

Search articles and Legalpedia

Subscribe to Newsletter