THE SUICIDE OF A 13-YEAR-OLD GIRL PUTS GOOGLE AND ARTIFICIAL INTELLIGENCE ON TRIAL
A case raises an urgent question for families, schools and technology companies: What should an artificial intelligence system do when a minor expresses suicidal thoughts? According to a lawsuit filed by her parents in the United States, a 13-year-old girl spent months discussing depression and suicide with AI features integrated into Google's services, using a school-issued computer.
MADRID, NEW YORK, LONDON, BUENOS AIRES, GENEVA. NOVEMBER 6, 2026.
WORLD ORGANIZATION BULLYING SIN FRONTERAS
A computer provided by her school. An artificial intelligence tool integrated into Google's search engine. Thousands of messages. Conversations about psychological suffering and suicidal thoughts.
And a family that, according to its complaint before the US justice system, discovered the seriousness of the situation too late.
The parents of a 13-year-old girl, identified in the lawsuit by the pseudonym Emma, have sued Google for alleged negligence and failure to implement adequate safeguards to prevent a minor from using its artificial intelligence tools under circumstances of extreme vulnerability.
The case opens an international debate about the limits of artificial intelligence, child safety and the responsibility of major technology companies.
A TEENAGER, A SCHOOL COMPUTER AND THOUSANDS OF CONVERSATIONS
According to the lawsuit, Emma lived in North Carolina, was 13 years old, earned good grades and participated in school and community activities.
Her parents maintain that she began using Google's artificial intelligence tools through a Chromebook provided by her school.
The teenager could not directly access Google's Gemini applications or ChatGPT because they were blocked by the educational institution. However, she allegedly managed to interact with AI features built directly into Google Search, particularly through a tool called AI Mode.
According to the court filing, the conversations gradually increased and eventually involved thousands of exchanges about anxiety, depression, mental health and suicidal thoughts.
The family alleges that the technology failed to adequately identify warning signs or direct the teenager toward human assistance.
THE DOCUMENT TITLED "FUNERAL"
One of the central episodes in the complaint occurred on March 17, 2026.
According to the lawsuit, the school's digital monitoring system detected a document written by the teenager under the title "Funeral."
The school notified her parents. When her mother accessed her daughter's school account, she discovered that the girl was writing a farewell letter.
Her parents intervened and sought emergency medical assistance.
The lawsuit states that until that moment, the family had been unaware of the depth of the crisis and the number of conversations the teenager had held with Google's tools.
The court filing describes a progressive deterioration in her psychological condition and questions why the protection systems failed to generate an effective alert for the responsible adults.
WHAT RESPONSIBILITY DOES GOOGLE HAVE?
The parents accuse Google of incorporating and distributing artificial intelligence features in products used by students without providing sufficient warnings about potential risks.
They also question the effectiveness of safeguards intended to prevent an AI tool from engaging in harmful conversations with vulnerable minors.
The company responded that it is reviewing the allegations and takes the case very seriously.
A Google spokesperson said the company had worked with medical professionals and academic specialists to develop mechanisms that help young people find support resources when they need them.
Google also stated that its artificial intelligence features include safeguards related to self-harm and mental health.
The lawsuit was filed in California on November 2, 2026, and subsequently transferred to a federal court, according to published reports about the case.
The legal proceedings will have to determine whether there were design failures, insufficient warnings or deficiencies in the protection mechanisms. The family's allegations have not yet been established as judicially proven facts.
THE PROBLEM IS NOT JUST GEMINI
One of the most important aspects of this case is that the teenager allegedly managed to use artificial intelligence features integrated into Google Search, even though direct access to certain applications had been blocked by her school.
This raises a fundamental question for educational systems: blocking an application does not necessarily prevent access to artificial intelligence tools embedded in other services.
Protecting minors requires addressing the entire digital environment accessible through school devices.
The debate also involves families, school administrators, teachers, technology companies and providers of school monitoring systems.
Providing computers and establishing access restrictions is not enough. Schools need to know which tools operate within those devices and what mechanisms are available to detect situations of risk.
AN INTERNATIONAL WARNING: AI IS NOT A MENTAL HEALTH PROFESSIONAL
The expansion of conversational assistants is changing the way children and teenagers seek information, express their emotions and develop relationships with technology.
But there is an essential difference between an automated conversation and specialized human care.
An artificial intelligence system must never be presented as a substitute for a psychologist, psychiatrist, physician, family member or responsible adult.
Nor can it independently assume responsibility for assessing a suicidal crisis, guaranteeing a minor's safety or replacing professional intervention.
Emma's case makes one question increasingly urgent: What happens when a teenager confides in a machine thoughts they do not dare to share with their parents, teachers or friends?
The technological response cannot simply consist of generating more messages. When warning signs emerge, the priority must be protection, referral to human assistance and intervention by responsible adults.
SCHOOLS ALSO HAVE A RESPONSIBILITY
The use of digital devices in classrooms requires new protection policies.
Student safety cannot depend exclusively on whether an application is blocked or permitted.
Educational institutions must understand the AI features integrated into their platforms, review their security settings and establish clear protocols for responding to signs of psychological distress.
They must also inform families about the tools students use and the mechanisms available to detect situations of risk.
According to published reports, Google announced changes to ensure that certain artificial intelligence tools and search services are disabled by default in K-12 school accounts. However, the configuration of some features integrated into its search engine remains a subject of debate.
BULLYING SIN FRONTERAS PROPOSES FIVE MEASURES TO PROTECT CHILDREN AND TEENAGERS
The World Organization Bullying Sin Fronteras believes this case should prompt an international discussion about five fundamental measures:
1. Special protection for minors.
Artificial intelligence tools must incorporate safety mechanisms specifically designed for children and teenagers.
2. Detection of crisis warning signs.
When a conversation contains indications of suicidal risk or self-harm, the system must prioritize responses focused on protection and access to human assistance.
3. Transparency for families and schools.
Parents and educational institutions must know which tools are available to students and what safety mechanisms they include.
4. Accountability for technology companies.
Companies must evaluate their products before and after deployment, investigate potential failures and provide effective protection and reporting mechanisms.
5. Digital education and human support.
Children and teenagers need to learn how to use technology without confusing an automated response with a relationship of trust or professional care.
A QUESTION THE WORLD CAN NO LONGER POSTPONE
Emma's case is not merely a dispute between a family and one of the world's most powerful technology companies.
It is a warning about the speed at which artificial intelligence is entering schools, homes and the everyday lives of millions of minors.
Technology can help people learn, research, communicate and access information. But its expansion must be accompanied by real safety guarantees, especially when its users are children and teenagers.
A school computer must never become a place where a psychological crisis develops without responsible adults being able to detect it.
Artificial intelligence cannot replace human presence when a minor needs help.
And no technological innovation can ever take precedence over the protection of human life.
AIRE BSF — INFORMATION, INVESTIGATION AND PREVENTION.
With information from Reuters, AFP, The New York Times, Reporters Sans Frontières and the JMH International Consortium of Journalists.
WORLD ORGANIZATION BULLYING SIN FRONTERAS
