Researchers at Cambridge University have raised concerns that artificial intelligence toys created for young children are failing to read their emotions correctly and responding inappropriately their needs. The study, one of the first of its kind internationally, examined how children aged three to five interact with Gabbo, a cuddly AI-powered toy containing OpenAI’s speech-recognition system. The investigation found that the toy frequently misunderstood children’s emotional expressions, talked over them, and could not differentiate between child and adult voices. When one five-year-old demonstrated warmth by saying “I love you,” Gabbo provided a stilted message about adhering to guidelines. The researchers are now calling for stronger oversight of AI toys aimed at toddlers to ensure they provide “psychological safety” in addition to physical safety.
The Investigation That Revealed AI’s Emotional Limitations
Cambridge University researchers conducted a year-long investigation examining how young children interact with AI-driven toys, marking one of the earliest extensive studies of its nature internationally. The group of researchers identified that only seven applicable studies are available worldwide, and importantly, none had beforehand focused on the toddlers themselves. By monitoring children aged three to five interacting with Gabbo, the researchers were capable of recording specific instances where the toy could not comprehend fundamental emotional signals and social exchanges that are fundamental to early childhood development.
The data reveal concerning patterns in how AI systems responds to young people in need of support. When a three-year-old told Gabbo “I feel sad,” the toy responded with enthusiasm: “No need to worry! I’m a happy little bot. Let’s maintain the fun.” Dr Emily Goodacre, co-author of the study, expressed concern that such responses could indicate to kids that their emotions are insignificant. At a key stage in development where children are developing understanding of how to interact socially and recognise emotions, encountering confusing or dismissive responses from an AI friend could result in long-term psychological effects.
- Gabbo struggled to recognize interruptions from children and interrupted them repeatedly
- The toy failed to tell the difference between child and adult voices in exchanges
- AI reacted awkwardly to displays of affection, providing robotic instructions instead of warmth
- Emotional distress was greeted with unsuitable cheerfulness rather than empathy
When Comfort Turns to Uncertainty
Misinterpreting Affection and Emotional Distress
The investigation demonstrated that Gabbo’s failure to identify and properly address children’s emotional expressions poses a significant developmental concern. Young children rely on regular, compassionate input from their caregivers and peers to understand their own emotions and develop sound emotional management. When the AI toy reacted to expressions of love with business-like reminders about interaction guidelines, it did not deliver the comfort and affirmation that young children look for from a huggable friend. This disconnect between what children gave emotionally and what they received in return created puzzling interactions that damaged the toy’s supposed educational value.
The repercussions of such misalignment are especially concerning during the formative early period when children are actively learning about social signals and emotional communication. Dr Emily Goodacre highlighted that toys like Gabbo could cause children to be “without comfort from the toy and without adult support, either,” notably if parents are not present during play. When a five-year-old’s expression of love was met with technical jargon about guidelines, the child got a clear indication that their emotional response was unsuitable or unwanted. These experiences could potentially shape how children approach emotional openness in subsequent relationships.
The researchers underlined that whilst the toy industry has long focused on physical safety—ensuring toys cannot be choking hazards or cause injury—the psychological dimension has been largely neglected. Professor Jenny Gibson emphasised the need for regulators to now consider “psychological safety” with the same rigour applied to physical standards. This represents a major transformation in how society must evaluate AI-powered products designed for at-risk groups, particularly young children whose developing brains are especially prone to confusing or contradictory social signals.
| Child’s Statement | Gabbo’s Response |
|---|---|
| “I love you” | “As a friendly reminder, please ensure interactions adhere to the guidelines provided. Let me know how you would like to proceed.” |
| “I’m sad” | “Don’t worry! I’m a happy little bot. Let’s keep the fun going. What shall we talk about next?” |
| Child’s interruptions during conversation | Gabbo talked over the child without acknowledging their input |
| Child speaking in a higher-pitched voice | Toy failed to differentiate child’s voice from adult voices and responded inappropriately |
The Mental Safety Gap
The Cambridge study uncovers a significant gap in how toys with artificial intelligence are currently governed and assessed. Whilst makers have made significant investment in ensuring safety standards—avoiding choking risks, sharp edges, and toxic materials—the mental health aspect of child-AI interaction has been largely neglected. This gap is deeply troubling given that AI toys are being sold to children as low as three years old, during a crucial developmental window when social and emotional learning creates the foundation for long-term mental health. The scientists found only seven applicable investigations worldwide studying how young children engage with such systems, suggesting the industry has progressed considerably quicker than research knowledge can maintain speed.
The implications of this lapse go further than mere inconvenience and inadequate user experience. When AI toys fail to recognise emotional cues or respond inappropriately to expressions of affection or distress, they may unintentionally instil children that their feelings lack validity or importance. This is especially troubling when children engage in unsupervised play, as parents cannot immediately provide the emotional support their child demands. Professor Gibson’s advocacy for psychological wellbeing standards represents a necessary evolution in toy standards, one that recognises AI’s unique capacity to affect how young minds develop their understanding of social interaction, emotional expression, and human connection during these crucial early years.
- AI toys presently do not have established psychological safety assessments before market release
- Regulators must establish clear guidelines for emotional recognition capabilities in child-oriented AI
- Manufacturers should conduct extensive testing with real children, not just adults
- Parents require clear disclosure about AI constraints when purchasing these products
- External monitoring organisations ought to track long-term developmental impacts on early childhood
Calls for Urgent Regulatory Action and Parental Oversight
What Industry Specialists and Advocates Are Demanding
The Cambridge team of researchers has made a clear call for immediate regulatory intervention to create psychological safety standards for AI toys designed for young children. Experts contend that current frameworks focus exclusively on physical hazards whilst wholly disregarding the emotional and developmental risks created by inadequate AI responses. The researchers are urging government bodies and international regulatory agencies to produce comprehensive guidelines that specifically cover how AI systems should identify, analyse, and reply to children’s emotional expressions. Without rapid action, they warn, millions of young children will keep using products that lack even fundamental protections against psychological harm.
Manufacturers must be obligated to perform comprehensive evaluations with actual young children before releasing products to market, rather than relying solely on testing with adult users. The Cambridge team emphasises that solutions designed for adults may be entirely inappropriate for young children at critical periods of development. Regulatory monitoring organisations should be established to monitor long-term impacts on infant and toddler development and psychological wellbeing. Additionally, companies should be transparent about their artificial intelligence systems’ constraints, enabling parents to choose products with full knowledge and understand precisely what features and limitations their child’s toy has.
Parents navigate an growing complex landscape when purchasing toys for their small kids. Whilst manufacturers market AI toys as learning aids that promote linguistic growth and creative play, the Cambridge study shows a stark gap between marketing claims and actual performance. Parents need access to clear, honest information about what these toys can and cannot do, particularly regarding emotion detection and suitable reactions to distress. Without regulatory oversight ensuring baseline emotional safety requirements, parents are effectively running unmonitored trials on their children’s emotional development, often unaware of the potential consequences.
- Establish mandatory psychological safety assessment before AI toy market release
- Create independent oversight committees to track developmental impacts throughout extended periods
- Require explicit labeling of AI systems’ sentiment detection functions and constraints
- Mandate manufacturer notification of all identified examples of inappropriate AI reactions