In an era where empathy can be simulated and companionship commodified, the interaction between minors and artificial intelligence is no longer merely a technological novelty. Writing in Lianhe Zaobao, Singapore’s flagship Chinese-language daily, Asia Academy of Digital Economics (AADE) President Tan Poh Hwee argued that the proliferation of AI virtual companions represents a critical intersection of psychological safety, public health, and children's rights.
The Commercialization of Empathy
Today's AI companions are engineered with humanized tones, personalized memory functions, and an architecture designed to offer unconditional presence. Tan noted that packaging a commercial algorithm as an emotional anchor heavily influences the developing attachment styles and social boundaries of adolescents. For a hyper-connected society already grappling with youth mental health pressures, this dynamic presents a profound vulnerability.
The primary danger lies in the core design of these systems. They are programmed to be perpetually online and endlessly accommodating. Tan stressed that teenagers must understand that an AI's "care" is a calculated product feature, not genuine human empathy.
Empirical Risks in Youth-AI Interaction
The concerns raised are firmly grounded in recent behavioral data. Citing research from the US-based non-profit Common Sense Media, Tan highlighted that nearly three-quarters of American teenagers have interacted with AI companions. More concerning is that approximately one-third of these users prefer confiding in an AI over a human for serious issues, while a quarter have actively disclosed sensitive personal information.
Furthermore, current safety guardrails on these platforms often fail to protect younger users. Tan referenced tests conducted by Stanford University researchers who posed as minors and easily bypassed safety filters on mainstream platforms to generate sexually suggestive, self-harm-related, and violent content. Even when terms of service strictly stipulate an 18-and-over user base, the underlying systems frequently engage minors in adult-oriented dialogue.
This creates an unprecedented hazard. Society is now facing a continuous generation of intimate or inappropriate interactions without a traditional human perpetrator, yet fully capable of inflicting psychological harm and erasing interpersonal boundaries.
A New Paradigm for AI Literacy
Addressing this new reality requires a fundamental shift in digital education. Tan emphasized that school-based AI literacy programs must evolve past their current focus on academic plagiarism, deepfakes, and misinformation. Educators must equip students to navigate emotional boundaries with machines. Minors must be explicitly taught the dangers of entrusting personal secrets, intimate imagery, or psychological crises to a faceless commercial entity.
The insights published in Lianhe Zaobao reflect AADE’s broader mandate to pioneer regulatory technology concepts and promote responsible digital governance across the region. As part of its commitment to digital inclusion, the Academy actively advocates for frameworks that protect vulnerable demographics from predatory algorithms. Empowering the next generation to interact with artificial intelligence safely and critically remains a cornerstone of building a resilient, secure, and equitable digital future.