Child-monitoring apps might need a reboot
Child-monitoring apps, increasingly leveraging AI, are booming as parents fear online dangers, but research suggests they can erode trust and cause harm despite preventing some serious incidents.
Intelligence analysis by Gemini 2.5 Flash
The article explores the double-edged nature of child-monitoring apps, which scan children's digital communications to alert parents to dangers. While these tools have prevented serious harm, they also lead to false alarms, privacy breaches, and a breakdown of trust, prompting calls for a shift towards platform-level safety and resilience training for children.
Imagine your parents want to keep you safe when you're playing online, like a lifeguard watching swimmers. Some apps are like a lifeguard who just tells you where to swim and how long you can stay in the water. But other apps are like a lifeguard who reads all your notes and listens to all your conversations, which can sometimes feel like too much watching and make you feel less trusted, even if they're trying to help.
Analysis
The proliferation of child-monitoring applications, particularly those integrating artificial intelligence, presents a complex ethical and practical dilemma for families navigating the digital landscape. While these tools are marketed as essential safeguards against escalating online threats—from cyberbullying and sextortion to drug dealing and even AI chatbots allegedly coaching suicide—their efficacy and long-term impact on children's well-being and family trust are under intense scrutiny. The market for parental control software, valued at an estimated $1.57 billion in 2025, is projected to nearly triple by 2034, underscoring the widespread parental anxiety driving this growth.
Pam Wisniewski
Pam Wisniewski's personal journey profoundly shaped her career, offering a unique perspective on internet safety. Having experienced isolation and then finding community online as a teenager, she also encountered significant risks, including a dangerous interaction that later revealed a predator. These formative experiences led her to dedicate over a decade to researching how families can achieve digital safety without sacrificing trust, viewing the internet as a "double-edged sword."
Wisniewski, a principal research scientist at the International Computer Science Institute, advocates for a shift from aggressive surveillance to fostering resilience in children. She argues that defining safety as the absence of risk leads to restrictive measures, whereas defining it as the ability to protect oneself and engage with risk necessitates different solutions. Her work focuses on developing tools that build trust and train children to recognize and cope with online dangers, rather than merely monitoring their every digital move.
Bark Technologies
Bark Technologies stands out as a leader among content-monitoring applications, demonstrating the significant scale and reach of these surveillance tools. In 2025 alone, the company reported scanning an astonishing 11 billion messages to or from 7.5 million children across the United States. Its free school program is particularly pervasive, implemented in over 3,700 districts and covering approximately one in 10 American children.
While Bark aims to flag only content that triggers its algorithmic filters for potential dangers like self-harm, bullying, or sexual content, some competitors, such as FlashGet Kids, offer even more intrusive features like screen mirroring and camera access. The article acknowledges that these apps have achieved genuine successes, including preventing suicide attempts, intercepting predators, and averting school shootings, with Bark's chief marketing officer, Titania Jordan, noting instances where the FBI has thanked the company for credible threat alerts. However, these successes are often weighed against the documented harms, such as false alarms, privacy invasions, and the erosion of trust within families.
2025 National Poll
The context for the booming child-monitoring app market is clearly articulated by the University of Michigan's 2025 National Poll on Children’s Health, which identified parents' top three worries as social media, screen time, and internet safety. This poll highlights a pervasive parental fear that is further exacerbated by alarming statistics regarding online harms. Nearly half of American teenagers report experiencing online bullying or harassment, according to the Pew Research Center, indicating a widespread problem.
Beyond bullying, the dangers escalate significantly, with online drug dealers selling counterfeit pills laced with fentanyl and a dramatic rise in financial sextortion cases. The National Center for Missing & Exploited Children fielded over 23,000 reports of financial sextortion in the first half of 2025 alone, where predators exploit children for money. The emergence of chatbots, with companies like OpenAI facing lawsuits for allegedly coaching children toward suicide, adds another layer of complexity and fear, driving parents to seek technological solutions for protection.
Key points
- Child-monitoring apps, increasingly using AI, are a booming market driven by parental fears over online dangers like cyberbullying, sextortion, and harmful chatbot interactions.
- While these apps have prevented serious incidents like suicide attempts and school shootings, they also cause harm through false alarms, privacy invasions, and eroding trust.
- Researchers like Pam Wisniewski advocate for shifting from aggressive surveillance to fostering children's resilience and building trust with parents.
- Alternative approaches include implementing a 'duty of care' on social media platforms to build in safety features, rather than leaving families to manage risks alone.
- The debate highlights the tension between protecting children from online harms and respecting their privacy and fostering their autonomy.
A shift towards 'duty of care' approaches for platforms and resilience training for children could lead to a more balanced and effective safety framework. This would empower children with self-protection skills and foster open communication with parents, rather than relying solely on intrusive surveillance.
Over-reliance on child-monitoring apps can lead to significant downsides, including false alarms that punish children unfairly, the premature revelation of personal secrets, and a breakdown of trust between children and parents, potentially causing lasting anxiety into adulthood.
