What Happened
The eSafety Commissioner has released new research showing AI tools have become a routine part of life for Australian children. The report, Talking to machines: Children's experiences with AI assistants and companions, surveyed almost 2,000 Australian children aged 10 to 17.
The research found 78% of children in that age group had used an AI assistant, with ChatGPT the most commonly used tool. Among those who had used AI assistants or companions, 28% were using them a few times a week, while one in five (20%) were using them daily or more often.
Why It Matters
The findings point to risks that go beyond homework help. One in five children (20%) who had used an AI assistant or companion reported experiencing a potentially inappropriate or harmful interaction, including controlling behaviour, harmful advice, bullying, or exposure to hateful content. Around one in three (32%) reported sharing personal or sensitive information with an AI tool, including photographs or personal secrets.
The eSafety Commissioner addressed both the opportunity and the risk directly: "It's encouraging that many children are exploring these technologies thoughtfully, but they also need to understand that AI has its limits. AI is not a trusted adult and cannot replace those key human interactions when children need advice, support or help with their wellbeing."
Key Details
The report distinguishes between two categories of AI product. AI assistants are generally designed to help people learn, answer questions, solve problems, and complete everyday tasks. AI companions are designed primarily for ongoing conversations, friendship, and emotional support.
More than half of children (54%) who had used AI assistants or companions said they had used them for personal or social reasons, including asking for advice about situations in their lives, discussing physical or mental health, talking about feelings, or simply having someone to chat with.
The eSafety Commissioner's statement on parental guidance was direct: "Open, honest and non-judgemental conversations remain one of the best ways parents can help children think critically about AI, understand its limitations and make informed decisions about when and how to use it."
On the obligations of technology companies, the Commissioner stated: "That means building strong safeguards into services, discouraging the unnecessary sharing of sensitive personal information, reducing the risk of harmful interactions, and considering children's developmental needs throughout the design process. Safety by Design has never been more important." Companies that fail to comply may face civil penalties of up to $54.6m.
Background and Context
Children's use of AI shifts with age. Younger children were more likely to use AI for entertainment, curiosity, and chatting, while teenagers increasingly turned to AI for advice about life situations, physical health, and mental health. The BBC has separately reported on how children are using AI tools across a range of contexts, noting the breadth of ways young people interact with these systems.
What Comes Next
The eSafety Commissioner's research adds weight to calls for platform-level accountability. The Safety by Design framework places the burden on technology companies to anticipate harm before it reaches users, rather than relying on children or parents to manage risk after the fact. With civil penalties of up to $54.6m available for non-compliance, regulators have signalled they intend to hold platforms to account.