How AI deepfakes threaten student safety

Schools across Australia are being urged to review how they share student images online following a warning from the eSafety Commissioner that predators are increasingly using AI deepfake technology to manipulate children’s photos.

Reports of AI-generated image misuse are rising, prompting fresh concerns about student privacy, online safety, and the growing sophistication of artificial intelligence.

Experts say images posted on school websites and social media can be exploited without consent, creating new risks for young people.

Speaking with Ticker, Dr Karen Sutherland from UniSC said schools, parents, and technology companies all have a role to play in reducing these risks.

She discussed the need for stronger safeguards, questioned whether existing laws are keeping pace with AI, and highlighted the responsibility of social media platforms to better protect children online.

As AI technology continues to evolve, experts warn that proactive action from schools, governments, families, and the tech industry will be critical to staying ahead of emerging threats and protecting students in the digital age.