New Canadian legislation aimed at controlling AI chatbots has sparked concern among technology experts who question whether the proposed rules can actually work.
The bill was introduced this week following widespread public anger over a February school shooting in British Columbia that claimed nine lives. Controversy erupted when OpenAI admitted it had failed to notify police about disturbing ChatGPT conversations involving the shooting suspect.
Under the proposed legislation, Canada would establish a new digital oversight agency and implement a social media prohibition for users under 16, similar to Australia’s recent approach. The regulatory body would mandate that chatbots minimize risks when users search for dangerous material and implement emergency response protocols for discussions involving suicide and self-harm.
However, the proposal has faced sharp criticism from academics and legal professionals who point to vague language, potential enforcement gaps, and an extended implementation timeline.
“If this is the preview of a law, I do not have high hopes for something that will be useful in a practical sense,” said Evan Light, an associate professor at the University of Toronto who focuses on technology and privacy.
Light expressed surprise at the bill’s lack of development, noting that internet restrictions could be easily bypassed using VPNs – virtual private networks that mask users’ internet addresses – or other methods.
The office of Canada’s Identity and Culture Minister Marc Miller did not immediately respond to a request for comment on the issue.
During Wednesday’s announcement, Miller acknowledged the challenge of balancing privacy rights with social media and AI chatbot oversight. He clarified that the proposed legislation would not cover private messaging platforms like WhatsApp or Signal, and noted that companies meeting specific regulatory standards could receive exemptions from the social media restrictions.
Miller referenced the Tumbler Ridge shooting in British Columbia, explaining that the 18-year-old suspect’s ChatGPT account had been internally flagged for violent content but authorities were never contacted.
Miller said the company “made an egregious human error” and the government was now taking steps to make social media and AI chatbots “safer by design.”
OpenAI did not respond to a request for comment. The company previously apologized for not alerting Canadian authorities.
Multiple governments worldwide, including those in Europe, Brazil, and several U.S. states, are advancing new age verification requirements for social networks, AI chatbots, and adult content providers.
A Meta spokesperson said in an email that social media bans are “counterproductive” and that the company is assessing the implications of the proposed bill.
A spokesperson for Google, which owns YouTube, said the company is committed to working with the government to establish higher safety standards, so parents can choose safer online experiences for their children. A TikTok spokesperson said the platform already has more than 50 safety and privacy settings and parents can use “Family Pairing” to manage their teens’ experience.
Government officials have said it could take a year for the bill to pass and 18 months to set up the digital regulator once it does.
Florian Martin-Bariteau, director of the Centre for Law, Technology and Society at the University of Ottawa, warned that children would likely be able to circumvent the social media ban and AI chatbot restrictions.
Since Australia’s social media ban took effect, the regulatory agency enforcing it reported that a substantial number of children under 16 still retain accounts.
“The proposed framework will move them to riskier, smaller platforms,” he said, adding that while rules for major platforms could likely be enforced, it would be virtually impossible for Canada to block smaller websites that don’t comply. “By trying to protect kids, we may actually put them at greater risk.”
