{"id":46120,"date":"2026-04-02T02:23:09","date_gmt":"2026-04-02T06:23:09","guid":{"rendered":"https:\/\/tvdelmarva.com\/wp\/new-tool-in-development-to-combat-ai-chatbot-extremism\/"},"modified":"2026-04-02T02:23:09","modified_gmt":"2026-04-02T06:23:09","slug":"new-tool-in-development-to-combat-ai-chatbot-extremism","status":"publish","type":"post","link":"https:\/\/tvdelmarva.com\/wp\/new-tool-in-development-to-combat-ai-chatbot-extremism\/","title":{"rendered":"New Tool in Development to Combat AI Chatbot Extremism"},"content":{"rendered":"\n
\"\"<\/figure>\n\n\n

A specialized company that provides crisis intervention services for major artificial intelligence platforms is working on groundbreaking technology to identify and help users displaying signs of violent extremism.<\/p>

ThroughLine, a New Zealand-based startup that currently assists ChatGPT’s parent company OpenAI, along with competitors Anthropic and Google, plans to expand beyond its existing mental health crisis support to tackle radicalization concerns.<\/p>

The company’s founder, Elliot Taylor, a former youth worker who operates from rural New Zealand, revealed the initiative comes as AI firms face mounting pressure over safety issues and legal challenges for allegedly failing to prevent violence.<\/p>

“It’s something that we’d like to move toward and to do a better job of covering and then to be able to better support platforms,” Taylor explained during a recent interview, though he noted no timeline has been established for the project.<\/p>

The development follows a February incident where OpenAI faced potential government intervention from Canada after disclosing that someone who committed a fatal school shooting had been banned from their platform without notifying authorities.<\/p>

ThroughLine currently manages an extensive network of 1,600 crisis helplines across 180 countries, which are continuously monitored and updated. When AI systems detect indicators of potential mental health emergencies, self-harm risks, domestic violence situations, or eating disorders, users are automatically connected to ThroughLine’s services and matched with nearby human-operated support resources.<\/p>

The proposed anti-extremism solution is being developed in partnership with The Christchurch Call, an organization established following New Zealand’s deadliest terrorist incident in 2019 to eliminate online hatred. This collaboration would involve the anti-extremism organization providing expert guidance while ThroughLine creates the intervention technology.<\/p>

According to Taylor, the new system would likely combine a specially trained chatbot designed to respond to individuals showing extremist tendencies with connections to real-world mental health professionals.<\/p>

“We’re not using the training data of a base LLM,” Taylor clarified, referring to the standard datasets that large language model platforms use to generate text. “We’re working with the correct experts.”<\/p>

Galen Lamphere-Englund, who serves as a counterterrorism advisor for The Christchurch Call, expressed optimism about expanding the tool’s use to gaming forum moderators and parents seeking to identify online extremism.<\/p>

Henry Fraser, an artificial intelligence researcher at Queensland University of Technology, praised the concept as both beneficial and essential, noting it addresses relationship dynamics rather than just problematic content.<\/p>

However, Fraser cautioned that success would depend on “how good are follow-up mechanisms and how good are the structures and relationships that they direct people into at addressing the problem.”<\/p>

Taylor acknowledged that follow-up procedures, including potential notifications to law enforcement about dangerous users, remain undetermined but would consider risks of escalating harmful behavior.<\/p>

He emphasized that individuals in crisis often share information online that they would be too embarrassed to discuss with another person, warning that government pressure on platforms to disconnect users engaging in sensitive conversations could worsen situations.<\/p>

Research from New York University’s Stern Center for Business and Human Rights indicates that increased platform moderation under law enforcement pressure has driven extremist sympathizers to less regulated alternatives like Telegram.<\/p>

“If you talk to an AI and disclose the crisis and it shuts down the conversation, no one knows that happened, and that person might still be without support,” Taylor warned.<\/p>

OpenAI confirmed their partnership with ThroughLine but declined additional comment. Anthropic and Google have not yet responded to requests for information about the initiative.<\/p>","protected":false},"excerpt":{"rendered":"

A New Zealand startup that works with major AI companies like OpenAI and Google is developing new technology to identify and redirect users showing violent extremist behavior on platforms like ChatGPT. The tool would connect at-risk individuals with deradicalization support services, similar to existing crisis intervention systems for mental health emergencies.<\/p>\n","protected":false},"author":4,"featured_media":46119,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[838],"tags":[],"class_list":["post-46120","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-science"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"https:\/\/i0.wp.com\/tvdelmarva.com\/wp\/wp-content\/uploads\/2026\/04\/news-1775110989638.jpg?fit=450%2C305&ssl=1","jetpack_shortlink":"https:\/\/wp.me\/pbtNqq-bZS","jetpack-related-posts":[{"id":70133,"url":"https:\/\/tvdelmarva.com\/wp\/ai-startup-modal-labs-reaches-4-65-billion-valuation-after-major-funding-round\/","url_meta":{"origin":46120,"position":0},"title":"AI Startup Modal Labs Reaches $4.65 Billion Valuation After Major Funding Round","author":"Admin","date":"May 21, 2026","format":false,"excerpt":"San Francisco-based AI startup Modal Labs secured $355 million in new funding, pushing its valuation to $4.65 billion. The company helps AI firms access computing power and provides testing tools for AI-generated code.","rel":"","context":"In "Business"","block_context":{"text":"Business","link":"https:\/\/tvdelmarva.com\/wp\/category\/business\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/tvdelmarva.com\/wp\/wp-content\/uploads\/2026\/05\/news-1779384147651.jpg?fit=450%2C300&ssl=1&resize=350%2C200","width":350,"height":200},"classes":[]},{"id":42615,"url":"https:\/\/tvdelmarva.com\/wp\/ai-startup-reflection-seeks-25b-valuation-in-massive-funding-round\/","url_meta":{"origin":46120,"position":1},"title":"AI Startup Reflection Seeks $25B Valuation in Massive Funding Round","author":"Admin","date":"March 25, 2026","format":false,"excerpt":"Reflection AI, supported by chip giant Nvidia, is pursuing $2.5 billion in new investment funding that would value the artificial intelligence company at $25 billion. Major bank JPMorgan Chase is reportedly considering joining the funding round through its security initiative.","rel":"","context":"In "Business"","block_context":{"text":"Business","link":"https:\/\/tvdelmarva.com\/wp\/category\/business\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/tvdelmarva.com\/wp\/wp-content\/uploads\/2026\/03\/news-1774495317427.jpg?fit=450%2C299&ssl=1&resize=350%2C200","width":350,"height":200},"classes":[]},{"id":69387,"url":"https:\/\/tvdelmarva.com\/wp\/ai-startup-lamda-secures-major-cloud-computing-contract-with-trading-firm\/","url_meta":{"origin":46120,"position":2},"title":"AI Startup Lamda Secures Major Cloud Computing Contract with Trading Firm","author":"Admin","date":"May 20, 2026","format":false,"excerpt":"Cloud computing company Lamda announced Wednesday it has secured a contract with high-speed trading firm Hudson River Trading. The agreement involves providing access to more than 1,000 of the latest artificial intelligence chip systems.","rel":"","context":"In "Business"","block_context":{"text":"Business","link":"https:\/\/tvdelmarva.com\/wp\/category\/business\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/tvdelmarva.com\/wp\/wp-content\/uploads\/2026\/05\/news-1779279772646.png?fit=1200%2C675&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/tvdelmarva.com\/wp\/wp-content\/uploads\/2026\/05\/news-1779279772646.png?fit=1200%2C675&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/tvdelmarva.com\/wp\/wp-content\/uploads\/2026\/05\/news-1779279772646.png?fit=1200%2C675&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/tvdelmarva.com\/wp\/wp-content\/uploads\/2026\/05\/news-1779279772646.png?fit=1200%2C675&ssl=1&resize=700%2C400 2x, https:\/\/i0.wp.com\/tvdelmarva.com\/wp\/wp-content\/uploads\/2026\/05\/news-1779279772646.png?fit=1200%2C675&ssl=1&resize=1050%2C600 3x"},"classes":[]},{"id":56920,"url":"https:\/\/tvdelmarva.com\/wp\/alphabet-plans-massive-40b-investment-in-ai-company-anthropic\/","url_meta":{"origin":46120,"position":3},"title":"Alphabet Plans Massive $40B Investment in AI Company Anthropic","author":"Admin","date":"April 24, 2026","format":false,"excerpt":"Google's parent company Alphabet is preparing to make a substantial investment in artificial intelligence startup Anthropic. The tech giant will initially invest $10 billion, with the possibility of adding another $30 billion in future funding.","rel":"","context":"In "Business"","block_context":{"text":"Business","link":"https:\/\/tvdelmarva.com\/wp\/category\/business\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/tvdelmarva.com\/wp\/wp-content\/uploads\/2026\/04\/news-1777047801356.jpg?fit=450%2C300&ssl=1&resize=350%2C200","width":350,"height":200},"classes":[]},{"id":63907,"url":"https:\/\/tvdelmarva.com\/wp\/ai-startup-anthropic-secures-massive-1-8b-cloud-computing-partnership\/","url_meta":{"origin":46120,"position":4},"title":"AI Startup Anthropic Secures Massive $1.8B Cloud Computing Partnership","author":"Admin","date":"May 8, 2026","format":false,"excerpt":"Artificial intelligence company Anthropic has entered into a massive $1.8 billion cloud computing agreement with Akamai Technologies to handle growing demand for its AI services. The deal sent Akamai's stock soaring nearly 30% as investors reacted positively to the partnership announcement.","rel":"","context":"In "Business"","block_context":{"text":"Business","link":"https:\/\/tvdelmarva.com\/wp\/category\/business\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/tvdelmarva.com\/wp\/wp-content\/uploads\/2026\/05\/news-1778268272989.jpg?fit=450%2C279&ssl=1&resize=350%2C200","width":350,"height":200},"classes":[]},{"id":35995,"url":"https:\/\/tvdelmarva.com\/wp\/german-startup-to-build-major-ai-data-center-doubling-nations-capacity\/","url_meta":{"origin":46120,"position":5},"title":"German Startup to Build Major AI Data Center, Doubling Nation’s Capacity","author":"Admin","date":"March 13, 2026","format":false,"excerpt":"A German technology startup called Polarise announced plans to construct a massive 30-megawatt artificial intelligence data center in Bavaria by mid-2027. The facility would double Germany's domestically-operated computing capacity as European nations seek greater control over critical technology infrastructure.","rel":"","context":"In "Business"","block_context":{"text":"Business","link":"https:\/\/tvdelmarva.com\/wp\/category\/business\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/tvdelmarva.com\/wp\/wp-content\/uploads\/2026\/03\/news-1773399061680.jpg?fit=450%2C300&ssl=1&resize=350%2C200","width":350,"height":200},"classes":[]}],"jetpack_sharing_enabled":true,"jetpack_likes_enabled":true,"_links":{"self":[{"href":"https:\/\/tvdelmarva.com\/wp\/wp-json\/wp\/v2\/posts\/46120","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/tvdelmarva.com\/wp\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/tvdelmarva.com\/wp\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/tvdelmarva.com\/wp\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/tvdelmarva.com\/wp\/wp-json\/wp\/v2\/comments?post=46120"}],"version-history":[{"count":0,"href":"https:\/\/tvdelmarva.com\/wp\/wp-json\/wp\/v2\/posts\/46120\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/tvdelmarva.com\/wp\/wp-json\/wp\/v2\/media\/46119"}],"wp:attachment":[{"href":"https:\/\/tvdelmarva.com\/wp\/wp-json\/wp\/v2\/media?parent=46120"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/tvdelmarva.com\/wp\/wp-json\/wp\/v2\/categories?post=46120"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/tvdelmarva.com\/wp\/wp-json\/wp\/v2\/tags?post=46120"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}