ThroughLine, a New Zealand crisis-management startup, currently routes users flagged for self-harm, domestic violence, or eating disorders to crisis support for OpenAI, Anthropic, and Google, and is exploring expansion to combat violent extremism.

The company is in talks with The Christchurch Call initiative to guide development, aiming to support platform moderation and provide deradicalisation resources.

The Christchurch Call, an anti-extremism coalition formed after the 2019 New Zealand terror attack, is involved in advising the new tool.

Experts and stakeholders are weighing follow-up mechanisms, risk assessments, potential alerts to authorities, and the risk of triggering escalated behavior if interventions are poorly designed.

Analysts stress the need for robust follow-up structures, safe referrals, and caution that aggressive moderation could push users to less regulated spaces.

The tool would operate as a hybrid model, with chatbot interactions and referrals to human services, and could include follow-up features such as alerts to authorities, though specifics and timeline remain undecided.

A hybrid approach with potential follow-up mechanisms is emphasized, including possible alerts to authorities, but exact features and release timing have not been determined.

There is a focus on empowering platforms to better support users while balancing safety and avoiding premature conversation shutdowns.

The project may implement follow-up mechanisms and potential alerts to authorities, aiming to avoid overreaching moderation that deters users from regulated spaces.

Broader industry concerns about platform safety — including prior government scrutiny and shifts to less-regulated channels — highlight the relevance of combining deradicalisation support with crisis routing.

The initiative arrives amid heightened safety and legal pressures on AI firms over alleged links to violent acts and the effectiveness of platform moderation.

Testing is ongoing with no set release date; the scope could include gaming forums, parents, and caregivers seeking to reduce online extremism.