ThroughLine, a New Zealand–based crisis-management startup, is directing users flagged for self-harm, domestic violence, or eating disorders to crisis support from OpenAI, Anthropic, and Google, while exploring expansion to combat violent extremism.

The Christchurch Call, the anti-extremism coalition formed after the 2019 New Zealand attack, is guiding the development of the new tool and its use in moderation.

ThroughLine is coordinating with The Christchurch Call to provide resources for platform moderators, parents, and caregivers to identify and address online extremism, with a focus on support rather than shutdown.

Experts warn that the tool’s effectiveness hinges on robust follow-up systems, quality referrals, and careful handling of escalation and privacy concerns, not merely flagging content.

Analysts emphasize that success depends on follow-up effectiveness and established support structures, alongside avoiding disengagement when conversations are blocked.

The approach must balance follow-up, existing support networks, and safety considerations to prevent users from moving to less regulated platforms.

The project may incorporate follow-up mechanisms and potential alerts to authorities, while avoiding overreach that could push users toward less regulated spaces.

There is no set release date; testing is ongoing and discussions include whether to implement authority alerts and follow-up features, balancing support with risk of escalation.

Current testing continues without a defined timeline, and the scope could involve gaming forums as well as parents and caregivers seeking to curb online extremism.

Experts note that online distress signals often involve disclosures users wouldn’t share in person, underscoring the danger of conversations simply being shut down.

There is broader industry concern about platform safety, government scrutiny, and shifts to less-regulated channels, highlighting the need for deradicalisation support alongside crisis routing.

The emphasis is on empowering platforms to better support users while balancing safety and avoiding premature conversation shutdowns.