A machine should never decide if a disabled person survives

Published 21 July 2026

On 1 July 2026, our Government handed a computer the power to decide whether disabled people and their families get the money they need to live. It did this in a single day, with no public submissions, and it expects the change to pay out $55 million less in benefits over four years.

What actually happened, and why the framing is wrong

The Social Security (Modernisation) Amendment Act 2026 was introduced and passed all its readings on 28 May 2026, under budget urgency, and was assented to on 4 June 2026. The Human Rights Commission | Te Kāhui Tika Tangata warned that bypassing select committee removed a critical step to test whether the safeguards protect people's rights to social security, housing, and an adequate standard of living.

The Act was presented as tidying up administration. The official narrative goes like this: The Ministry of Social Development makes millions of decisions each year. Many are straightforward, and automating them frees up case managers to help people in complex situations. Put like that, who could object?

Here is the part that framing leaves out. This was a Budget 2025 savings initiative, projected to cut spending by $157.9 million over four years. Budget 2026 added a further $54.5 million in savings, tied to cutting Temporary Additional Support. The Government told the public it expected to pay out $55 million less in benefits over four years as a direct result.

You cannot design a system to pay out less and then promise it will not affect who gets paid. Those two claims cannot both be true. When the financial model of a welfare system is built on spending less, the pressure runs one way: towards denial, not access.

It is important to understand what this technology is. It is not ChatGPT. It is rules-based automation running on set criteria and the data MSD already holds. The problem is that disabled people's lives do not fit inside a rulebook, and this law now lets a rulebook decide.

Why this lands hardest on disabled people and whānau

Disabled people and their families rely on the Supported Living Payment, the Disability Allowance, and the Child Disability Allowance more than almost anyone. Many live on low, fixed incomes with extra disability-related costs and no other way to make up a shortfall. When an automated system gets it wrong, disabled people and families are often the people it hurts first.

And automated systems do get disability wrong, because disability rarely fits a tidy category. Conditions fluctuate. Energy varies. Mental distress does not follow a schedule. Narrow scoring tools cannot capture any of that, as disability researcher and advocate Dr Bex has set out in detail.

One example she shares of this is practice is a man whose wife has young-onset dementia who spent roughly 12 months trying to get MSD to stop sending her automated notices about work opportunities. Staff agreed the system was automated and hard to interrupt. As he put it, dementia is progressive and there is no cure. A person "is not going to suddenly become 'better' and able to return to normal employment because an automated system or review cycle asks the question again."

The new law makes this worse. It lets MSD require a person to attend a medical examination at any time, with the doctor nominated by MSD if the two sides do not agree, and that doctor sends the report straight to MSD rather than to the person's own clinician. We have raised concerns about this before. A doctor contracted and paid by MSD cannot act as a neutral medical voice, and disabled people can be sent to someone who does not know their history. This gives Work and Income staff power to override the clear evidence of a person's own GP or specialist. Automating that process does not fix the problem. It hard-wires it.

We have seen where this road leads. In Australia, the Robodebt scheme used automation to chase welfare debts that people did not owe. It was ruled illegal, it caused deep harm, and it was linked to suicides. It was projected to save $1.7 billion and has instead cost around $2.4 billion and counting. When automation fails, it fails at speed and at scale.

The safeguards are not strong enough, and everyone credible is saying so

The Government points to its assurances. Automation will only handle "straightforward" decisions. People will be told when it was used. A person, not a machine, will review a challenged decision. An Automated Decision-Making Standard guards against bias and error.

These promises sound reassuring until you look closely.

"Straightforward" has no fixed meaning. The Act enables automation for any and all benefit decisions, so the line between simple and complex is drawn by MSD itself. Being told a decision was automated does not help someone who lacks the support, capacity, or means to challenge it, and disabled people already face extra barriers to appealing. And the ADM Standard is a Ministry document, not law. MSD can change it whenever it likes, without Parliament.

This is not only our view. The New Zealand Law Society has flagged "black box" systems that make it harder for people to know whether a decision was fair, let alone challenge it, and has recommended keeping such systems out of decisions on benefit entitlements. It has also warned that rushed law-making through urgency weakens democratic accountability. The Human Rights Commission | Te Kāhui Tika Tangata warned the law was passed under urgency without the scrutiny needed to test whether its safeguards protect people's rights. And the Law Commission is now reviewing automated government decision-making, because New Zealand has no overarching law, standard, or guidance to keep it lawful and consistent.

New Zealand has no AI-specific law at all. The European Union treats AI used for welfare eligibility as high-risk and demands human oversight, transparency, and rights checks. We offer none of that. We signed the United Nations Convention on the Rights of Persons with Disabilities, which requires disabled people to be at the table from the start of decisions that affect us. Because this was passed with no public scrutiny, it’s fair to say disabled people and families were not at the table. Indeed, not even in the building.

What CCS Disability Action are asking for

New Zealand has, so far, avoided a Robodebt-scale disaster. Whether we keep avoiding one is a choice we make now. CCS Disability Action is asking for three things.

  1. MSD should not automate any Supported Living Payment or disability-related entitlement decision until the Law Commission's review is complete and its safeguards are law. Administrative standards that MSD can rewrite on its own are not enough for decisions this serious.

  2. Parliament should adopt a positive test for urgency. Governments should have to show a genuine reason from a recognised category, and confirm a bill has had proper rights-screening, before skipping select committee. Constitutional experts, including Sir Geoffrey Palmer, have argued for exactly this.

  3. Disabled people, families, DPOs and related agencies must be consulted before any welfare law that affects them, and that law must be grounded in the UNCRPD, Te Tiriti o Waitangi, and Enabling Good Lives. This is what our signed international commitments already require.

A benefit is not a line in a budget. It is a person's ability to eat, to stay housed, to keep going. Disabled people with permanent conditions and whānau should not have to keep proving they exist to a machine that was designed to pay out less.

Frequently asked questions: AI in New Zealand welfare decisions

If this is the first you have heard of it, here are the key questions answered simply.

What is the Social Security (Modernisation) Amendment Act 2026, and what does it change?

It is a new law Parliament passed in mid-2026. It lets the Ministry of Social Development use automated systems to make far more decisions about people's benefits. Before, automation was limited to a few simple tasks. Now it can be used across almost any benefit decision.

What does "automation" or "AI" actually mean in the welfare system?

It means a computer following set rules, not a person weighing up your situation. It is not ChatGPT or the kind of AI you may have use in everyday life. It works off the data the Ministry already holds and a fixed set of criteria.

How was the law passed, and why did that happen so quickly?

Very quickly. It went through all its stages in a single day, under a process called urgency, alongside the Budget. That meant no select committee, no chance for the public to make submissions, and no proper check on whether it protects people's rights.

How much money is the Government trying to save, and why does that matter?

The Government expects the change to pay out $55 million less in benefits over four years. That matters because a system built to spend less tends to push towards saying no.

What does the new law mean for disabled people and their families?

Many disabled people rely on payments like the Supported Living Payment. The new law also lets the Ministry require a person to see a Ministry-chosen doctor at any time, and to send full medical reports straight to the Ministry rather than to the person's own doctor. If a computer misreads a complex or changing condition, the person can lose income they depend on and then face a hard road to put it right.

What is CCS Disability Action asking the Government to do?

We are asking for three things: pause automated decisions on disability payments until proper legal safeguards exist, require a genuine reason before Parliament uses urgency to skip public scrutiny, and consult disabled people before passing any law that affects them.

About CCS Disability Action

CCS Disability Action is the largest pan-disability support and advocacy organisation in Aotearoa New Zealand.

We support people with all types of impairments and have been working alongside disabled people since 1935.

We are at the forefront of service provision, advocacy and information sharing in the disability sector. We partner with disabled people, their families and whānau to enable them to have choice and control in their lives. Our vision is to see every disabled person and whānau hauā interwoven into the lives of their whānau and community.

Next
Next

Our submission on the Jobseeker Support and Accommodation Supplement Bill