AI in Government: The Sneaky Silent Scam Californians Need to Know About

Photo by Ministerie van Buitenlandse Zaken | License
Imagine a world where government algorithms are playing puppet master with your life, and nobody’s batting an eye. Welcome to California, 2025, where state agencies are pulling the ultimate tech sleight of hand. 🤖
The California Department of Technology just dropped a report claiming zero high-risk AI usage across nearly 200 state entities - and tech experts are calling absolute BS. Despite using algorithms that predict criminal recidivism and denying unemployment benefits to hundreds of thousands, these agencies are somehow reporting “no risk”.
The AI Shell Game
Let’s break down this digital deception. The state uses predictive technology that can literally determine someone’s future, yet claims these systems aren’t “high-risk”. The California Department of Corrections uses COMPAS, an algorithm with a documented history of racial bias, but nonchalantly reports no problematic automation.
Show Me the Money
Interestingly, legislative analyses suggest monitoring these AI systems could cost hundreds of millions annually. So wait - if there’s no high-risk AI, why would assessment cost billions? Something doesn’t add up, and tech advocates are not having it.
The Real Human Cost
Behind these algorithms are real people’s lives. When the Employment Development Department paused unemployment benefits for 1.1 million people using AI fraud scoring, 600,000 claims were later confirmed as legitimate. This isn’t just a technical glitch - it’s a human rights issue.
As Governor Newsom continues deploying AI for everything from wildfire communication to tax assistance, one thing becomes crystal clear: transparency isn’t just needed, it’s mandatory. Tech isn’t neutral - it carries the biases of its creators, and Californians deserve to know exactly how these systems might be impacting their lives.
AUTHOR: cgp
SOURCE: CalMatters