--- title: "Driverless Cars are Biased Against Dark-Skinned People and Kids, Scientists Say" description: "A review of eight different AI pedestrian detectors revealed the programs to be worse at detecting darker-skinned pedestrians and kids." date: "2023-08-19" modified: "2023-08-21" authors: - name: "Maggie Harrison Dupré" job_title: "Senior Staff Writer" link: "https://futurism.com/authors/mharrison" url: "https://futurism.com/the-byte/driverless-cars-biased" categories: - "Advanced Transport" tags: - "ai bias" - "Autonomous vehicles" - "driverless cars" - "the digest" --- # Driverless Cars are Biased Against Dark-Skinned People and Kids, Scientists Say ![A review of eight different AI pedestrian detectors revealed the programs to be worse at detecting darker-skinned pedestrians and kids.]() *\Image: Cruise / Futurism\* ## Racist Cars Driverless cars have been stealing headlines by causing [traffic jams](), [getting stuck in cement](), and getting pulled over by [very confused police](). But according to a [recent study](), these basic technological failures hardly scratch the surface of more insidious problems that may lurk within autonomous vehicles' underlying tech. According to the not-yet-peer-reviewed study, conducted by researchers at King's College in London, a fairness review of eight different AI-powered pedestrian detectors trained on "widely-used, real-world" datasets revealed the programs to be much worse at detecting darker-skinned pedestrians than lighter-skinned ones, with the system failing to identify darker-complexioned individuals nearly eight percent more often than their lighter-skinned counterparts. That's a staggering figure — and speaks to the real, and potentially deadly, dangers of biased AI systems. ## Ominous Implications According to the study, researchers first engaged in extensive data annotation, marking a total of 8,111 images with "16,070 gender labels, 20,115 age labels, and 3,513 skin tone labels." From there, it was just a statistics game, with the researchers ultimately finding a 7.52 detection accuracy disparity between light- and dark-skinned folks. And according to the research, the danger for darker-skinned folks went up significantly in "low-contrast" or "low-brightness" settings — or, in other words, at night. But that wasn't all. In addition to this racial bias, the detectors had another collective — and concerning — blindspot: children, who results revealed were twenty percent less likely to be identified by the detectors than adults. It's important to note that none of the systems that were tested were actually those belonging to driverless car companies, as such information generally falls under the "proprietary information" umbrella. But as Jie Zhang, a Kings College lecturer in computer science and a co-author on the study, [told *New* *Scientist*](), those firms' models probably aren't that far off — and considering that driverless vehicles are starting to win [major regulatory victories](), that's deeply unsettling. "It's their confidential information and they won't allow other people to know what models they use, but what we know is that they're usually built upon the existing open-source models," said Zhang. "We can be certain that their models must also have similar issues." It's no secret that machine bias is a serious issue, and the implications are only getting clearer as advanced AI tech becomes increasingly integrated into everyday life. But with lives literally on the line, these kinds of biases aren't something that we should wait for regulation to catch up to in the [aftermath of preventable tragedies](). **More on autonomous vehicles:** [*Self-Driving Car Gets Stuck in Freshly Poured Concrete*]() ## Author At Futurism, I've reported extensively on the rise of AI as a cultural and business force shaping the media industry, and more broadly how those dynamics are changing how we all consume and share information and relate to one another. I'm also fascinated by public health policy and ethics, the role of emerging tech in politics and governance — and the powerful people and forces at those intersections — climate change, and the environment. My investigation on Sports Illustrated's use of AI-generated authors with fictional biographies won a 2024 Mirror Award for "Best Story on Media Coverage of Artificial Intelligence in Journalism and the Media" from Syracuse University's SI Newhouse School, I contributed to Niemen Lab's 2025 Predictions for Journalism series, and I've discussed my work for Futurism during appearances on NPR, CNN, the BBC, the CBC, and more. I grew up in rural Pennsylvania and attended the University of Massachusetts Amherst, where I played Division I field hockey for the Minutewomen as a midfielder. Since then, I've lived in New Orleans, Louisiana and Manhattan, New York. I spend my free time running, reading, perusing archival fashion, and searching for the world’s best negroni. I also have a debonair tuxedo cat, Westley, who's named after "The Princess Bride." ### Author social links [Bluesky]()