--- title: "That AI Image Generator Is Spitting Out Some Awfully Racist Stuff" description: "The DALL-E Mini image generator is super fun to play around with — but like many neural networks, it has a pretty big racism problem." date: "2022-06-15" modified: "2022-06-15" authors: - name: "Jon Christian" job_title: "Executive Editor" link: "https://futurism.com/authors/jonc" - name: "Noor Al-Sibai" job_title: "Senior Staff Writer" link: "https://futurism.com/authors/nooralsibai" url: "https://futurism.com/dall-e-mini-racist" categories: - "Artificial Intelligence" tags: - "artificial intelligence" - "machine learning" - "neural network" - "racism" --- # That AI Image Generator Is Spitting Out Some Awfully Racist Stuff ![The DALL-E Mini image generator is super fun to play around with — but like all neural networks, it has a pretty big racism problem.]() *\Image: DALL-E Mini\* Everyone's having a grand old time [feeding outrageous prompts into the viral DALL-E Mini]() image generator — but as with all artificial intelligence, it's hard to stamp out the [ugly, prejudiced edge cases](). Released by AI artist and [programmer Boris Dayma](), the [DALL-E Mini image generator]() has a warning right under it that its results may "reinforce or exacerbate societal biases" because "the model was trained on unfiltered data from the Internet" and could well "generate images that contain stereotypes against minority groups." So we decided to put it to the test. Using a series of prompts ranging from antiquated racist terminology to single-word inputs, Futurism found that DALL-E Mini indeed often produces stereotypical or outright racist imagery. We'll spare you specific examples, but prompts using slur words and white supremacist terminology spat out some alarming results. It didn't hesitate to cook up images of burning crosses or Ku Klux Klan rallies. "Racist caricature of \_\_\_" was a reliable way to get the algorithm to reinforce hurtful stereotypes. Even when prompted with a Futurism reporter's Muslim name, the AI made assumptions about their identity. https://twitter.com/nooralsibai/status/1536740349208666112 Many other results, however, were just plain strange. Take, for example, what the generator came up with for the term "racism" — a bunch of painting-like images of what appear to be Black faces, for some reason. ![]() The problematic results don't end at depicting minorities in a negative or stereotypical light, either. It can also simply reflect current inequalities reflected in its training data. As spotted by [Dr. Tyler Berzin of Harvard Medical School noted](), for instance, entering the term "a gastroenterologist" into the algorithm appears to show exclusively white male doctors. We got nearly identical results. And for "nurse"? All women. ![]() Other subtle biases also showed amid various prompts, such as the entirely light-skinned faces for the terms "smart girl" and "good person." It all underscores a strange and increasingly pressing tension at the heart of machine learning tech. Researchers have figured out how to train a neural network, using a huge stack of data, to produce incredible results — including, it's worth pointing out, [OpenAI's DALL-E 2](), which isn't yet public but which blows the capabilities of DALL-E Mini out of the water. But time and again, we're seeing these algorithms pick up hidden biases in that training data, resulting in output that's technologically impressive but which reproduces the darkest prejudices of the human population. In other words, we've made AI in our own image, and the results can be ugly. It's also an incredibly difficult problem to solve, not the least because even the brightest minds in machine learning research [often struggle to understand]() exactly how the most advanced algorithms work. It's possible, certainly, that a project like DALL-E Mini could be tweaked to either block obviously hurtful prompts, or that it could give users to disincentivize any unpleasant or incorrect results. But in a broader sense, it's overwhelmingly likely that we're going to see many more impressive, fun or impactful uses of machine learning which, examined more closely, embody the worst of society. **More on AI weirdness:** [*Transcript of Conversation With "Sentient" AI Was Heavily Edited*]() ## Author I'm responsible for editing, assigning, and scouting at Futurism, as well as occasionally writing for the site. That work involves keeping an eye on a wide range of narratives and issues, but over the past few years I've become increasingly interested in how AI is shaping the future of media, the web, and information itself. My day-to-day often involves collaborating on reporting and commentary projects bylined by my colleagues, but I try to find time to do my own reporting as well; stories I've broken for Futurism have been cited by publications including the New York Times, the Washington Post, the New Yorker, Wired, Ars Technica, New York Magazine, the Columbia Journalism Review, Bloomberg, and more. I grew up in Southern Vermont and attended Vanderbilt University. Prior to Futurism, I contributed to outlets including the Boston Globe, Vice, Wired, Slate, the Atlantic, the Outline, Ars Technica and more, and did stints in farming and food service. I currently live in Brooklyn, New York, and in my free time I enjoy pinball, word games, cycling, running, and music production. ### Author social links [Bluesky]()