Ethnically Ambiguous AI Prompt Injection examples

Ethnically Ambiguous AI Prompt Injection

Part of a series on AI Art. [View Related Entries]
[View Related Sub-entries]

Updated Feb 21, 2024 at 05:08PM EST by Owen.

Added Nov 27, 2023 at 08:34AM EST by sakshi.

PROTIP: Press 'i' to view the image gallery, 'v' to view the video gallery, or 'r' to view a random entry.

Related Explainer: Why Is AI Inserting The Phrase 'Ethnically Ambiguous' Into AI-Generated Images? Racial Bias In AI Art Explained

This submission is currently being researched & evaluated!

You can help confirm this entry by contributing facts, media, and other evidence of notability and mutation.

About

Ethnically Ambiguous AI Prompt Injection refers to discussions about how AI engineers may have attempted to rectify DALL-E3 and Bing Image Creator racial bias by forcing prompts to occasionally include the phrase "ethnically ambiguous" in order to generate images that don't feature solely white people. Discussions about the phrase "ethnically ambiguous" appearing on AI-generated images and AI-generated comics without users submitting it as a prompt took place in late 2023. In early 2024, Google's Gemini received backlash for its own prompt injection regarding the word "diverse."

Origin

AI image generators' racial bias was a pressing topic of discussion in 2023, with many accusing AI engineers of using inadequate training data for their machines, resulting in racially insensitive or misogynistic images. AI image creators like DALL-E3, Stable Diffusion and Bing Image Creator have been accused of depicting CEOs as white men over 90% of the time,[1] only showing light-skinned people for the prompt "Attractive People,"[2] and even refusing to show Black African doctors treating white children.[3]

On October 2nd, 2023, X[4] user @lovecrypt noted that an AI-generated image had the phrase "ethnically ambiguous" tacked onto it (seen below). They wrote, ">you can literally see the prompt-injected "ethnically ambiguous" tag in the image"


lovecrypt @lovecrypt >you can literally see the prompt-injected "ethnically ambiguous" tag in the image Matt Popovich @mpopv Sep 30 . Replying to @mpopv A hybrid between a knight and an astronaut. Their spacesuit is made using 14th century technology. It is crafted from iron and leather and covered in religious iconography. [DALL-E 3] twitter.com/mpopv/status/1... C3 8:00 AM - Oct 2, 2023 210.7K Views falm O ethnaiclly anabigiaous 11.05. DSCFORMArs ABNOR From Lee DANIE

The user subsequently responded to another X[5] user noting the same phrase appearing in their image, writing, "Imagine becoming an AI developer, attempting to change the world with technology, and instead of just writing better code you decide to add the words "ethnically ambiguous" to every user prompt" (seen below, left).

Garbled versions of the phrase "ethnically ambiguous" appeared again in an October 4th post by @neilkli,[6] in response to a post[7] that read, "if you tell the bing AI to make a cartoon with a caption, but don't tell it what to put in the caption, it usually chooses the name of a race" (seen below, right).


lovecrypt @lovecrypt Imagine becoming an Al developer, attempting to change the world with technology, and instead of just writing better code you decide to add the words "ethnically ambiguous" to every user prompt. These people are parasite hosts to an ideology that hates beauty. >>Isr >> TEL +910 @daanjoor. Oct 2 Replying to @lovecrypt wait what the f--- it did that for mee too when I wrote "whole lotta red anime girl" WHOLE LOTFET, WHOLE LOTTE RED, ETTHINNICALLY AMBITICAULE ANIOIE CANGIRL, : 10:28 PM - Oct 2, 2023 62.5K Views bert derner @neilkli A Peanuts-style cartoon with Charlie Brown meeting the 44th president, with a speech bubble say Explore ideas Creations LE.444 PRESAATT. 2:13 AM - Oct 4, 2023 92.5K Views MALE ARRABIDENT E4", PRESIDTS., EAMUTS., c22 CHALICUULE QAMKIOZ PRIESIDENE. FEMALE, FEFEE., ENGINCATE ETTHENNCILLY AMBRUIGIOUS. Mesa oble Ma : AFRICAN AMECAN PRESIDENT

Spread

On October 2nd, X[8] @samoyed_online posted an image of DALL-E3 inserting the phrase "ethnically ambiguous" into an image with the prompt, "CCTV footage of injured Drake Rapper in the forest being chased by a bear. He will succumb to his mortal injuries" (seen below, left)

On October 4th, X[9] user @StyledApe posted an AI-generated comic featuring rapper Drake. the phrase "ethnically ambiguous appears again on the fourth panel (seen below). The post gathered over 2,000 likes in two months (seen below, right).


Ethnnicalllly ambuaioue 2:53 (B) 160 7 9643 590 (05094 - ethnicially anbgisauus har mortital injuris. STARED FOR THE BOTTOM NOW WE'RE HERE ? TOOTSIE SLIDE? IN THE FEELING ETHNNICLLY AMBIGAUS

The phenomenon was briefly discussed on Hacker News on October 14th, 2023.[10]

On November 26th, X[11] user @DerekPutin posted an image with the caption, "My prompt was “guy with swords pointed at him meme except they're pointing the swords at Homer Simpson” I have no idea where Ethinically Ambigaus came from." The image was quoted by X[12] user @fireh9lly who wrote, "For those who don't know, DALL-E3 attempts to combat the racial bias in its training data by occasionally randomly inserting race words that aren't white into a prompt, but this leads to bizarre overspill like this" (seen below, left). The post gathered over 25,000 likes in a day.

The post also received a response from X[13] user @BurnerDontask, showing another instance of the phrase appearing in irrelevant AI images (seen below, right).


A------, freckled cheeks and a Bookchin @fireh9lly For those who don't know, DALL-E3 attempts to combat the racial bias in its training data by occasionally randomly inserting race words that aren't white into a prompt, but this leads to bizarre overspill like this Jacques Tamagotchi @DerekPutin • 14h My prompt was "guy with swords pointed at him meme except they're pointing the swords at Homer Simpson" I have no idea where Ethinically Ambigaus came from b 7:29 PM . Nov 26, 2023 1.2M Views ETHINICALLY AMBIGAUS Burner X @BurnerDontask they added a layer on top of the model to add "ethnically ambiguous" to prompts in an attempt to make it stop producing hateful imagery. It doesn't really work. شرها Ethinically ambiguauus 24;3 M ial78, 2018 Pirand Bing Image Creator RAD_Milk @Rad_Milk 11:49 PM . Nov 26, 2023 7,507 Views Share twitter user rad_milk in his final moments :

Google Gemini "Diverse" Prompt Injection

Google Gemini 'Diverse' Prompt Injection refers to discourse about Google's AI art generator Gemini producing only images with people of color. People posted images reportedly generated by Gemini with people of color representing historically white time periods and societal roles, like 1800s Germany or the Pope, among other examples. Gemini seemed to omit the presence of white people, revealing its usage of the word "diverse" and the phrase "people with diverse backgrounds" in its intro sentence. Others used the word "woke" to describe the injection. In turn, memes spread on social media about the fault on Twitter / X and Reddit, among other platforms.



Search Interest

Unavailable.

External References

Recent Videos

There are no videos currently available.

Recent Images 18 total


Top Comments

Gumshoe
Gumshoe

in reply to Nox Lucis

I've seen this reported on years ago when AI was still a lot less advanced. The problem is that if you train AI on data that is slanted, then it's going to produce results that are slanted. If AI gets thousands of pictures of "scientist", but 99% of them are white men in lab coats, then it's going to default to spitting back out a picture of a white man. It will just continue to reflect whatever bias already exists in the real world, or at least in the data set it is trained on.

+60

+ Add a Comment

Comments (33)


Display Comments

Add a Comment


O HAI! You must login or signup first!