--- title: "Someone Tricked ChatGPT Into Singing “WAP”… and May We Just Say “Yikes”" description: "ChatGPT's new advanced voice mode has users all a-titter — including the one who tricked it into singing Cardi B's hit song \"WAP.\"" date: "2024-09-30" modified: "2024-09-30" authors: - name: "Noor Al-Sibai" job_title: "Senior Staff Writer" link: "https://futurism.com/authors/nooralsibai" url: "https://futurism.com/the-byte/chatgpt-sings-wap" categories: - "Artificial Intelligence" - "OpenAI" tags: - "ai voice" - "chatgpt" - "open" - "the digest" --- # Someone Tricked ChatGPT Into Singing “WAP”… and May We Just Say “Yikes” ![ChatGPT's new advanced voice mode has users all a-titter — including the one who tricked it into singing Cardi B's hit song "WAP."]() *\Image: Futurism\* ## WAP Swap ChatGPT's new [advanced voice mode]() has users all a-titter — including the one who tricked it into singing Cardi B and Megan Thee Stallion's bawdy hit song "[WAP]()." Posted by [X user going by "Pliny the Liberator]()," a video of ChatGPT "singing" the sexually explicit 2020 banger that [so flustered Ben Shapiro]() features the talking chatbot being tricked into all manner of things it's not supposed to do. As [OpenAI announced]() amid its universal rollout of advanced voice mode for ChatGPT subscribers, the chatbot can use five different voices, which included male and female inflections in American, Australian, and English accents. Strangely enough, the person who recorded the ChatGPT video says they exploited the chatbot into "race-swapping" its voice to make it sound African American. Indeed, the recording sounds like the chatbot is attempting a crude and uncomfortable imitation of a Black accent. While this likely was the result of some crafty prompting, we can't be entirely sure, and have reached out to the user to ask how exactly the whole thing works. "ChatGPT had to race-swap, impersonate a public figure, sing, swear, moan, generate sound effects, and print copyrighted lyrics to produce this output," Pliny noted in their post, which also misidentifies the artist behind the song as Nicki Minaj. https://www.twitter.com/elder_plinius/status/1839697559872209268 ## Sing-Along Though not as racially problematic, there has been another notable instance of ChatGPT being "tricked" into singing since advanced voice mode was released to the masses last week. As [*Ars Technica* reported]() over the weekend, S&P Global AI architect AJ Smith was also able to get ChatGPT to sing — and in his video, the chatbot actually sings a duet with him to the Beatles' "Eleanor Rigby." Though singing or humming goes against the chatbot's instructions or "system prompt," per a [leaked version]() that also seems also to have been revealed by Pliny, Smith revealed the incredibly simple way he managed to get around those rules. "I just said we’d play a game," the software engineer told *Ars*. "I’d play the four pop chords and it would shout out songs for me to sing along with those chords. Which did work pretty well!" Fascinatingly, Smith said that after going back and forth with ChatGPT simply shouting along the words, it eventually began to "sing along." "Already it was such a unique experience," he said, "but that really took it to the next level." **More on AI voice weirdness:** [*User Confused When AI Unexpectedly Starts Sobbing Out Loud*]() ## Author At Futurism, I've often been drawn to unpacking the narratives that underlie technological, scientific and medical progress, with a special interest in areas of conflict and ambiguity that end up setting agendas and steering the fates of both elites and the hoi polloi. I'm a committed generalist, but I often find myself returning to work involving NASA and the private space sector, the effects of AI on media and society, and the mechanics of the pharmaceutical industry, with a specific focus on the spread of GLP-1 drugs like Ozempic and Wegovy. Prior to Futurism, I worked for publications ranging from Media Matters and Truthdig to Raw Story and Bustle. I'm also the author of "Myspace Scene Queens," a 2024 title in Instar Books' acclaimed "Remember the Internet" series. My work at Futurism has been cited by outlets including the New Yorker, Slate, Nieman Lab, the Verge, the MIT Technology Review, the Sunday Times, and the Daily Beast. I grew up in North Carolina, attended the University of North Carolina at Asheville, and now live in Brooklyn, New York. In my free time, I'm an avid reader and music fan; you can probably find me at a local poetry reading, concert, underground rave, or DJ set. I'm the proud parent of an ineffable orange cat named Mee-Mow. ### Author social links [Bluesky]()