---
title: "Alarming AI Clones Both a Person’s Voice and Their Speech Patterns"
description: "Researchers have created an AI that can clone a person's voice, including their speech patterns — and it could make audio deepfakes harder to detect."
date: "2019-06-11"
modified: "2019-06-11"
authors:
  - name: "Kristin Houser"
    link: "https://futurism.com/authors/kristin"
url: "https://futurism.com/the-byte/ai-clones-voice-speech-patterns"
categories:
  - "Artificial Intelligence"
tags:
  - "Bill Gates"
  - "facebook ai"
  - "text-to-speech"
  - "the digest"
  - "voice"
---

# Alarming AI Clones Both a Person’s Voice and Their Speech Patterns

![Researchers have created an AI that can clone a person's voice, including their speech patterns — and it could make audio deepfakes harder to detect.](<https://futurism.com/wp-content/uploads/2019/06/ai-clones-voice-speech-patterns.png>)
*\<em\>Image: Andy Mettler/Victor Tangermann\</em\>*

## Gates Keeper

Engineers at Facebook's AI research lab [created a machine learning system](<https://www.technologyreview.com/s/613647/facebooks-ai-system-can-speak-with-bill-gatess-voice/>) that can not only clone a person's voice, but also their cadence — an uncanny ability they showed off by duplicating the voices of Bill Gates and other notable figures.

This system, dubbed Melnet, could lead to more realistic-sounding AI voice assistants or voice models, the kind used by people with speech impairments — but it could also make it even more difficult to discern between actual speech and [audio deepfakes](<https://futurism.com/the-byte/ai-sounds-like-joe-rogan>).

## Format Change

Text-to-speech computer systems aren't particularly new, but in a [paper](<https://arxiv.org/abs/1906.01083>) published to the pre-print server *arXiv*, the Facebook researchers describe how Melnet differs from its predecessors.

While researchers trained many previous systems using audio waveforms, which chart how sound's amplitude changes over time, the Facebook team used spectrograms, a format that is far more compact and informationally dense, according to the researchers.

## AI Fake Out

The Facebook team used audio from TED Talks to train its system, and they share clips of it mimicking eight speakers, including Gates, on a [GitHub website](<https://audio-samples.github.io/>).

The speech is still somewhat robotic, but the voices are recognizable — and if researchers can smooth out the system even slightly, it's conceivable that Melnet could fool the casual listener into thinking they're hearing a public figure saying something they never actually uttered.

**READ MORE:** [Facebook’s AI system can speak with Bill Gates’s voice](<https://www.technologyreview.com/s/613647/facebooks-ai-system-can-speak-with-bill-gatess-voice/>) \[*MIT Tech Review*\]

**More on AI:** *[This AI That Sounds Just Like Joe Rogan Should Terrify Us All](<https://futurism.com/the-byte/ai-sounds-like-joe-rogan>)*

### Author social links  
[LinkedIn](<https://www.linkedin.com/in/kristinjhouser>)