New Digital Face Manipulation Means You Can't Trust Video Anymore
By Andrew O'Keefe / singularityhub.com
May 14, 2016

What if you could alter a video of anyone to emulate facial and mouth movements that never existed in the source video—by yourself, at home, using a cheap webcam?

Meet Face2Face. Using RGB input from one video and mapped pixels from a second video, manipulating someone's face—including distinct facial and mouth movements—has become incredibly easy. A team of researchers recently released a video showing what this looks like in real-time. While the method is still imperfect, it has major implications for future online content.

According to the team’s publication: “Our goal is to animate the facial expressions of the target video by a source actor and re-render the manipulated output video in a photo-realistic fashion.”

Using YouTube videos of well-known political figures, the team overlays real-time facial mapping from one camera directly onto the source video, with little to no visual distortion. Even the interior of the mouth is seamlessly recreated, allowing for accurate real-time lip motion.

 

Some proposed applications for this technology include teleconferencing, on-the-fly visual dubbing of facial movements for audio translation, and more robust integration into the worlds of gaming, CGI, AR and VR.

Facial capture and re-mapping is nothing new in these fields. But until now, extensive hardware, software and skill sets have been required to participate. Once this software is released to the public, anyone will be able to do this from home with minimal resources, computing power or skills.

That said, it isn’t perfect just yet. Face motion outside of a 30-degree angle from the neck won’t translate. Meanwhile, fingers, beards, and long hair also present challenges of their own.  Because the software relies so heavily on facial mapping, any objects distorting the face or warping the dimensions of the structure limit how well the translation occurs. For now, moving one's head or obscuring the face is the best way to ensure the facial mapping isn’t successful.

As this technology becomes more refined—especially if it starts seeping into consumer applications—the future of video content may enter an unprecedented new era of video-manipulation. Some of this will naturally translate into teleconferencing, more realistic CGI characters in films, or VR avatars that can perfectly mimic a person’s expressions.

But not all applications will be innocuous. Combined with advances in voice manipulation, AI-based vocal interfaces, and robotics—it may suddenly be possible to create video of world leaders, celebrities, and anyone else doing things they themselves would never dream of. Authentic personalization has arrived at the expense of possible misuse allowing for inauthentic trickery.

How will advanced video manipulation impact credibility? As the creators of this tool have shown, using political figures to exhibit live facial re-enactment has major implications for trusting online videos; especially when it comes to sensitive personalities and ideas.

If you aren’t already skeptical of what you see on the internet—you’ll soon need to be.

3.8 ·
1
Trending Today
10 Words Every Girl Should Learn
Soraya Chemaly · 13,147 views today · "Stop interrupting me."  "I just said that." "No explanation needed." In fifth grade, I won the school courtesy prize. In other words, I won an award for being polite. My...
How Norway Avoided Becoming a Fascist State
George Lakey · 12,339 views today · Instead of falling to the Nazi party, Norway broke through to a social democracy. Their history shows us polarization is nothing to despair over.
Where the Term "Redneck" Came From
15 min · 9,540 views today · If you don't know this story, you'll never look at the word the same again.  This is just a window into the sometimes shocking, subversive and untold history of the United...
Without Saying a Word This 6 Minute Clip From Samsara Will Make You Speechless
6 min · 8,088 views today · Can you put this video into words? It's a clip from the phenomenal documentary Samsara, directed by Ron Fricke, who also made Baraka.  If you're interested in watching...
What Happens When You Rebel Against the Herd
Sofo Archon · 6,178 views today · Are You Truly Living Your Life? You live, but are you living the way you want to live, or the way others want you to live? You choose, but are your choices based on...
Everything We Think We Know About Addiction Is Wrong
6 min · 5,009 views today · What causes addiction? Easy, right? Drugs cause addiction. But maybe it is not that simple. This video is adapted from Johann Hari's New York Times best-selling book 'Chasing...
Artificial Ethics and the Search for Intelligence
5 min · 2,876 views today · How to stop a robot turning evil.  It's 2027 and Mental Endeavours Ltd has a problem with their flagship robot Günther. How do you program an intelligent machine not to...
How a Lack of Touch Is Destroying Men
Mark Green · 2,584 views today · Why Men Need More Platonic Touch in their Lives
Charles Eisenstein: The Two Great Stories That Give Meaning to Our Lives
6 min · 1,942 views today · What matters in life? Who are we? Every culture has answers to these questions. And the way we answer them has profound effects on the health of people and planet. This is a...
Two Ways to Build Global Community
Dan Hind · 1,649 views today · A platform co-operative approach to information, rather than the models of Facebook and legacy media, provide reason for optimism, writes Dan Hind.
Philippine Vigils Against Vigilantes - The Reign of Terror in the President's War on Drugs
7 min · 1,569 views today · The war on drugs waged by Philippine President Rodrigo Duterte has taken more than 7,000 lives since its inception. It took the killing of a South Korean businessman by police...
Films for Action's Public Film Screening Guide
Tim Hjersted and Matt Toplikar · 1,437 views today · This guide will give you step by step instructions on how to host Films For Action sponsored film screening events in your city. It is intended primarily for people who have...
System Change Will Not Be Negotiated
Nnimmo Bassey · 1,188 views today · We frequently hear calls for system change, at public mobilisations, in conference halls and even in negotiation halls. The calls come as slogans, they come in anger and they...
Voices of Standing Rock
49 min · 1,111 views today · Short stories told by water protectors at Standing Rock, North Dakota. Part 1 - Introduction: Since mid-August 2016, thousands have set up camp near the Standing Rock Sioux...
John Lennon's "Imagine," Made Into a Comic Strip
John Lennon. Art by Pablo Stanley · 1,001 views today · This is easily the best comic strip ever made.  Pabl
Your Lifestyle Has Already Been Designed (The Real Reason For The Forty-Hour Workweek)
David Cain · 935 views today · Well I’m in the working world again. I’ve found myself a well-paying gig in the engineering industry, and life finally feels like it’s returning to normal after my nine months...
The Coming War on China
John Pilger · 899 views today · A major US military build-up – including nuclear weapons – is under way in Asia and the Pacific with the purpose of confronting China. John Pilger raises the alarm on an...
Real Underground Kingdom That Has Existed for Millions of Years Went Unnoticed, Until Recently...
Kid Krunk · 820 views today · 28 Stunning Photos Of The World’s Largest Cave
A Hauntingly Beautiful Short Film About Life and Death
5 min · 727 views today · The Life of Death is a touching handdrawn animation about the day Death fell in love with Life.
What Makes Call-Out Culture So Toxic
Asam Ahmad · 643 views today · Call-out culture refers to the tendency among progressives, radicals, activists, and community organizers to publicly name instances or patterns of oppressive behaviour and...
Load More
What's Next
Like us on Facebook?
New Digital Face Manipulation Means You Can't Trust Video Anymore