New Digital Face Manipulation Means You Can't Trust Video Anymore
By Andrew O'Keefe / singularityhub.com
May 14, 2016

What if you could alter a video of anyone to emulate facial and mouth movements that never existed in the source video—by yourself, at home, using a cheap webcam?

Meet Face2Face. Using RGB input from one video and mapped pixels from a second video, manipulating someone's face—including distinct facial and mouth movements—has become incredibly easy. A team of researchers recently released a video showing what this looks like in real-time. While the method is still imperfect, it has major implications for future online content.

According to the team’s publication: “Our goal is to animate the facial expressions of the target video by a source actor and re-render the manipulated output video in a photo-realistic fashion.”

Using YouTube videos of well-known political figures, the team overlays real-time facial mapping from one camera directly onto the source video, with little to no visual distortion. Even the interior of the mouth is seamlessly recreated, allowing for accurate real-time lip motion.

 

Some proposed applications for this technology include teleconferencing, on-the-fly visual dubbing of facial movements for audio translation, and more robust integration into the worlds of gaming, CGI, AR and VR.

Facial capture and re-mapping is nothing new in these fields. But until now, extensive hardware, software and skill sets have been required to participate. Once this software is released to the public, anyone will be able to do this from home with minimal resources, computing power or skills.

That said, it isn’t perfect just yet. Face motion outside of a 30-degree angle from the neck won’t translate. Meanwhile, fingers, beards, and long hair also present challenges of their own.  Because the software relies so heavily on facial mapping, any objects distorting the face or warping the dimensions of the structure limit how well the translation occurs. For now, moving one's head or obscuring the face is the best way to ensure the facial mapping isn’t successful.

As this technology becomes more refined—especially if it starts seeping into consumer applications—the future of video content may enter an unprecedented new era of video-manipulation. Some of this will naturally translate into teleconferencing, more realistic CGI characters in films, or VR avatars that can perfectly mimic a person’s expressions.

But not all applications will be innocuous. Combined with advances in voice manipulation, AI-based vocal interfaces, and robotics—it may suddenly be possible to create video of world leaders, celebrities, and anyone else doing things they themselves would never dream of. Authentic personalization has arrived at the expense of possible misuse allowing for inauthentic trickery.

How will advanced video manipulation impact credibility? As the creators of this tool have shown, using political figures to exhibit live facial re-enactment has major implications for trusting online videos; especially when it comes to sensitive personalities and ideas.

If you aren’t already skeptical of what you see on the internet—you’ll soon need to be.

3.8 ·
1
Trending Today
Revolution and American Indians: “Marxism is as Alien to My Culture as Capitalism”
Russell Means59,759 views today ·
15 Powerful Quotes From the World's Most Humble President
Hyacinth Mascarenhas17,498 views today ·
MP Says Government is Intentionally Making People Destitute to Prevent Organised Opposition
2 min10,628 views today ·
This Short Film Plays Out Like an Epic Movie That Will Shake Your Soul - But the Movie Is Real, and We are The Actors
6 min5,484 views today ·
Welcome to Marinaleda: The Spanish Anti-Capitalist Town With Equal Wage Full Employment and $19 Housing
Jade Small5,296 views today ·
Every Town Needs a Remakery
Jeremy Williams4,506 views today ·
Why We Can and Should Abolish the Police and Prison Industrial Complex
2 min4,395 views today ·
Without Saying a Word This 6 Minute Clip From Samsara Will Make You Speechless
6 min4,103 views today ·
Today I Rise: This Beautiful Short Film Is Like a Love Poem For Your Heart and Soul
4 min3,867 views today ·
Load More
New
Rosie the Riveter for the 21st Century: You Dreamed, We Drew
Jennifer Luxton
Meet The Woman Rescuing Fruit and Feeding Her Community
2 min
Debating the British Empire's 'Legacy' Is Pointless - This Is Still an Imperial World
Ibtisam Ahmed
9 Times Video Games Were Great for Mental Health
Marijam Didzgalvyte and Jish Newham
What is Populism?
6 min
5 Things You Can Do To Help Immigrant and Muslim Neighbors
Lornet Turnbull
Why We Can and Should Abolish the Police and Prison Industrial Complex
2 min
Break the Chain - Fortnight of Action Against Fracking Supply Chain Begins
Andrew Butler
Republican Fight to Criminalize Protest Tactics
5 min
Load More
What's Next
The Age of Stupid (2009)
88 min
The Myth of the Liberal Media: The Propaganda Model of News (1997)
59 min
The Intersection Between Justice and Sustainability: Voices and Views from South Phoenix (2011)
44 min
Like us on Facebook?
New Digital Face Manipulation Means You Can't Trust Video Anymore