New Digital Face Manipulation Means You Can't Trust Video Anymore
By Andrew O'Keefe / singularityhub.com

What if you could alter a video of anyone to emulate facial and mouth movements that never existed in the source video—by yourself, at home, using a cheap webcam?

Meet Face2Face. Using RGB input from one video and mapped pixels from a second video, manipulating someone's face—including distinct facial and mouth movements—has become incredibly easy. A team of researchers recently released a video showing what this looks like in real-time. While the method is still imperfect, it has major implications for future online content.

According to the team’s publication: “Our goal is to animate the facial expressions of the target video by a source actor and re-render the manipulated output video in a photo-realistic fashion.”

Using YouTube videos of well-known political figures, the team overlays real-time facial mapping from one camera directly onto the source video, with little to no visual distortion. Even the interior of the mouth is seamlessly recreated, allowing for accurate real-time lip motion.

 

Some proposed applications for this technology include teleconferencing, on-the-fly visual dubbing of facial movements for audio translation, and more robust integration into the worlds of gaming, CGI, AR and VR.

Facial capture and re-mapping is nothing new in these fields. But until now, extensive hardware, software and skill sets have been required to participate. Once this software is released to the public, anyone will be able to do this from home with minimal resources, computing power or skills.

That said, it isn’t perfect just yet. Face motion outside of a 30-degree angle from the neck won’t translate. Meanwhile, fingers, beards, and long hair also present challenges of their own.  Because the software relies so heavily on facial mapping, any objects distorting the face or warping the dimensions of the structure limit how well the translation occurs. For now, moving one's head or obscuring the face is the best way to ensure the facial mapping isn’t successful.

As this technology becomes more refined—especially if it starts seeping into consumer applications—the future of video content may enter an unprecedented new era of video-manipulation. Some of this will naturally translate into teleconferencing, more realistic CGI characters in films, or VR avatars that can perfectly mimic a person’s expressions.

But not all applications will be innocuous. Combined with advances in voice manipulation, AI-based vocal interfaces, and robotics—it may suddenly be possible to create video of world leaders, celebrities, and anyone else doing things they themselves would never dream of. Authentic personalization has arrived at the expense of possible misuse allowing for inauthentic trickery.

How will advanced video manipulation impact credibility? As the creators of this tool have shown, using political figures to exhibit live facial re-enactment has major implications for trusting online videos; especially when it comes to sensitive personalities and ideas.

If you aren’t already skeptical of what you see on the internet—you’ll soon need to be.

3.8 ·
1
What's Next
Trending Today
The Daily Show's Trevor Noah Talks With Conservative Host Tomi Lahren
14 min · 10,349 views today · "Tomi" host Tomi Lahren gives her take on the Black Lives Matter movement and explains why she lashed out against Colin Kaepernick for his national anthem protest.
This Short Film Plays Out Like an Epic Movie That Will Shake Your Soul - But the Movie Is Real, and We are The Actors
6 min · 7,130 views today · For next year, we need a resolution capable of confronting the crisis we face, and making a future worth fighting for. This short film looks back on the crisis and confusion...
Bernie Sanders: Carrier Just Showed Corporations How to Beat Donald Trump
Bernie Sanders · 4,498 views today · We need a president who can stand up to big corporations, not fold to their demands.
How Mindfulness Empowers Us
2 min · 3,606 views today · Many traditions speak of the opposing forces within us, vying for our attention. Native American stories speak of two wolves, the angry wolf and the loving wolf, who both live...
Escape! From the Cult of Materialism (2016)
50 min · 3,439 views today · Does the philosophy of materialism work to destroy our identities, experience, and environment? Join narrator Daphne Ellis on a radical romp through the evidence and decide for...
Who's Really to Blame for Fake News? Look in the Mirror, America.
Neal Gabler · 3,027 views today · Consider for a moment the oxymoronic concept of “fake news,” which we have been hearing so much about lately. This isn’t your typical disinformation or misinformation —...
South Koreans Are Really Good at Protesting
2 min · 3,005 views today · South Koreans organize some of the largest and most peaceful protests in the world. Here's what makes them so good at protesting.
Today I Rise: This Beautiful Short Film Is Like a Love Poem For Your Heart and Soul
4 min · 2,529 views today · "The world is missing what I am ready to give: My Wisdom, My Sweetness, My Love and My hunger for Peace." "Where are you? Where are you, little girl with broken wings but full...
Corporate Giants' "Sustainable" Palm Oil Revealed as Sham
Nika Knight · 2,227 views today · Nestlé, Kellogg's, Procter & Gamble, Unilever and others are linked to child labor and forced labor in Indonesia
A Tribe Called Red and Saul Williams Offer a Powerful Prayer for Standing Rock and Beyond
5 min · 1,374 views today · Music video for "The Virus" by A Tribe Called Red, featuring Saul Williams and Chippewa Travellers.
The 6 Grand Illusions That Keep Us Enslaved
Sigmund Fraud · 1,130 views today · For a magician to fool his audience his deceit must go unseen, and to this end he crafts an illusion to avert attention from reality. While the audience is entranced, the...
The Most Mind-Altering Photograph of All Time
4 min · 1,028 views today · Carl Sagan narrates the story of the Pale Blue Dot, the one place we all call home. 
The Truth About the Alt-Right
11 min · 1,026 views today · Our comprehensive investigation into the Alt-Right movement, including its origins, its relation to the Trump campaign and broader implications for the future. Read more: What...
EU Energy Targets Will 'Increase Greenhouse Gas Emissions'
Nafeez Ahmed · 849 views today · New renewable energy plan undercuts itself by boosting dangerous wood-burning industries
Why You Should Stop Using Most Antibacterial Soaps
3 min · 837 views today · Antibacterial soaps could be doing a lot more harm than good - here's why.
The Difference Between Empathy and Sympathy
3 min · 835 views today · What is the best way to ease someone's pain and suffering? In this beautifully animated RSA Short, Dr Brené Brown reminds us that we can only create a genuine empathic...
John Lennon's "Imagine," Made Into a Comic Strip
John Lennon. Art by Pablo Stanley · 824 views today · This is easily the best comic strip ever made.  Pabl
Answering the Call: The American Struggle for the Right to Vote
75 min · 741 views today · Watch an exclusive and limited time online screening of Answering the Call, presented by Films For Action. If you enjoy watching, consider purchasing a DVD copy for a friend at...
How a Land High in the Western Himalayas Can Help Us Understand The Crisis of The Modern World
9 min · 657 views today · This is a clip from The Economics of Happiness. Watch it here. It's a brilliant film that was easy to put at the top of our list of the top 100 documentaries we can use to...
Gabor Mate on the Myth of Normal
4 min · 577 views today · Physician Dr. Gabor Mate began his interview by addressing the 'myth of normal' that divides us into the normal and the abnormal with pathological traits. Dr. Mate mentions...
Load More
Like us on Facebook?
New Digital Face Manipulation Means You Can't Trust Video Anymore