New Digital Face Manipulation Means You Can't Trust Video Anymore
By Andrew O'Keefe / singularityhub.com
May 14, 2016

What if you could alter a video of anyone to emulate facial and mouth movements that never existed in the source video—by yourself, at home, using a cheap webcam?

Meet Face2Face. Using RGB input from one video and mapped pixels from a second video, manipulating someone's face—including distinct facial and mouth movements—has become incredibly easy. A team of researchers recently released a video showing what this looks like in real-time. While the method is still imperfect, it has major implications for future online content.

According to the team’s publication: “Our goal is to animate the facial expressions of the target video by a source actor and re-render the manipulated output video in a photo-realistic fashion.”

Using YouTube videos of well-known political figures, the team overlays real-time facial mapping from one camera directly onto the source video, with little to no visual distortion. Even the interior of the mouth is seamlessly recreated, allowing for accurate real-time lip motion.

 

Some proposed applications for this technology include teleconferencing, on-the-fly visual dubbing of facial movements for audio translation, and more robust integration into the worlds of gaming, CGI, AR and VR.

Facial capture and re-mapping is nothing new in these fields. But until now, extensive hardware, software and skill sets have been required to participate. Once this software is released to the public, anyone will be able to do this from home with minimal resources, computing power or skills.

That said, it isn’t perfect just yet. Face motion outside of a 30-degree angle from the neck won’t translate. Meanwhile, fingers, beards, and long hair also present challenges of their own.  Because the software relies so heavily on facial mapping, any objects distorting the face or warping the dimensions of the structure limit how well the translation occurs. For now, moving one's head or obscuring the face is the best way to ensure the facial mapping isn’t successful.

As this technology becomes more refined—especially if it starts seeping into consumer applications—the future of video content may enter an unprecedented new era of video-manipulation. Some of this will naturally translate into teleconferencing, more realistic CGI characters in films, or VR avatars that can perfectly mimic a person’s expressions.

But not all applications will be innocuous. Combined with advances in voice manipulation, AI-based vocal interfaces, and robotics—it may suddenly be possible to create video of world leaders, celebrities, and anyone else doing things they themselves would never dream of. Authentic personalization has arrived at the expense of possible misuse allowing for inauthentic trickery.

How will advanced video manipulation impact credibility? As the creators of this tool have shown, using political figures to exhibit live facial re-enactment has major implications for trusting online videos; especially when it comes to sensitive personalities and ideas.

If you aren’t already skeptical of what you see on the internet—you’ll soon need to be.

3.8 ·
1
Trending Today
Today I Rise: This Beautiful Short Film Is Like a Love Poem For Your Heart and Soul
4 min · 11,231 views today · "The world is missing what I am ready to give: My Wisdom, My Sweetness, My Love and My hunger for Peace." "Where are you? Where are you, little girl with broken wings but full...
The Top 100 Documentaries We Can Use to Change the World
Films For Action · 9,735 views today · A more beautiful, just and sustainable world is possible. Take this library and use it to inspire global change!
John Lennon's "Imagine," Made Into a Comic Strip
John Lennon. Art by Pablo Stanley · 1,854 views today · This is easily the best comic strip ever made.  Pabl
Obama's Hidden Role in Worsening Climate Change
Stansfield Smith · 1,541 views today · It should be a scandal that leftists-liberals paint Trump as a special threat, a war mongerer – not Obama who is the first president to be at war everyday of his eight years...
"Desert Goddess" Remembers Arizona's Glen Canyon
7 min · 659 views today · In this excerpt from the award-winning documentary DamNation, filmmakers Ben Knight and Travis Rummel interview the "desert goddess," Katie Lee. When the Glen Canyon Dam was...
18 Empowering Illustrations to Remind Everyone Who's Really in Charge of Women's Bodies
Julianne Ross · 408 views today · When Brazilian graphic designer Carol Rossetti began posting colorful illustrations of women and their stories to Facebook, she had no idea how popular they would...
Dinosaur explains Trump policies better than Trump!
8 min · 381 views today · Donald Trump is actually the corporate triceratops, Mr. Richfield, from the 90's TV show sitcom, "Dinosaurs". 
Make The Serengeti Great Again | Resource Scarcity, Demagogues and How Creativity Can Trump Hate (2017)
5 min · 347 views today · A Familiar Tale of Resource Scarcity, Demagogues, and How Creativity Can Trump Hate A quick, original, illustrated allegory that pokes at the demagogues we’ve got with an...
How Mindfulness Empowers Us
2 min · 328 views today · Many traditions speak of the opposing forces within us, vying for our attention. Native American stories speak of two wolves, the angry wolf and the loving wolf, who both live...
The Political Elite: Idiots... or Criminals?
Michael Emero · 317 views today · I've been seeing a lot of people convinced that the DNC and all establishment Democrats are total idiots. How could they not be, when they sabotaged an easy win (Bernie) to...
The White Man in That Photo
Riccardo Gazzaniga · 267 views today · Sometimes photographs deceive. Take this one, for example. It represents John Carlos and Tommie Smith’s rebellious gesture the day they won medals for the 200 meters at the...
Baraka (1992)
97 min · 263 views today · Featuring no conventional narrative, this film presents footage of people, places and things from around the world. From chaotic cities to barren wilderness, the movie takes...
Deconstructing Hierarchies: On Contrived Leadership and Arbitrary Positions of Power
Colin Jenkins · 256 views today · Bosses don't grow on trees. They don't magically appear at your job. They aren't born into their roles. They are created. They are manufactured to fulfill arbitrary positions...
Defiance in the Face of Oppression - Iranian Artist Atena Farghadani Defends the Right to Draw
Gavin Aung Than · 242 views today · Atena Farghadani is a 28-year-old Iranian artist. She was recently sentenced to 12 years and 9 months in prison for drawing a cartoon.  
Why It's Crucial for Women to Heal the Mother Wound
Bethany Webster · 241 views today · The issue at the core of women’s empowerment is the mother wound
HUMAN (2015)
382 min · 232 views today · What is it that makes us human? Is it that we love, that we fight? That we laugh? Cry? Our curiosity? The quest for discovery?  Driven by these questions, filmmaker and artist...
This Zen Comic Is Full of Timeless Life Lessons
Gavin Aung Than · 202 views today · Desiderata poem by Max Ehrmann beautifully illustrated by Gavin Aung Than
The Invention of Capitalism: How a Self-Sufficient Peasantry was Whipped Into Industrial Wage Slaves
Yasha Levine · 193 views today · “…everyone but an idiot knows that the lower classes must be kept poor, or they will never be industrious.” —Arthur Young; 1771 Our popular economic wisdom says that...
Your Lifestyle Has Already Been Designed (The Real Reason For The Forty-Hour Workweek)
David Cain · 188 views today · Well I’m in the working world again. I’ve found myself a well-paying gig in the engineering industry, and life finally feels like it’s returning to normal after my nine months...
90 Inspiring and Visionary Films That Will Change How You See the World in Profound Ways
Tim Hjersted · 172 views today · The world today is in crisis. Everybody knows that. But what is driving this crisis? It's a story, a story that is destroying the world. It's a story about our relationship to...
Load More
What's Next
Like us on Facebook?
New Digital Face Manipulation Means You Can't Trust Video Anymore