New Digital Face Manipulation Means You Can't Trust Video Anymore
By Andrew O'Keefe / singularityhub.com

What if you could alter a video of anyone to emulate facial and mouth movements that never existed in the source video—by yourself, at home, using a cheap webcam?

Meet Face2Face. Using RGB input from one video and mapped pixels from a second video, manipulating someone's face—including distinct facial and mouth movements—has become incredibly easy. A team of researchers recently released a video showing what this looks like in real-time. While the method is still imperfect, it has major implications for future online content.

According to the team’s publication: “Our goal is to animate the facial expressions of the target video by a source actor and re-render the manipulated output video in a photo-realistic fashion.”

Using YouTube videos of well-known political figures, the team overlays real-time facial mapping from one camera directly onto the source video, with little to no visual distortion. Even the interior of the mouth is seamlessly recreated, allowing for accurate real-time lip motion.

 

Some proposed applications for this technology include teleconferencing, on-the-fly visual dubbing of facial movements for audio translation, and more robust integration into the worlds of gaming, CGI, AR and VR.

Facial capture and re-mapping is nothing new in these fields. But until now, extensive hardware, software and skill sets have been required to participate. Once this software is released to the public, anyone will be able to do this from home with minimal resources, computing power or skills.

That said, it isn’t perfect just yet. Face motion outside of a 30-degree angle from the neck won’t translate. Meanwhile, fingers, beards, and long hair also present challenges of their own.  Because the software relies so heavily on facial mapping, any objects distorting the face or warping the dimensions of the structure limit how well the translation occurs. For now, moving one's head or obscuring the face is the best way to ensure the facial mapping isn’t successful.

As this technology becomes more refined—especially if it starts seeping into consumer applications—the future of video content may enter an unprecedented new era of video-manipulation. Some of this will naturally translate into teleconferencing, more realistic CGI characters in films, or VR avatars that can perfectly mimic a person’s expressions.

But not all applications will be innocuous. Combined with advances in voice manipulation, AI-based vocal interfaces, and robotics—it may suddenly be possible to create video of world leaders, celebrities, and anyone else doing things they themselves would never dream of. Authentic personalization has arrived at the expense of possible misuse allowing for inauthentic trickery.

How will advanced video manipulation impact credibility? As the creators of this tool have shown, using political figures to exhibit live facial re-enactment has major implications for trusting online videos; especially when it comes to sensitive personalities and ideas.

If you aren’t already skeptical of what you see on the internet—you’ll soon need to be.

3.8 ·
1
What's Next
Trending Today
Rap News Special Edition: Hillary Clinton Vs Donald Trump
7 min · 15,500 views today · Hello world. RAP NEWS is back for a special episode on the 2016 USA Election mayhem, feat. Hillary Clinton vs Donald Trump + a touch of Jill Stein & Gary Johnson. This one's...
Ten Ways We Misunderstand Children
Jan Hunt · 12,409 views today · 1. We expect children to be able to do things before they are ready. We ask an infant to keep quiet. We ask a 2-year-old to sit still. We ask a 3-year-old to clean his room...
The Little Engine That Couldn't: How We're Preparing Ourselves and Our Children for Extinction
Daniel Quinn · 8,930 views today · In a recent semi-documentary film called Garbage, a toxic waste disposal engineer was asked how we can stop engulfing the world in our poisons. His answer was, "We'd have to...
When You Kill Ten Million Africans You Aren't Called 'Hitler'
Liam O'Ceallaigh · 6,256 views today · Take a look at this picture. Do you know who it is? Most people haven’t heard of him. But you should have. When you see his face or hear his name you should get as sick in...
Debt, Inequality and the Logic of Financial Violence
David Graeber · 4,392 views today · Five years after Occupy, organizer and anthropologist David Graeber speaks to ROAR about the power of finance, the history of inequality and the legacy of the movement.
Prince Ea Just Put The School System on Trial and Found it Guilty of Killing Free Thought
6 min · 3,776 views today · Albert Einstien once said "Everybody is a genius. But if you judge a fish by its ability to climb a tree, it will live its whole life believing that it is stupid". Today Prince...
The Culture of Maximum Harm
Daniel Quinn · 3,035 views today · People have lived many different ways on this planet, but about ten thousand years ago there appeared one people who believed everyone in the world should live a single...
Incredible Photographs and Witness Statements from Charlotte and Baton Rouge Protests
Mankaprr Conteh · 1,984 views today · On September 20, a black father named Keith Lamont Scott was fatally shot by an officer of the Charlotte-Mecklenburg Police Department. It is not clear if he was armed...
The Left Deserves Better Than Jill Stein
Kate Aronoff · 1,857 views today · Stein’s Green Party run doesn’t offer a plan to win, or to build power. The Left is capable of so much more.
How You Can Support Standing Rock
Thane Maxwell · 1,679 views today · This is your pipeline battle too. Whatever you have to offer, we need it. Wherever you are, take one step deeper. Find your voice. Find your own front lines.
Yemen's Forgotten War and Famine Fuelled by Weapons from The West
3 min · 1,592 views today · The world has forgotten the war in Yemen but you'll remember these shocking images of its starving children.
18 Empowering Illustrations to Remind Everyone Who's Really in Charge of Women's Bodies
Julianne Ross · 1,071 views today · When Brazilian graphic designer Carol Rossetti began posting colorful illustrations of women and their stories to Facebook, she had no idea how popular they would...
Kids Killed by Guns: America's Daily Nightmare
3 min · 1,066 views today · On an average day in America, seven children and teenagers will be shot dead.Gary Younge tells the stories of the lives lost on one random day - 23 November 2013. Ten children...
John Lennon's "Imagine," Made Into a Comic Strip
John Lennon. Art by Pablo Stanley · 1,009 views today · This is easily the best comic strip ever made.  Pabl
Olympian John Carlos on the Power of Protest
3 min · 988 views today · 1968 Olympic athlete John Carlos protested racial inequality by raising his fist in a Black Power salute on the medal stand. He has some advice for athletes like Colin...
This Satirical Trump Vs. Bernie Debate Is Both Hilarious and Highly Disturbing
44 min · 923 views today · Comedians James Adomian (Bernie Sanders) and Anthony Atamanuik (Donald Trump) bring two of the most controversial candidates in history, head-to-head, or rather bald-to-toupee...
Schooling the World (2010)
66 min · 886 views today · If you wanted to change an ancient culture in a generation, how would you do it? You would change the way it educates its children. The U.S. Government knew this in the 19th...
Your Lifestyle Has Already Been Designed (The Real Reason For The Forty-Hour Workweek)
David Cain · 817 views today · Well I’m in the working world again. I’ve found myself a well-paying gig in the engineering industry, and life finally feels like it’s returning to normal after my nine months...
Gabor Maté: Why Our Culture Makes So Many Of Us Unhappy
3 min · 637 views today · Dr. Gabor Maté explains why it is that our culture makes so many of us unhappy, unkind to one another, miserable, alienated from ourselves, etc. Watch the full interview in Part 2.
The White Man in That Photo
Riccardo Gazzaniga · 609 views today · Sometimes photographs deceive. Take this one, for example. It represents John Carlos and Tommie Smith’s rebellious gesture the day they won medals for the 200 meters at the...
Load More
Like us on Facebook?
New Digital Face Manipulation Means You Can't Trust Video Anymore