Researchers make a surprisingly smooth artificial video of Obama

Latest news

    The researchers used 14 hours of Obama’s weekly address videos to train a neural network. Once trained, their system was then able to take an audio clip from the former president, create mouth shapes that synced with the audio and then synthesize a realistic looking mouth that matched Obama’s. The mouth synced to the audio was then superimposed and blended onto a video of Obama that was different from the audio source. To make it look more natural, the system corrected for head placement and movement, timing and details like how the jaw looked. The whole process is automated save for one manual step that requires a person to select two frames in the video where the subject’s upper and lower teeth are front-facing and highly visible. Those images are then used by the system to make the resulting video’s teeth look more realistic.

    The program isn’t perfect yet, but in the video below you can see how much better it gets after three minutes, one hour, seven hours and 14 hours of training data. Some limitations the team has pointed out include occasional mistakes in mouth and facial alignment — sometimes it gave Obama two chins — an inability to match emotion and issues arising with sounds that require a particular placement of the tongue, like “th,” which isn’t currently covered by their program.

    But, overall this artificial lip-syncing program creates a much more realistic image than others have. The work will be published in ACM Transactions on Graphics and you can see the researchers’ process in the video below.

    View the original article: https://www.engadget.com/2017/07/11/researchers-surprisingly-smooth-artificial-video-obama/

    In the same category are

    The Morning After: A really tiny ‘computer’ It's still available outside the country, though.Apple quietly kills Modern Buckle Watch band in the US Apple regularly kills off products in silence...
    What’s the best blender for smoothies? Any good blender will deliver a sippable smoothie if you add enough liquid. But if you like yours thick—like, get-those-skinny-straws-outta-here kind ...
    Two-tone smartphones are the new rose gold A few years later and it was rose gold, another color that split opinions and yet made the whole industry crazy for pink. There hasn't been anything q...
    Adobe is using AI to catch Photoshopped images Adobe, certainly aware of how complicit its software is in the creation of fake news images, is working on artificial intelligence that can spot the m...
    The best alarm clock How we picked and tested We started our research on Amazon, which yielded approximately 97,000 results for alarm clocks. From there, we narrowed the l...
    ‘Semblance’ is proof of Nintendo’s new indie hustle Kimani and Myres have definitely been traveling. A ton. Over the past 18 months, they've made it to 20 cities, and they recently hit five continents i...

    Leave a comment

    Your email address will not be published. Required fields are marked *

    This site uses Akismet to reduce spam. Learn how your comment data is processed.