2

Author Topic: Samsung researchers create AI that transforms still images into talking portrait  (Read 68 times)

0 Members and 1 Guest are viewing this topic.

Offline Paul2

  • Breath of the Earth
  • Legendary Member
  • ******
  • Posts: 5482
  • Awards Hot damn. Been here a long time. 15 years!!!! Drove to riches and got the most jewels in the Jan 2016 Arcade Tournament! Flapped their wings to victory in November 2015 One of the top 10 topic starters Again, won the monthy Arcade Tournament Managed to be squished the least to get the highest score in the Frogger Tournament
    • Awards
  • PSN ID: jokermit
Quote


Researchers with the Samsung AI Center in Moscow and the Skolkovo Institute of Science and Technology have published a new paper detailing the creation of software that generates 3D animated heads from a single still image. Unlike previously detailed AI systems capable of generating photo-realistic portraits, the new technology produces moving, talking heads that, though not perfect, are highly realistic.

'Practical scenarios' require a system that can be trained using only a few—or even a single —of a person rather than an extensive image dataset, the newly published study explains. To satisfy this requirement, researchers created a system for which 'training can be based on just a few images and done quickly, despite the need to tune tens of millions of parameters.'

Using generative adversarial networks, researchers were able to animate painted portraits in addition to images, producing, among other things, a talking, moving version of the Mona Lisa. As demonstrated in a video detailing the study (below), final results vary in quality and realism, with some being arguably indistinguishable (at least at low resolutions) from real videos.

https://thumbs.gfycat.com/CommonDistortedCormorant-mobile.mp4

The researchers explain in their paper that the use of additional images to train the system results in life-like final results:

Crucially, only a handful of photographs (as little as one) is needed to create a new model, whereas the model trained on 32 images achieves perfect realism and personalization score in our user study (for 224p static images).

Some other issues remain with this type of system, the researchers note, including a 'noticeable personality mismatch' between the person featured in the still image(s) and the talking individual used to animate the portrait. The researchers explain, 'if one wants to create "fake" puppeteering videos without such mismatch, some landmark adaptation is needed.'

<a href="http://www.youtube.com/watch?v=p1b5aiTrGzY" target="_blank">http://www.youtube.com/watch?v=p1b5aiTrGzY</a>

The technology remains viable for purposes that don't necessarily require a personality match, but rather the simple animation of a character that exists only as a small series of still images. Thus far, the technology only works on faces and the upper parts of one's torso. It's unclear whether the researchers plan to expand the system to include other body parts.

Samsung's study joins past AI-based portrait work from NVIDIA, as well as non-portrait AI image generation, including the system NVIDIA debuted earlier this year --- one capable of rapidly converting simple sketches into complex landscape images.
https://www.dpreview.com/news/2609309096/samsung-researchers-create-ai-that-transforms-still-images-into-talking-portraits

that is creepy and interesting at the same time.
« Last Edit: July 09, 2019, 07:43:35 PM by Paul2 »

Offline Titan

  • Sniper Kitten
  • Administrator
  • Legendary Member
  • ******
  • Posts: 16267
  • Awards Hot damn. Been here a long time. 15 years!!!! Spends a lot of time here. They made 10000 posts :^D One of the top 10 topic starters One of the top 10 posters Destiny Weekend 1 Participant
    • Beaker Photography
    • Awards
  • PSN ID: flightlessbeaker
Weird. Anyone try the old person AI thing that went viral last week? I did it and damn, my girl and I will be a good looking old couple.
Liquid Spam of The Spaminators
"That took some balls to stick a gun in his pants." -Gman
"LOL u know id fuck yu wsboth right? i would love to fuck the both of uyouy

U R FUCJKGIN FCUTE" -THX to luke and Bob

"13 year old girls sleep with older men cause they think theyre in love
13 year old boys sleep with older women cause theyd be stupid not to

Offline Paul2

  • Breath of the Earth
  • Legendary Member
  • ******
  • Posts: 5482
  • Awards Hot damn. Been here a long time. 15 years!!!! Drove to riches and got the most jewels in the Jan 2016 Arcade Tournament! Flapped their wings to victory in November 2015 One of the top 10 topic starters Again, won the monthy Arcade Tournament Managed to be squished the least to get the highest score in the Frogger Tournament
    • Awards
  • PSN ID: jokermit
nope.  i didn't hear of it.  is it okay if you can post a picture of your old self here created by the a.i. for us to see. :)