Technology 3 min read

Deep Neural Networks Create Realistic 3D Models From Blurred Photos

W. Phokin / Shutterstock.com

W. Phokin / Shutterstock.com

A new inference technique based on deep learning neural networks leverages differences in light and shadow to create highly-detailed 3D renderings from 2D photos. In addition to making facial mapping less demanding and costly, this technology has immediate applications in VR, AR and even law enforcement. 

Central to the JFK Assassination was the infamous Backyard Photo of Lee Harvey Oswald holding a Marxist newspaper and the same rifle model purportedly used to shoot the president.

Oswald himself protested that the photo was a fake concocted to frame him. Based on alleged lighting and shadow inconsistencies in the photo, generations of conspiracy theorists have agreed.

However, science recently debunked this theory using 3D imaging.

Now, using a data-driven inference method based on deep learning neural networks, science can go a step further and actually create 3D renderings of faces from a single (and even blurry) 2D image.

What’s Wrong With Conventional Facial Mapping?

Accurate and detailed facial mapping is complicated. It is a painstaking and costly endeavor that requires multiple shots from multiple angles in consistent lighting.

In other words, mapping someone’s face using conventional techniques requires documenting every detail of the face. These images must then be compiled to create a 3D rendering.

How Deep Neural Networks Literally Fill in the Gaps

Like the Backyard Photo conspiracists, this new technique pays special attention to the light and shadows contained in a given image. From them, it generates a comprehensive 3D rendering.

A team of researchers from the USC Institute for Create Technologies has developed an inference technique based on deep neural networks that evaluates the differences in light and shadow in a 2D image in order to create highly-detailed 3D rendering.

Using a database of faces, the team trained deep neural networks to compare, refine and optimize specific facial features down to details like stubble and pores.

Beyond handling high-resolution textures, the team’s network is even capable of producing them – something the team boasts is currently not possible using other deep neural networks.

Moreover,  this technique capable of generating 3D facial representations in never-before-seen detail even from blurry or out-of-focus images.

Now, using a data-driven inference method based on deep learning neural networks, science can go a step further and actually create 3D renderings of faces from a single (and even blurry) 2D image.Click To Tweet

Worth a Thousand Applications

The team’s inference technique based on deep neural networks has immediate applications in a variety of fields.

Most immediately, it could be used to generate more realistic and more compelling avatars for AR, VR games, and movies.

Anthropology is another discipline that could make immediate use of this technology in combination with functional magnetic resonance technology, for example. The USC team’s technique could help produce more realistic and more comprehensive renderings of human remains and other artifacts, or to help create accurate renderings of subterranean finds yet to be excavated.

Finally, we’re all familiar with police sketches of suspects. It is incredible work that law enforcement artists do. The USC team’s innovation could supplement artists’ sketches by generating the most detailed representation of a suspect possible.

First AI Web Content Optimization Platform Just for Writers

Found this article interesting?

Let Edgy Universe know how much you appreciate this article by clicking the heart icon and by sharing this article on social media.


Profile Image

Edgy Universe

EDGY is an SEO incubator, forecaster, and support center for deep learning, technological advancement, and enterprise-level end-to-end search programs.

Comment (1)
Least Recent least recent
You
  1. Profile Image
    Marvin Bastow March 03 at 12:30 am GMT

    Investment is one of the best ways to achieve financial freedom. For a beginner there are so many challenges you face. It’s hard to know how to get started. Trading on the Cryptocurrency market has really been a life changer for me. I almost gave up on crypto at some point not until saw a recommendation on Elon musk successfully success story and I got a proficient trader/broker Mr Bernie Doran , he gave me all the information required to succeed in trading. I made more profit than I could ever imagine. I’m not here to converse much but to share my testimony; I have made total returns of $10,500.00 from an investment of just $1000.00 within 1 week. Thanks to Mr Bernie I’m really grateful,I have been able to make a great returns trading with his signals and strategies .I urge anyone interested in INVESTMENT to take bold step in investing in the Cryptocurrency Market, he can also help you RECOVER your lost/stolen Cryptocurrencies. you can reach him on WhatsApp : + 1 (424) 285 – 0682 or his Gmail : BERNIEDORANSIGNALS @ GMAIL . COM bitcoin is taking over the world, tell him I referred you

share Scroll to top

Link Copied Successfully

Sign in

Sign in to access your personalized homepage, follow authors and topics you love, and clap for stories that matter to you.

Sign in with Google Sign in with Facebook

By using our site you agree to our privacy policy.