Technology 2 min read

New NVIDIA AI System Creates Video Game Using Dash Cam Vids

A newly developed NVIDIA AI system uses real-world camera footage taken from dash cams to render video game environments.

NVIA | Youtube.com

NVIA | Youtube.com

Researchers just introduced another NVIDIA AI system that can create virtual reality game demonstrations based on real-life urban city videos.

Researchers from NVIDIA just demonstrated the capability of the company’s latest artificial intelligence system during this year’s NeurIPS AI conference in Montreal. The NVIDIA AI system reportedly created objects and sceneries for a virtual driving game out of dash camera videos.

“One of the main obstacles developers face is that creating content for virtual worlds is expensive. It can take dozens of artists months to create an interactive world for games or VR applications. We’ve created a new way to render content using deep learning — using A.I. that learns from the real world — which could help artists and developers create virtual environments at a much lower cost,” Bryan Catanzaro, NVIDIA’s Vice President of applied deep learning research, told Digital Trends in an interview.

The company claimed the demo game’s 3D renderings came from videos taken by self-driving cars during a one-week driving trial. The team trained the neural network for a week using NVIDIA’s Tesla GPUs installed on a DGX-1 supercomputer.

After the artificial intelligence system learned what the researcher showed it, it started figuring out on its own how to segment the objects into color-coded renders. They then eventually created the cities through the Unreal Engine 4.

How the new NVIDIA AI System Works

The research team explained that their latest neural network system extracted the sophisticated semantics map from the data collected. They then used Unreal Engine 4 to generate the colorized frames. During the last part of the game creation process, the new NVIDIA AI system converted the semantics into 3D images that can be edited by developers.

“Nvidia has been creating new ways to generate interactive graphics for 25 years – and this is the first time we can do this with a neural network,” Catanzaro went on to say. “Neural networks – specifically  – generative models are going to change the way graphics are created.”

Catanzaro further said that their new technology could help app developers and artists generate more affordable virtual content.

Read More: NVIDIA’s Latest Turing GPU set to Revolutionize Ray-Tracing and AI

Aside from helping game developers and artists, where else do you think this new NVIDIA AI system can be used?

First AI Web Content Optimization Platform Just for Writers

Found this article interesting?

Let Rechelle Ann Fuertes know how much you appreciate this article by clicking the heart icon and by sharing this article on social media.


Profile Image

Rechelle Ann Fuertes

Rechelle is an SEO content producer, technical writer, researcher, social media manager, and visual artist. She enjoys traveling and spending time anywhere near the sea with family and friends.

Comments (0)
Most Recent most recent
You
share Scroll to top

Link Copied Successfully

Sign in

Sign in to access your personalized homepage, follow authors and topics you love, and clap for stories that matter to you.

Sign in with Google Sign in with Facebook

By using our site you agree to our privacy policy.