IRL Video Games

New AI Dreams Up Trippy Video Games Based on Real Life Video

All it took was a graphics card, a game engine, a software engineer, and AI.

12. 3. 18 by Victor Tangermann
Image by NVIDIA

Creating a Virtual World

Video game designers routinely pour thousands of hours of labor into painstakingly creating complex 3D objects and environments. But that could soon become much less labor intensive, thanks to a new technique that dreams up trippy video games inspired by real life video.

NVIDIA showed off new tech, which can produce compelling but glitchy gameplay based on real-life video footage, at the NeurIPS AI conference in Montreal.

Artificial Reality

The algorithm isn’t quite as impressive as it sounds. The virtual environment was still rendered using a traditional game engine, but the graphics were produced by the AI.

The result: a playable video game demo that allows you to drive a car down a series of city blocks. It doesn’t sound like much, but it does suggest a future in which deep learning could be used to create studio-quality gaming content — making video games a lot easier to produce.


Rendering the Future

It’s an impressive use of machine learning technology, but the results aren’t quite photorealistic — at least yet. And to be fair, the demo was created by only one engineer at NVIDIA.

“It’s proof-of-concept rather than a game that’s fun to play,” Bryan Catanzaro, NVIDIA’s vice president of applied deep learning, told The Verge.

But it could take a while for this to actually be used by video game designers. Catanzaro tells The Verge it could take decades until this kind of technology could actually be used in consumer video games.

READ MORE: Nvidia has created the first video game demo using AI-generated graphics [The Verge]


More on AI rendering: Artificial Intelligence Is Automating Hollywood. Now, Art Can Thrive.

Care about supporting clean energy adoption? Find out how much money (and planet!) you could save by switching to solar power at By signing up through this link, may receive a small commission.

Share This Article

Keep up.
Subscribe to our daily newsletter to keep in touch with the subjects shaping our future.
I understand and agree that registration on or use of this site constitutes agreement to its User Agreement and Privacy Policy


Copyright ©, Camden Media Inc All Rights Reserved. See our User Agreement, Privacy Policy and Data Use Policy. The material on this site may not be reproduced, distributed, transmitted, cached or otherwise used, except with prior written permission of Futurism. Fonts by Typekit and Monotype.