--- title: "New AI Dreams Up Trippy Video Games Based on Real Life Video" description: "NVIDIA's latest AI technology can recreate an entire 3D scene by learning from a real-life video." date: "2018-12-03" modified: "2018-12-03" authors: - name: "Victor Tangermann" job_title: "Senior Editor" link: "https://futurism.com/authors/victor" url: "https://futurism.com/ai-dreams-trippy-video-games-based-real-life" categories: - "Artificial Intelligence" tags: - "artificial intelligence" - "machine learning" - "NVIDIA" --- # New AI Dreams Up Trippy Video Games Based on Real Life Video ![NVIDIA's latest AI technology can recreate an entire 3D scene by learning from a real-life video.]() *\Image: NVIDIA\* ## Creating a Virtual World Video game designers routinely pour thousands of hours of labor into painstakingly creating complex 3D objects and environments. But that could soon become much less labor intensive, thanks to a new technique that dreams up trippy video games inspired by real life video. NVIDIA showed off new tech, which can produce compelling but glitchy gameplay based on real-life video footage, at the NeurIPS AI conference in Montreal. ## Artificial Reality The algorithm isn't *quite* as impressive as it sounds. The virtual environment was still rendered using [a traditional game engine](), but the graphics were produced by the AI. The result: a playable video game demo that allows you to drive a car down a series of city blocks. It doesn't sound like much, but it does suggest a future in which deep learning could be used to create studio-quality gaming content — making video games a lot easier to produce. https://youtu.be/ayPqjPekn7g ## Rendering the Future It's an impressive use of machine learning technology, but the results aren't quite photorealistic — at least yet. And to be fair, the demo was created by only one engineer at NVIDIA. "It’s proof-of-concept rather than a game that’s fun to play," Bryan Catanzaro, NVIDIA's vice president of applied deep learning, [told]() *The Verge*. But it could take a while for this to actually be used by video game designers. Catanzaro tells *The Verge* it could take decades until this kind of technology could actually be used in consumer video games. **READ MORE:** [Nvidia has created the first video game demo using AI-generated graphics]() \[The Verge\] ***More on AI rendering: [Artificial Intelligence Is Automating Hollywood. Now, Art Can Thrive.]()*** ## Author I've been at Futurism since 2017, where my role has evolved to encompass design, writing, and increasingly editing. I've always been fascinated by space exploration and advanced transportation, which I've leaned into by interviewing luminaries in those fields while closely following the dimensions of policy and regulation that allow next-generation projects to succeed -- or, sometimes, to fail. I'm also keenly interested in the effects of generative AI on society, policies, and democratic institutions, as well as clean energy, physics and biology, and the vagaries of tech leadership. My work for Futurism has been cited by publications including Ars Technica, Gizmodo, PC Magazine, Jalopnik, Fox News, and the New York Post. I spent my childhood living in locations including Manila, the Philippines, and Geneva, Switzerland, attended McGill University, and now live in Toronto, Canada. Before Futurism I worked at AskMen and a small photography studio. In my free time, I'm an avid gardener, foodie, and craft beer lover, as well as a maker of artisanal hot pepper sauces. I have a magnificent dog named Freida. ### Author social links [Bluesky]()