AI Unleashes Doom with Stable Diffusion

Episode 21,   Oct 29, 07:30 AM

In this episode, the AI Paper Club welcomes João Costa from Deeper Insights to discuss the paper “Diffusion Models are Real-Time Game Engines” by Google researchers. They examine how AI replicates, the video game, Doom through stable diffusion, with João unpacking real-time frame generation.

In the latest AI Paper Club podcast, hosts Rafael Herrera and Sonia Marques are joined by João Costa, Senior Machine Learning Software Engineer at Deeper Insights. Together, they explore the paper “Diffusion Models are Real-Time Game Engines,” produced by researchers at Google. This episode delves into the intriguing evolution of AI as it replicates the iconic game Doom using stable diffusion—an AI model typically associated with image generation.

The team discusses the paper’s innovative methodology, detailing how stable diffusion models were adapted to generate frame-by-frame gameplay, capturing Doom’s game logic through AI. João unpacks the technical nuances behind the real-time generation of 20 frames per second using powerful TPU processors and explores the research’s practical applications and limitations.

We also extend a special thank you to the Google DeepMind team for developing this month's paper. If you are interested in reading the paper yourself, please visit this link: https://gamengen.github.io

For more information on all things artificial intelligence, machine learning, and engineering for your business, please visit www.deeperinsights.com or reach out to us at thepaperclub@deeperinsights.com.