DLSS 3 Generates Entire Frames in Real Time With AI, Benefiting GPU- and CPU-Limited Games and Apps
Tuesday, September 20, 2022
GTC—NVIDIA today announced NVIDIA® DLSS 3, an AI-powered performance multiplier that kicks off a new era of NVIDIA RTX™ neural rendering for games and applications.
DLSS 3 builds on the company’s lead in AI-accelerated super-resolution techniques to deliver outstanding image quality and up to 4x the performance of brute-force rendering, plus the quick responsiveness that defines a comprehensive gaming experience.
“DLSS is one of our best inventions and has made real-time ray tracing possible. DLSS 3 is another quantum leap for gamers and creators,” said Jensen Huang, founder and CEO of NVIDIA. “Our pioneering work in RTX neural rendering has opened a new universe of possibilities where AI plays a central role in the creation of virtual worlds.”
DLSS 3 is already receiving widespread support from the gaming ecosystem, with over 35 games and applications integrating the technology.
DLSS 3: The Performance Multiplier, Powered by AI
The combination of ray tracing and AI technologies has revolutionized video games by simultaneously delivering dramatic improvements in image quality along with massive uplifts in performance — a feat unheard of before GeForce RTX.
Powered by new fourth-generation Tensor Cores and a new Optical Flow Accelerator on GeForce RTX 40 Series GPUs, DLSS 3 is the latest iteration of the company’s critically acclaimed Deep Learning Super Sampling technology and introduces a new capability called Optical Multi Frame Generation.
Optical Multi Frame Generation generates entirely new frames, rather than just pixels, delivering astounding performance boosts. The new Optical Flow Accelerator incorporated into the NVIDIA Ada Lovelace architecture analyzes two sequential in-game images and calculates motion vector data for objects and elements that appear in the frame, but are not modeled by traditional game engine motion vectors. This dramatically reduces visual anomalies when AI renders elements such as particles, reflections, shadows and lighting.
Pairs of super-resolution frames from the game, along with both engine and optical flow motion vectors, are then fed into a convolutional neural network that analyzes the data and automatically generates an additional frame for each game-rendered frame — a first for real-time game rendering. Combining the DLSS-generated frames with the DLSS super-resolution frames enables DLSS 3 to reconstruct seven-eighths of the displayed pixels with AI, boosting frame rates by up to 4x compared to without DLSS.
Because DLSS Frame Generation executes as a post-process on the GPU, it can boost frame rates even when the game is bottlenecked by the CPU. For CPU-limited games, such as those that are physics heavy or involve large worlds,