CUDA Hardware & Memory Architecture

Hover over the physical hardware components to see how memory and execution units are structured.

Tap diagram to explore

Hardware View

Welcome to the hardware-level view of the GPU!

While the previous diagram showed the logical grouping of threads, this diagram shows the actual physical hardware that runs them.

  • Hover over the Device to see the whole GPU.
  • Hover over a Multiprocessor (SM).
  • Explore the memory types: Registers, Shared, and Device Memory.

Key Concept

The physical layout of memory heavily dictates performance. Closer memory (Registers) is faster but scarce; distant memory (Device Memory) is vast but slow.