CUDA Execution Architecture

Hover over the diagram components to understand how GPUs organize parallel computation.

Tap diagram to explore

Interactive Mode

Welcome to the interactive CUDA hierarchy explorer!

Move your mouse (or tap on mobile) over different parts of the diagram on the left.

  • Hover over the green Grid.
  • Hover over the orange Blocks.
  • Explore the zoomed-in grid of Threads.
  • See how they connect to Shared Memory.

Key Concept

GPUs execute code in parallel using a massive number of threads organized in a rigid hierarchy.