Continuous Batching & PagedAttention
Interactive scheduling simulator for LLM inference.
1. Static Batching
2. Continuous Batching
3. PagedAttention Synergy
Prev Event
EVENT 1 / 5
Next Event
Static Batching
Title
Description goes here.
Utilization Legend
Active Compute
Idle Bubble (Wasted)