LLM Architecture

Attention in Practice: Visualizing Q/K/V and why scaling heads changes behavior

A walkthrough of scaled dot-product attention (Q/K/V), softmax temperature, and why increasing head count shifts attention statistics and behavior.