#topic

Topics tagged "topic".

• K-Means Clustering

  Partition points around mass-weighted centroids — and its streaming variant, where points arrive one at a time and capacity is fixed.

• KV Cache

  The memory of a decoder-only transformer — why it grows without bound, and the design space for keeping it finite.

• Rotary Position Embedding

  RoPE encodes position by rotating query/key pairs — relative offsets fall out of dot products, and extrapolation beyond the trained range degrades gracefully but really degrades.