Ryanne's Blog
  • Attention
    • K-Means Memory
    • Lattice Memory
    • Positioning
    • Related Work
    • The Engine
    • Tiered Memory
    • TinyStories Data
    • Training in the Loop
    • Verification Methodology
    • Finite Memory for Unbounded Streams
  • Topics
    • K-Means Clustering
    • KV Cache
    • Rotary Position Embedding

#inference

Topics tagged "inference".

  • The Engine

    A pure-Java transformer inference engine where attention — including the KV cache — is a plugin.