Posts tagged with

Inference

Study notes on neural networks, Transformers, attention, decoder-only LLMs, mixture-of-experts models, and the prefill/decode split.