Frontier CheckpointExploring the open frontier

The index

Topics

The controlled vocabulary, grouped by facet. Every tag is a cross-collection feed of everything that carries it.

architecture

Attention 3Long Context 2Transformers 2State-Space Models 1Mixture of Experts 1RoPE 1

training

Fine-Tuning 3Pretraining 2Optimization 2Distributed Training 2Tensor Parallelism 2PEFT 1FSDP 1

inference

Serving 5KV Cache 4PagedAttention 2Quantization 1

systems

GPU Memory 3FlashAttention 2Kernels 2

rl

Reasoning 3GRPO 3RLHF 3Test-Time Compute 1DPO 1PPO 1

agents

Agents 3Agent Harness 1Tool Use 1

evaluation

Reproducibility 5Evaluation 4

meta

Industry 3Methodology 2

domain

LLMs 3