Sources of truth¶
Every claim the kernel makes about the engine is stated against one release of vLLM, and every input it reads is pinned to one commit. This table is generated from the pins themselves.
| What | Version | Commit | Pinned in |
|---|---|---|---|
| Engine behavior: vLLM | v0.31.0 |
db9527a46873 |
EngineBehaviourVersion, EngineBehaviourCommit in new.go |
| Interfaces and document types: blis-schemas | v0.4.0 |
— | go.mod |
| Declared facts: blis-catalog | 0.3.0 |
676326ec6c70 |
testdata/upstream.lock |
| Coefficients: blis-registry | v0.2.0 |
7f6662d7188d |
testdata/upstream.lock |
Two sources of engine behavior¶
Most of what the kernel knows about vLLM is encoded here, at v0.31.0: which kernels run, how
work is split, what an unstated setting defaults to, which layouts start. Some version-scoped
facts are read instead from the blis-schemas rules pack for the release the scenario declares,
among them which tensor-parallel widths the custom all-reduce supports, when the MoE input is
made sequence-parallel, which decode-context combine backends the release accepts, how many
pages a window cache holds, how stated caches group into the shared KV block pool, and the
CUDA graph capture sizes a deployment's stated knobs resolve to (resolve.EngineRules lists
them).
Reading a citation¶
A comment in the source that cites vllm/<path>:<lines> means those lines at the commit
above. To read them in a vLLM checkout:
A comment that cites a vLLM line without a path, as :571-577, continues the path of the
citation before it.
Changing a pin¶
- vLLM. Moving to a newer release is a review of every behavior the kernel encodes, not a
version bump: each citation must be checked against the new release, and the constants
EngineBehaviourVersionandEngineBehaviourCommitinnew.gochanged with them. - blis-schemas. A Go module dependency: change
go.mod. - blis-catalog and blis-registry. Edit
testdata/upstream.lock, runscripts/fetch-testdata.sh, and rungo test ./.... A renamed chip or coefficient is supposed to break the scenarios that name it.
After any of these, run go run ./internal/docgen so this table and the figures follow.