Vendor full tokenized WikiText-2 corpus into core benchmark fixtures#27

Merged

sharpninja merged 9 commits intomainfrom

copilot/add-wikitext-2-validation-set

Mar 21, 2026

Commits on Mar 21, 2026

Initial plan
Copilot
committed
Add repository-local WikiText-2 validation fixture

Copilot
and
sharpninja
committed
Add full tokenized WikiText-2 corpus

Copilot
and
sharpninja
committed
Fix WikiText2 fixture review feedback

Copilot
and
sharpninja
committed
Polish WikiText2 fixture review fixes

Copilot
and
sharpninja
committed
Fix CI test runtime for vendored WikiText2 fixtures

Copilot
and
sharpninja
committed
Refine CI test runtime fix

Copilot
and
sharpninja
committed
Add local corpus processing script

Copilot
and
sharpninja
committed
Polish corpus script usage docs

Copilot
and
sharpninja
committed