Strata

0 Fork 0

mirror of https://github.com/Niko1221/Strata.git synced 2026-11-09 17:36:14 -10:00

Files

T

Niko1221 5c50fbbcf2 setup: --draft-vocab fr - the English/code subset plus the tokens of French text (#597 )

French answers drafted poorly with the shipped subsets: 23.6% of the token occurrences of French text fall outside
draft_vocab_en.bin, and the draft head cannot propose those (no subset adds the accented words and word pieces).

- tools/draft_vocab.py: a coverage mode. --corpus FILE... adds to the base the most frequent tokens of the corpus that
  together cover --coverage (default 0.99) of its occurrences, and prints the share outside the base and the new list.
- data/draft_vocab_fr.bin: draft_vocab_en.bin plus 5,686 tokens (46,211 ids), from 10 French Wikipedia articles
  (France, Paris, Napoleon Ier, Langue francaise, Union europeenne, Litterature francaise, Cuisine francaise,
  Economie de la France, Revolution francaise, Seconde Guerre mondiale; 1.24 M characters, 326,926 tokens) at 0.99:
    python tools/draft_vocab.py --gguf <IQ3_XXS shard 1> --base data/draft_vocab_en.bin --corpus <the articles> \
        --coverage 0.99 --out data/draft_vocab_fr.bin
  Outside the list on that corpus: 0.74% (23.65% with en).
- setup.py: "fr" in DRAFT_VOCABS / --draft-vocab (~151 MiB head on IQ3_S, between en and cyrillic). The sha256 check
  knows it as a shipped subset, so a later --draft-vocab cjk/en replaces it and a subset made by hand stays.
- tests: tools/test_draft_vocab.py (the coverage mode), tools/test_setup_draft_vocab.py (fr replaces a shipped subset
  and back, keeps the en ids first in their order, its MiB estimate).

The default subset (cjk) is unchanged.

2026-10-03 18:19:49 +02:00

experimental-speed-projection

Experimental speed projection: an optional control vector (EXPERIMENTAL, off by default)

2026-09-27 16:47:45 +02:00

draft_vocab_cyrillic.bin

setup: --draft-vocab cyrillic - the English/code subset plus the whole Cyrillic script

2026-10-01 08:13:17 +02:00

draft_vocab_en.bin

setup: --host/--api-key/--draft-vocab on a start are kept for the model (#179 ); --draft-vocab en keeps the English/code subset (~110 MiB less VRAM); CUDA 13.0 for RTX 50 builds (#220 ); llama.cpp's web UI is not unpacked (Windows path limit, #206 ); Swift Q2_0 hidden (#171 ); the earlier data folder and nested Strata-data move into --data-dir (#198 ); whole shards without a finish mark count (#173 )

2026-09-30 10:54:45 +02:00

draft_vocab_fr.bin

setup: --draft-vocab fr - the English/code subset plus the tokens of French text (#597 )