13 Commits
Author SHA1 Message Date
Niko1221 ed4b4db405 docs and packaging: the owner's 2026-10-23 guide set brought in for 0.2.5 (one installer per system, engine downloaded on first start, DeepSeek in the app and the Terminal with three sets and the Speed choice, install.sh form kept, versions 0.2.5 and 0.1.50, source setup labelled as the developer path) 2026-10-25 11:28:02 +01:00
Niko1221 5e7b9a8301 Docs: plain-wording pass on the 0.2.0 text (fewer mid-sentence bolds, direct phrasing) 2026-10-19 08:01:47 +02:00
Niko1221 2b209b406d Docs consistency pass: pictures on by default on NVIDIA and AMD (Intel Arc off for now), seven monitor views, area prefix for issue and PR titles in AGENTS.md 2026-10-19 08:00:26 +02:00
Niko1221 afe92c1727 docs: models, NVFP4, Gyro, Qwen3.6 and troubleshooting for 0.2.0
Pictures are on by default (CPU reader under 24 GB, GPU reader from 24 GB, every make; no Mac reader yet).
Gyro and NVFP4-QAD read pictures; Gyro needs engine 0.1.45.1+ and is correct on RTX 50 since the SwiGLU guard.
The three NVFP4 versions get their app names. A Qwen3.6-35B-A3B section, the app and Terminal ways to add a model,
and engine versions on the older speed tables. Troubleshooting: no-engine warning, needs a newer engine / Update
engine, Mac xattr steps, strata doctor, Save logs. Private test-notes references removed.
2026-10-19 07:07:54 +02:00
Niko1221 0408f0921c Merge f-145-q36speed (Qwen3.6 speed: decode/prompt kernels, bigger prompt chunk by default) 2026-10-14 22:23:29 +02:00
Niko1221 bb90c106b6 docs/QWEN36.md: speed section (kernels, measured R9700 / RTX 3060 numbers, the prompt chunk default and its KL, what was dropped) 2026-10-14 22:04:58 +02:00
Niko1221 4b348ad4b8 docs/QWEN36.md: the P100 row 2026-10-14 21:38:01 +02:00
Niko1221 34db47a8e1 setup: Qwen3.6 --parallel on small cards follows the measured cost (the slots may take 35% of the experts' room; 12 GB at 8K: 4, 16 GB at 32K: 2), and the text says the gain against one-at-a-time with drafts is small 2026-10-14 21:37:45 +02:00
Niko1221 3bfa088e46 setup: Qwen3.6 offers --parallel on small cards too (the price said: a request alone ~5% slower, 4 together ~1.5x), and asks how many requests at once; Enter keeps one at a time 2026-10-14 07:00:10 +02:00
Niko1221 1e13cbc8a5 qwen35: keep the base engine's end-of-answer accounting (hybrid text identical), a stop keeps only x, the held tokens list every accepted draft
An earlier commit capped the accepted drafts at the end of an answer; that is an exact state, but it moved the hybrid mode's expert-slot
counts, so a sequence of requests with --mtp on a card that does not hold every expert differed from the base engine from the fourth
request on (found by comparing the 10 parity prompts against the base goldens on the 12 GB card).  Now the speculative step commits what
the base engine committed; a stop seen before the state moves keeps only x (the server's hand-over of a stopped request to a batch slot then
reuses the held state: its text equals the run alone), and the held tokens list x and every accepted draft, so a conversation that continues
from them matches the state exactly.  Setup says what parallel measured on the 12 GB card; docs/QWEN36.md updated.
2026-10-14 02:28:13 +02:00
Niko1221 a7027766ff docs/QWEN36.md: the long picture, two pictures, reads beside decoding slots, the hand-over; the picture comparison takes several pictures 2026-10-14 01:54:21 +02:00
Niko1221 3921f57eea qwen35: a conversation's held tokens match its state exactly (no drafts past the end of an answer or a stop), reads give the decoding slots windows, pictures x2 check
spec_step takes no draft past an end-of-answer token or past the room max_new leaves, and a stop asked for before the state moves keeps
only x: every token emitted but the last is in the state, so a conversation that continues from the held tokens (the server's solo ->
slot -> solo hand-over, a chat's next turn) neither misses nor reads a token twice.  Before, an answer ending inside accepted drafts left
the state ahead of the held tokens (found by tools/qwen35/q36_serve_handoff.py: the first request's text now equals its run alone).
STRATA_Q36_READ_WINDOWS sets the decode windows of the other slots between two chunks of a prompt read (default 1).  The mtmd dump takes
several pictures; the engine logs each request's reuse; a 1,024-token test picture.
2026-10-14 01:47:11 +02:00
Niko1221 a9adfa5dad Qwen3.6-35B-A3B: setup asks for pictures and recommends parallel requests; docs
Setup: the images question for qwen36 (GPU encoder on an NVIDIA card of 16 GB or more, the CPU encoder otherwise, AMD under Linux on the
CPU; --vision gpu kept as asked with a note), the pinned mmproj (size and SHA-256) beside the GGUF, the vision section and --vision in
the config; --parallel N is written as asked with what a slot costs, and the recommendation is said where every expert still fits.
docs/QWEN36.md: pictures and several requests at once with the measurements.
2026-10-14 01:11:11 +02:00