.....[strata] done: 12 tokens in 0 s (120989.5 tok/s) (stop, cancel=False)
..[strata] other apps now use the Chat settings: temperature=0.5
.[strata] done: 12 tokens in 0 s (294337.1 tok/s) (stop, cancel=False)
.....[strata] done: 12 tokens in 0 s (314572.8 tok/s) (stop, cancel=False)
.[strata] other apps now use the Chat settings: temperature=0.5
[strata] other apps now use the Chat settings: temperature=0.5
[strata] other apps now use the Chat settings: temperature=0.5
..[strata] 400 invalid request: request exceeds the context window: prompt (150722 tokens) leaves no room to answer in the context (131072); requests are never truncated
[strata] 400 invalid request: request exceeds the context window: prompt (150722 tokens) leaves no room to answer in the context (131072); requests are never truncated
[strata] 400 invalid request: request exceeds the context window: prompt (150722 tokens) + max tokens (16) exceeds the context (131072); requests are never truncated. Send a smaller max_tokens (at most 0 here), or add "fit_max_tokens": true to the model's strata-<model>.json to shorten it to the room left (#545)
[strata] 400 invalid request: request exceeds the context window: prompt (1024 tokens) + max tokens (131072) exceeds the context (131072); requests are never truncated. Send a smaller max_tokens (at most 130040 here), or add "fit_max_tokens": true to the model's strata-<model>.json to shorten it to the room left (#545)
[strata] 400 invalid request: request exceeds the context window: prompt (150722 tokens) leaves no room to answer in the context (131072); requests are never truncated
[strata] 400 invalid request: request exceeds the context window: prompt (150722 tokens) leaves no room to answer in the context (131072); requests are never truncated
[strata] 400 invalid request: request exceeds the context window: prompt (150722 tokens) + max tokens (16) exceeds the context (131072); requests are never truncated. Send a smaller max_tokens (at most 0 here), or add "fit_max_tokens": true to the model's strata-<model>.json to shorten it to the room left (#545)
[strata] 400 invalid request: request exceeds the context window: prompt (1024 tokens) + max tokens (131072) exceeds the context (131072); requests are never truncated. Send a smaller max_tokens (at most 130040 here), or add "fit_max_tokens": true to the model's strata-<model>.json to shorten it to the room left (#545)
[strata] 400 invalid request: request exceeds the context window: prompt (150722 tokens) leaves no room to answer in the context (131072); requests are never truncated
[strata] 400 invalid request: request exceeds the context window: prompt (150722 tokens) leaves no room to answer in the context (131072); requests are never truncated
[strata] 400 invalid request: request exceeds the context window: prompt (150722 tokens) + max tokens (16) exceeds the context (131072); requests are never truncated. Send a smaller max_tokens (at most 0 here), or add "fit_max_tokens": true to the model's strata-<model>.json to shorten it to the room left (#545)
[strata] 400 invalid request: request exceeds the context window: prompt (1024 tokens) + max tokens (131072) exceeds the context (131072); requests are never truncated. Send a smaller max_tokens (at most 130040 here), or add "fit_max_tokens": true to the model's strata-<model>.json to shorten it to the room left (#545)
[strata] 400 invalid request: request exceeds the context window: prompt (150722 tokens) leaves no room to answer in the context (131072); requests are never truncated
[strata] 400 invalid request: request exceeds the context window: prompt (150722 tokens) leaves no room to answer in the context (131072); requests are never truncated
[strata] 400 invalid request: request exceeds the context window: prompt (150722 tokens) + max tokens (16) exceeds the context (131072); requests are never truncated. Send a smaller max_tokens (at most 0 here), or add "fit_max_tokens": true to the model's strata-<model>.json to shorten it to the room left (#545)
[strata] 400 invalid request: request exceeds the context window: prompt (1024 tokens) + max tokens (131072) exceeds the context (131072); requests are never truncated. Send a smaller max_tokens (at most 130040 here), or add "fit_max_tokens": true to the model's strata-<model>.json to shorten it to the room left (#545)
.[strata] done: 1 tokens in 0 s (76260.1 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] 400 invalid request: request exceeds the context window: prompt (131064 tokens) + max tokens (1) exceeds the context (131072); requests are never truncated. Send a smaller max_tokens (at most 0 here), or add "fit_max_tokens": true to the model's strata-<model>.json to shorten it to the room left (#545)
[strata] done: 1 tokens in 0 s (82241.3 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] 400 invalid request: request exceeds the context window: prompt (131064 tokens) leaves no room to answer in the context (131072); requests are never truncated
[strata] done: 1 tokens in 0 s (79137.8 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] 400 invalid request: request exceeds the context window: prompt (131064 tokens) + max tokens (1) exceeds the context (131072); requests are never truncated. Send a smaller max_tokens (at most 0 here), or add "fit_max_tokens": true to the model's strata-<model>.json to shorten it to the room left (#545)
[strata] done: 1 tokens in 0 s (72315.6 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] 400 invalid request: request exceeds the context window: prompt (131064 tokens) leaves no room to answer in the context (131072); requests are never truncated
[strata] done: 1 tokens in 0 s (41527.8 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] done: 1 tokens in 0 s (49932.2 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
....sssss....[strata] 400 invalid request: unknown reasoning effort 'huge': use none, low, medium or high
.[strata] done: 24 tokens in 0 s (288433.5 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (333322.2 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (311651.1 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (311651.1 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (320583.7 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (343560.7 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (333322.2 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (333322.2 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (348315.9 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (304118.7 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (347114.8 tok/s) (stop, cancel=False)
.[strata] done: 24 tokens in 0 s (353204.5 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (347114.8 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (242562.2 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (351969.6 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (348315.9 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (267011.4 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (351969.6 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (343560.7 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (261463.1 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (299593.1 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (315558.9 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (264208.1 tok/s) (stop, cancel=False)
.[strata] done: 24 tokens in 0 s (358232.4 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (324720.3 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (319566.0 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (315558.9 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (347114.8 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (354448.2 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (354448.2 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (353204.5 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (353204.5 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (348315.9 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (299593.1 tok/s) (stop, cancel=False)
.[strata] done: 24 tokens in 0 s (363405.4 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (356962.0 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (363405.4 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (354448.2 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (363405.4 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (353204.5 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (319566.0 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (319566.0 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (311651.1 tok/s) (stop, cancel=False)
.[strata] done: 24 tokens in 0 s (272800.3 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (257450.9 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (278845.7 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (275789.9 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (275789.9 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (276547.5 tok/s) (stop, cancel=False)
.[strata] done: 24 tokens in 0 s (351969.6 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (343560.7 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (276547.5 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (316551.2 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (311651.1 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (276547.5 tok/s) (stop, cancel=False)
.[strata] done: 24 tokens in 0 s (358232.4 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (358232.4 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (319566.0 tok/s) (stop, cancel=False)
.[strata] done: 24 tokens in 0 s (358232.4 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (332222.1 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (338933.7 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (275789.9 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (315558.9 tok/s) (stop, cancel=False)
.[strata] done: 24 tokens in 0 s (109061.0 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (127745.3 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (157041.0 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (142179.8 tok/s) (stop, cancel=False)
.[strata] done: 24 tokens in 0 s (304118.7 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (307838.8 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (315558.9 tok/s) (stop, cancel=False)
.................[strata] the engine stopped unexpectedly (exit code -15). Unrecoverable native verification failure: verify: timed out at layer 18; its GPU waits were released and the GPU finished (#267) The next request starts the engine again.
[strata] done: 0 tokens in 0 s (0.0 tok/s) (error, cancel=False)
[strata] the engine had stopped (exit code -15); starting it again (a minute or two) ...
[strata] the engine is running again
[strata] done: 1 tokens in 0 s (19599.6 tok/s) (length, cancel=False)
...[strata] the engine stopped unexpectedly (exit code -15). Unrecoverable native verification failure: verify: timed out at layer 18; its GPU waits were released and the GPU finished (#267) The next request starts the engine again.
[strata] done: 0 tokens in 0 s (0.0 tok/s) (error, cancel=False)
[strata] the engine had stopped (exit code -15); starting it again (a minute or two) ...
[strata] the engine is running again
[strata] done: 1 tokens in 0 s (25731.9 tok/s) (length, cancel=False)
................................[strata] image: 512x768, n=2, 8 steps, seed 11
/Users/nikoveit/Documents/deepseek-harness/strata-work/strata-rebuild/serve/server.py:6159: ResourceWarning: unclosed file <_io.TextIOWrapper name=9 encoding='UTF-8'>
  images, figures = gen.run(job, cancel)
ResourceWarning: Enable tracemalloc to get the object allocation traceback
[strata] image done in 0.2 s (keep)
.[strata] 400 invalid request: size 999x999: each side a multiple of 32 from 256 to 2048
[strata] image: 1024x1024, n=1, 8 steps, seed 1110634191
[strata] image job failed: sd-cli exited with code 1
[INFO ] loading tensors completed, taking 0.10s
[ERROR] ggml_vulkan: ErrorDeviceLost
/Users/nikoveit/Documents/deepseek-harness/strata-work/strata-rebuild/serve/server.py:6163: ResourceWarning: unclosed file <_io.TextIOWrapper name=9 encoding='UTF-8'>
  return
ResourceWarning: Enable tracemalloc to get the object allocation traceback
.[strata] image: 1024x1024, n=1, 8 steps, seed 468962749
[strata] image done in 1.7 s (keep)
[strata] done: 8 tokens in 0 s (38304.1 tok/s) (length, cancel=False)
...[strata] image: 1024x1024, n=1, 8 steps, seed 0
[strata] image done in 0.2 s (keep)
[strata] image: 1024x1024, n=1, 8 steps, seed 1
[strata] image done in 0.2 s (keep)
[strata] image: 1024x1024, n=1, 8 steps, seed 2
[strata] image done in 0.2 s (keep)
[strata] image: 1024x1024, n=1, 8 steps, seed 3
[strata] image done in 0.2 s (keep)
.[strata] image job: the conversation (123 tokens) saved; unloading the model
[strata] loading the model again (it was unloaded) ...
[strata] the engine is running again
[strata] the conversation from before the image job is back (123 tokens)
...[strata] image job: the engine's expert cache gave VRAM back (9000 MiB free)
.[strata] image job: the conversation (123 tokens) saved; unloading the model
[strata] loading the model again (it was unloaded) ...
[strata] the engine is running again
[strata] the conversation from before the image job is back (123 tokens)
.........[strata] done: 3 tokens in 0 s (110376.4 tok/s) (stop, cancel=False)
[strata] done: 1 tokens in 0 s (59074.7 tok/s) (disconnect, cancel=False)
.[strata] loading the model again (it was unloaded) ...
.[strata] model unloaded; the next request loads it again
.....[strata] loading the model again (it was unloaded) ...
[strata] the engine is running again
[strata] done: 7 tokens in 0 s (131072.0 tok/s) (stop, cancel=False)
[strata] done: 7 tokens in 0 s (143220.1 tok/s) (stop, cancel=False)
[strata] model unloaded; the next request loads it again
[strata] loading the model again (it was unloaded) ...
[strata] the engine is running again
[strata] done: 7 tokens in 0 s (40496.7 tok/s) (stop, cancel=False)
.[strata] loading the model again (it was unloaded) ...
[strata] the engine is running again
....[strata] 400 invalid request: logit_bias: expected an object or a list of [token_id, bias] pairs
[strata] 400 invalid request: logit_bias: this engine does not support token biases; use a supporting CUDA/HIP build
[strata] 400 invalid request: logit_bias: biases must be finite numbers between -100 and 100; false is a pair-list ban
...[strata] MCP server 'missing' did not start: could not start 'strata-no-such-program': [Errno 2] No such file or directory: 'strata-no-such-program'. Its tools are left out; the chat works without them.
[strata] MCP server 'paged': 6 tools (echo, fail, sleep, big, die, add)
[strata] MCP server 'fake': 6 tools (echo, fail, sleep, big, die, add)
[strata] MCP server 'broken' did not start: the server stopped (exit code 2): cannot start: missing configuration. Its tools are left out; the chat works without them.
...[strata] MCP server 'solo': 6 tools (echo, fail, sleep, big, die, add)
[strata] MCP server 'solo' had stopped; starting it again
[strata] MCP server 'solo': 6 tools (echo, fail, sleep, big, die, add)
........[strata] MCP server 'down' did not start: could not reach http://127.0.0.1:9/mcp: <urlopen error [Errno 61] Connection refused>. Its tools are left out; the chat works without them.
[strata] MCP server 'web': 6 tools (echo, fail, sleep, big, die, add)
..[strata] done: 13 tokens in 0 s (152733.8 tok/s) (stop, cancel=False)
.[strata] MCP server 'fake': 6 tools (echo, fail, sleep, big, die, add)
[strata] MCP server 'broken' did not start: the server stopped (exit code 2): cannot start: missing configuration. Its tools are left out; the chat works without them.
[strata] done: 83 tokens in 0 s (127100.1 tok/s) (stop, cancel=False)
.[strata] MCP server 'fake': 6 tools (echo, fail, sleep, big, die, add)
[strata] MCP server 'broken' did not start: the server stopped (exit code 2): cannot start: missing configuration. Its tools are left out; the chat works without them.
.[strata] MCP server 'fake': 6 tools (echo, fail, sleep, big, die, add)
[strata] MCP server 'broken' did not start: the server stopped (exit code 2): cannot start: missing configuration. Its tools are left out; the chat works without them.
[strata] done: 120 tokens in 0 s (142865.9 tok/s) (stop, cancel=False)
[strata] tool fake__echo: ok, 5 characters in 0.0 s
[strata] done: 120 tokens in 0 s (141819.2 tok/s) (stop, cancel=False)
[strata] tool fake__echo: ok, 5 characters in 0.0 s
[strata] done: 120 tokens in 0 s (149975.1 tok/s) (stop, cancel=False)
.[strata] MCP server 'fake': 6 tools (echo, fail, sleep, big, die, add)
[strata] MCP server 'broken' did not start: the server stopped (exit code 2): cannot start: missing configuration. Its tools are left out; the chat works without them.
[strata] done: 141 tokens in 0 s (156165.0 tok/s) (stop, cancel=False)
[strata] tool fake__add: ok, 1 characters in 0.0 s
[strata] done: 13 tokens in 0 s (275383.6 tok/s) (stop, cancel=False)
.[strata] MCP server 'fake': 6 tools (echo, fail, sleep, big, die, add)
[strata] MCP server 'broken' did not start: the server stopped (exit code 2): cannot start: missing configuration. Its tools are left out; the chat works without them.
[strata] refused an API request from the web page 'http://evil.example' (no API key; add its host to "allowed_hosts" or its origin to "cors_origins" in the config)
[strata] done: 13 tokens in 0 s (200463.1 tok/s) (stop, cancel=False)
.[strata] MCP server 'fake': 6 tools (echo, fail, sleep, big, die, add)
[strata] MCP server 'broken' did not start: the server stopped (exit code 2): cannot start: missing configuration. Its tools are left out; the chat works without them.
[strata] done: 109 tokens in 0 s (140239.0 tok/s) (stop, cancel=False)
.[strata] MCP server 'fake': 6 tools (echo, fail, sleep, big, die, add)
[strata] MCP server 'broken' did not start: the server stopped (exit code 2): cannot start: missing configuration. Its tools are left out; the chat works without them.
[strata] done: 116 tokens in 0 s (135564.0 tok/s) (stop, cancel=False)
[strata] done: 16 tokens in 0 s (192841.6 tok/s) (stop, cancel=False)
[strata] done: 16 tokens in 0 s (202745.8 tok/s) (stop, cancel=False)
.[strata] MCP server 'fake': 6 tools (echo, fail, sleep, big, die, add)
[strata] MCP server 'broken' did not start: the server stopped (exit code 2): cannot start: missing configuration. Its tools are left out; the chat works without them.
[strata] done: 120 tokens in 0 s (132731.1 tok/s) (stop, cancel=False)
.[strata] MCP server 'fake': 6 tools (echo, fail, sleep, big, die, add)
[strata] MCP server 'broken' did not start: the server stopped (exit code 2): cannot start: missing configuration. Its tools are left out; the chat works without them.
[strata] done: 134 tokens in 0 s (130980.4 tok/s) (stop, cancel=False)
[strata] tool fake__echo: ok, 19 characters in 0.0 s
[strata] done: 31 tokens in 0 s (144150.1 tok/s) (stop, cancel=False)
.[strata] MCP server 'fake': 6 tools (echo, fail, sleep, big, die, add)
[strata] MCP server 'broken' did not start: the server stopped (exit code 2): cannot start: missing configuration. Its tools are left out; the chat works without them.
[strata] done: 84 tokens in 0 s (150179.7 tok/s) (stop, cancel=False)
[strata] tool fake__fail: error, 27 characters in 0.0 s
[strata] done: 21 tokens in 0 s (169385.4 tok/s) (stop, cancel=False)
.[strata] MCP server 'fake': 6 tools (echo, fail, sleep, big, die, add)
[strata] MCP server 'broken' did not start: the server stopped (exit code 2): cannot start: missing configuration. Its tools are left out; the chat works without them.
[strata] done: 115 tokens in 0 s (144285.1 tok/s) (stop, cancel=False)
[strata] tool fake__big: ok, 3,000 characters in 0.0 s (truncated for the model)
[strata] done: 16 tokens in 0 s (205225.9 tok/s) (stop, cancel=False)
.[strata] done: 24 tokens in 0 s (195462.7 tok/s) (stop, cancel=False)
....[strata] 400 invalid request: request exceeds the context window: prompt (183 tokens) + max tokens (20000) exceeds the context (16384); requests are never truncated. Send a smaller max_tokens (at most 16193 here), or add "fit_max_tokens": true to the model's strata-<model>.json to shorten it to the room left (#545)
[strata] done: 0 tokens in 0 s (0.0 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] done: 0 tokens in 0 s (0.0 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] done: 0 tokens in 0 s (0.0 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] done: 0 tokens in 0 s (0.0 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
.[strata] done: 50 tokens in 0 s (130908.4 tok/s) (stop, cancel=False)
.[strata] done: 50 tokens in 0 s (134003.3 tok/s) (stop, cancel=False)
[strata] done: 50 tokens in 0 s (68512.0 tok/s) (stop, cancel=False)
[strata] done: 50 tokens in 0 s (144134.2 tok/s) (stop, cancel=False)
[strata] done: 50 tokens in 0 s (74738.1 tok/s) (stop, cancel=False)
..[strata] loading the model again (it was unloaded) ...
[strata] the engine is running again
[strata] done: 50 tokens in 0 s (84596.7 tok/s) (stop, cancel=False)
[strata] done: 50 tokens in 0 s (93832.3 tok/s) (stop, cancel=False)
.[strata] done: 7 tokens in 0 s (152125.0 tok/s) (stop, cancel=False)
..[strata] "parallel" must be a whole number of requests (2..8), not '4': ignored
[strata] "parallel" must be a whole number of requests (2..8), not True: ignored
[strata] "parallel": 12 - the engine runs at most 8 requests together; it will use 8
.[strata] done: 8 tokens in 0 s (29.6 tok/s) (length, cancel=False)
[strata] done: 8 tokens in 0 s (31.4 tok/s) (length, cancel=False)
[strata] done: 8 tokens in 1 s (29.7 tok/s) (length, cancel=False)
[strata] done: 8 tokens in 1 s (29.7 tok/s) (length, cancel=False)
[strata] done: 8 tokens in 1 s (29.3 tok/s) (length, cancel=False)
[strata] done: 8 tokens in 1 s (28.7 tok/s) (length, cancel=False)
[strata] answering: 3 of max 8 tokens, 22.3 tok/s, 1 s
[strata] answering: 3 of max 8 tokens, 33.7 tok/s, 1 s
[strata] done: 8 tokens in 1 s (28.2 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 1 s so far
[strata] done: 8 tokens in 1 s (28.2 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 1 s so far
[strata] done: 8 tokens in 1 s (29.5 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 1 s so far
[strata] done: 8 tokens in 1 s (29.6 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 2 s so far
[strata] done: 8 tokens in 2 s (29.2 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 2 s so far
[strata] done: 8 tokens in 2 s (29.3 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 2 s so far
[strata] done: 8 tokens in 2 s (30.1 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 2 s so far
[strata] done: 8 tokens in 2 s (29.9 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 45 tokens, 2 s so far
[strata] done: 8 tokens in 2 s (28.9 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 2 s so far
[strata] done: 8 tokens in 2 s (29.8 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 2 s so far
[strata] done: 8 tokens in 3 s (31.4 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 3 s so far
[strata] done: 8 tokens in 3 s (31.3 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 3 s so far
[strata] done: 8 tokens in 3 s (29.6 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 3 s so far
[strata] done: 8 tokens in 3 s (29.6 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 45 tokens, 3 s so far
[strata] done: 8 tokens in 3 s (31.5 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 3 s so far
[strata] done: 8 tokens in 3 s (30.7 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 3 s so far
[strata] done: 8 tokens in 3 s (28.1 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 3 s so far
[strata] done: 8 tokens in 3 s (28.1 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 3 s so far
[strata] done: 8 tokens in 4 s (29.5 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 4 s so far
[strata] done: 8 tokens in 4 s (29.1 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 4 s so far
[strata] done: 8 tokens in 4 s (29.5 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 4 s so far
[strata] done: 8 tokens in 4 s (29.5 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 4 s so far
[strata] done: 8 tokens in 4 s (28.9 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 4 s so far
[strata] done: 8 tokens in 4 s (29.4 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 4 s so far
[strata] done: 8 tokens in 5 s (30.4 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 5 s so far
[strata] done: 8 tokens in 5 s (30.4 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 5 s so far
[strata] done: 8 tokens in 5 s (29.3 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 5 s so far
[strata] done: 8 tokens in 5 s (29.2 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 45 tokens, 5 s so far
[strata] done: 8 tokens in 5 s (30.1 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 5 s so far
[strata] done: 8 tokens in 5 s (30.1 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 5 s so far
[strata] done: 8 tokens in 5 s (29.0 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 5 s so far
[strata] done: 8 tokens in 5 s (29.7 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 5 s so far
[strata] done: 8 tokens in 6 s (31.6 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 45 tokens, 6 s so far
[strata] done: 8 tokens in 6 s (31.5 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 6 s so far
[strata] done: 8 tokens in 6 s (29.8 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 6 s so far
[strata] done: 8 tokens in 6 s (28.9 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 6 s so far
[strata] done: 8 tokens in 6 s (28.6 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 6 s so far
[strata] done: 8 tokens in 6 s (28.6 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 45 tokens, 6 s so far
[strata] done: 8 tokens in 7 s (31.5 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 7 s so far
[strata] done: 8 tokens in 7 s (31.5 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 7 s so far
[strata] done: 8 tokens in 7 s (28.5 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 7 s so far
[strata] done: 8 tokens in 7 s (28.6 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 7 s so far
[strata] done: 8 tokens in 7 s (29.7 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 45 tokens, 7 s so far
[strata] done: 8 tokens in 7 s (29.6 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 7 s so far
[strata] done: 8 tokens in 7 s (29.0 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 7 s so far
[strata] done: 8 tokens in 7 s (29.5 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 45 tokens, 7 s so far
[strata] done: 8 tokens in 8 s (29.6 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 8 s so far
[strata] done: 8 tokens in 8 s (30.0 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 8 s so far
[strata] done: 8 tokens in 8 s (30.3 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 8 s so far
[strata] done: 8 tokens in 8 s (29.5 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 8 s so far
[strata] done: 8 tokens in 8 s (29.3 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 8 s so far
[strata] done: 8 tokens in 8 s (29.2 tok/s) (length, cancel=False)
[strata] reading the prompt: 32 of 46 tokens, 8 s so far
[strata] done: 8 tokens in 9 s (29.0 tok/s) (length, cancel=False)
[strata] done: 8 tokens in 9 s (35.0 tok/s) (length, cancel=False)
.[strata] done: 10 tokens in 1 s (39.0 tok/s) (stop, cancel=False)
[strata] thinking: 23 of max 200 tokens, 25.5 tok/s, 1 s
[strata] done: 55 tokens in 2 s (30.4 tok/s) (stop, cancel=False)
.[strata] the engine stopped unexpectedly (exit code 1). The engine exited (code 1) after it reported: verify batch: layer 34 never rang (graph finished) - please report it at github.com/Niko1221/Strata/issues with the log. The next request starts the engine again.
[strata] done: 4 tokens in 0 s (19.4 tok/s) (error, cancel=False)
[strata] the engine stopped unexpectedly (exit code 1). The engine exited (code 1) after it reported: verify batch: layer 34 never rang (graph finished) - please report it at github.com/Niko1221/Strata/issues with the log. The next request starts the engine again.
[strata] done: 1 tokens in 0 s (14.5 tok/s) (error, cancel=False)
.[strata] parallel: slot(s) 0, 1 were marked busy with no request using them (issue #1603); freed, the waiting request goes on
[strata] reading the prompt: 32 of 52 tokens, 1 s so far
[strata] done: 10 tokens in 1 s (36.3 tok/s) (stop, cancel=False)
.[strata] done: 10 tokens in 1 s (19.1 tok/s) (stop, cancel=False)
[strata] reading the prompt: 1,824 of 3,037 tokens, 1 s so far
[strata] done: 10 tokens in 2 s (36.4 tok/s) (stop, cancel=False)
.[strata] done: 10 tokens in 0 s (36.0 tok/s) (stop, cancel=False)
[strata] done: 10 tokens in 0 s (34.3 tok/s) (stop, cancel=False)
[strata] loading the model again (it was unloaded) ...
[strata] the engine is running again
[strata] done: 10 tokens in 0 s (37.9 tok/s) (stop, cancel=False)
.[strata] done: 10 tokens in 0 s (34.9 tok/s) (stop, cancel=False)
[strata] answering: 33 of max 200 tokens, 33.3 tok/s, 1 s
[strata] done: 55 tokens in 2 s (33.6 tok/s) (stop, cancel=False)
.[strata] done: 10 tokens in 0 s (29.0 tok/s) (stop, cancel=False)
[strata] done: 10 tokens in 0 s (35.0 tok/s) (stop, cancel=False)
.[strata] parallel requests: 4 asked, the engine runs 2 (its log says why)
[strata] done: 10 tokens in 0 s (35.9 tok/s) (stop, cancel=False)
.[strata] done: 10 tokens in 1 s (17.9 tok/s) (stop, cancel=False)
[strata] done: 10 tokens in 1 s (18.7 tok/s) (stop, cancel=False)
[strata] reading the prompt: 1,792 of 3,037 tokens, 1 s so far
[strata] done: 10 tokens in 2 s (38.9 tok/s) (stop, cancel=False)
.[strata] reading the prompt: 2,560 of 3,037 tokens, 1 s so far
[strata] answering: 1 of max 64 tokens, 167772.2 tok/s, 1 s
[strata] answering: 5 of max 60 tokens, 2.1 tok/s, 2 s
[strata] reading the prompt: 2,560 of 3,037 tokens, 2 s so far
[strata] answering: 2 of max 64 tokens, 1.7 tok/s, 2 s
[strata] done: 10 tokens in 3 s (6.2 tok/s) (stop, cancel=False)
[strata] done: 10 tokens in 3 s (36.3 tok/s) (stop, cancel=False)
[strata] answering: 33 of max 60 tokens, 9.7 tok/s, 3 s
[strata] done: 55 tokens in 4 s (13.7 tok/s) (stop, cancel=False)
.[strata] parallel: slot(s) 0 were marked busy with no request using them (issue #1603); freed, the waiting request goes on
..[strata] done: 10 tokens in 0 s (35.3 tok/s) (stop, cancel=False)
[strata] done: 3 tokens in 0 s (41.9 tok/s) (disconnect, cancel=True)
[strata] thinking: 20 of max 512 tokens, 24.1 tok/s, 1 s
[strata] thinking: 16 of max 512 tokens, 36.7 tok/s, 1 s
[strata] done: 0 tokens in 1 s (0.0 tok/s) (cancel, cancel=True)
[strata] done: 55 tokens in 2 s (31.0 tok/s) (stop, cancel=False)
[strata] thinking: 54 of max 512 tokens, 37.0 tok/s, 2 s
[strata] done: 55 tokens in 2 s (37.1 tok/s) (stop, cancel=False)
[strata] done: 10 tokens in 0 s (38.5 tok/s) (stop, cancel=False)
.[strata] done: 10 tokens in 0 s (36.1 tok/s) (stop, cancel=False)
[strata] thinking: 5 of max 256 tokens, 48.6 tok/s, 1 s
[strata] done: 10 tokens in 1 s (37.8 tok/s) (stop, cancel=False)
[strata] done: 10 tokens in 0 s (38.0 tok/s) (stop, cancel=False)
.[strata] done: 10 tokens in 0 s (35.2 tok/s) (stop, cancel=False)
[strata] thinking: 14 of max 512 tokens, 15.9 tok/s, 1 s
[strata] done: 0 tokens in 1 s (0.0 tok/s) (disconnect, cancel=True)
[strata] thinking: 47 of max 512 tokens, 24.8 tok/s, 2 s
[strata] done: 55 tokens in 2 s (25.7 tok/s) (stop, cancel=False)
[strata] done: 10 tokens in 0 s (37.6 tok/s) (stop, cancel=False)
.[strata] parallel: the engine refused slot 1 (BGEN: no such free slot (--batch 2) or a bad max_new); trying another slot (1/6) (issue #1994)
[strata] done: 10 tokens in 1 s (37.4 tok/s) (stop, cancel=False)
[strata] answering: 34 of max 64 tokens, 33.8 tok/s, 1 s
[strata] done: 55 tokens in 2 s (35.4 tok/s) (stop, cancel=False)
[strata] done: 10 tokens in 0 s (35.6 tok/s) (stop, cancel=False)
.[strata] parallel: the engine refused slot 1 (BGEN: no such free slot (--batch 2) or a bad max_new); trying another slot (1/6) (issue #1994)
[strata] parallel: the engine refused slot 1 (BGEN: no such free slot (--batch 2) or a bad max_new); trying another slot (2/6) (issue #1994)
[strata] parallel: the engine refused slot 1 (BGEN: no such free slot (--batch 2) or a bad max_new); trying another slot (3/6) (issue #1994)
[strata] parallel: the engine refused slot 1 (BGEN: no such free slot (--batch 2) or a bad max_new); trying another slot (4/6) (issue #1994)
[strata] parallel: the engine refused slot 1 (BGEN: no such free slot (--batch 2) or a bad max_new); trying another slot (5/6) (issue #1994)
[strata] parallel: the engine refused slot 1 (BGEN: no such free slot (--batch 2) or a bad max_new); trying another slot (6/6) (issue #1994)
[strata] parallel: the engine refused slot 1 (BGEN: no such free slot (--batch 2) or a bad max_new); trying another slot (7/6) (issue #1994)
[strata] done: 0 tokens in 0 s (0.0 tok/s) (length, cancel=False)
[strata] answering: 34 of max 64 tokens, 33.9 tok/s, 1 s
[strata] done: 55 tokens in 2 s (35.2 tok/s) (stop, cancel=False)
[strata] done: 10 tokens in 0 s (37.7 tok/s) (stop, cancel=False)
.[strata] done: 10 tokens in 0 s (35.7 tok/s) (stop, cancel=False)
[strata] done: 10 tokens in 1 s (35.0 tok/s) (stop, cancel=False)
[strata] answering: 32 of max 64 tokens, 31.8 tok/s, 1 s
[strata] done: 55 tokens in 2 s (34.1 tok/s) (stop, cancel=False)
.[strata] answering: 34 of max 64 tokens, 34.2 tok/s, 1 s
[strata] answering: 33 of max 64 tokens, 36.2 tok/s, 1 s
[strata] done: 55 tokens in 2 s (35.2 tok/s) (stop, cancel=False)
[strata] done: 55 tokens in 2 s (36.7 tok/s) (stop, cancel=False)
.[strata] starting the engine: reading the model's weights ...
.[strata] parallel requests: 4 asked, the engine runs 2 (its log says why)
.[strata] parallel requests: 4 asked, the engine runs one at a time (its log says why)
[strata] done: 10 tokens in 0 s (35.6 tok/s) (stop, cancel=False)
.[strata] done: 10 tokens in 0 s (36.4 tok/s) (stop, cancel=False)
[strata] answering: 35 of max 200 tokens, 35.1 tok/s, 1 s
[strata] done: 55 tokens in 2 s (35.0 tok/s) (stop, cancel=False)
.[strata] done: 10 tokens in 0 s (35.4 tok/s) (stop, cancel=False)
[strata] answering: 33 of max 200 tokens, 33.4 tok/s, 1 s
[strata] done: 55 tokens in 2 s (34.1 tok/s) (stop, cancel=False)
.[strata] reading the prompt: 2,304 of 3,037 tokens, 1 s so far
[strata] answering: 1 of max 64 tokens, 1.4 tok/s, 2 s
[strata] reading the prompt: 32 of 3,037 tokens, 3 s so far
[strata] answering: 8 of max 64 tokens, 4.7 tok/s, 3 s
[strata] done: 10 tokens in 3 s (5.5 tok/s) (stop, cancel=False)
[strata] reading the prompt: 2,336 of 3,037 tokens, 4 s so far
[strata] done: 10 tokens in 4 s (35.0 tok/s) (stop, cancel=False)
.[strata] reading the prompt: 2,560 of 3,037 tokens, 1 s so far
[strata] answering: 1 of max 64 tokens, 0.9 tok/s, 2 s
[strata] reading the prompt: 2,560 of 3,037 tokens, 4 s so far
[strata] answering: 3 of max 64 tokens, 1.2 tok/s, 4 s
[strata] done: 10 tokens in 4 s (3.5 tok/s) (stop, cancel=False)
[strata] done: 10 tokens in 4 s (35.4 tok/s) (stop, cancel=False)
.[strata] the engine's logits became non-finite before the first token (#879); it dropped its cached state: sending the request again once
[strata] done: 10 tokens in 0 s (38.6 tok/s) (stop, cancel=False)
[strata] the engine's logits became non-finite before the first token (#879); it dropped its cached state: sending the request again once
[strata] done: 10 tokens in 0 s (36.4 tok/s) (stop, cancel=False)
[strata] answering: 34 of max 64 tokens, 33.7 tok/s, 1 s
[strata] done: 55 tokens in 2 s (34.4 tok/s) (stop, cancel=False)
[strata] the engine's logits became non-finite after 2 tokens (#879): the reply ends here as "length"; the engine dropped its cached state, so the next request reads its prompt from the start
[strata] done: 2 tokens in 0 s (24.6 tok/s) (length, cancel=False)
[strata] answering: 34 of max 64 tokens, 33.9 tok/s, 1 s
[strata] done: 55 tokens in 2 s (35.2 tok/s) (stop, cancel=False)
.[strata] starting the engine: reading the model's weights ...
[strata] answering: 36 of max 64 tokens, 35.5 tok/s, 1 s
[strata] answering: 35 of max 64 tokens, 37.5 tok/s, 1 s
[strata] done: 55 tokens in 2 s (35.1 tok/s) (stop, cancel=False)
[strata] done: 55 tokens in 2 s (36.4 tok/s) (stop, cancel=False)
.[strata] done: 10 tokens in 0 s (37.7 tok/s) (stop, cancel=False)
.[strata] done: 10 tokens in 0 s (37.6 tok/s) (stop, cancel=False)
.[strata] parallel requests: 1 asked, the engine runs one at a time (its log says why)
[strata] done: 10 tokens in 0 s (36.4 tok/s) (stop, cancel=False)
.[strata] done: 9 tokens in 0 s (34.9 tok/s) (stop, cancel=False)
[strata] done: 10 tokens in 0 s (37.3 tok/s) (stop, cancel=False)
.[strata] done: 10 tokens in 0 s (37.4 tok/s) (stop, cancel=False)
.[strata] reading the prompt: 2,560 of 3,037 tokens, 1 s so far
[strata] reading the prompt: 2,560 of 3,037 tokens, 2 s so far
[strata] answering: 2 of max 64 tokens, 1.7 tok/s, 2 s
[strata] done: 10 tokens in 3 s (6.3 tok/s) (stop, cancel=False)
[strata] done: 10 tokens in 3 s (37.5 tok/s) (stop, cancel=False)
.[strata] reading the prompt: 768 of 3,037 tokens, 1 s so far
[strata] reading the prompt: 32 of 3,037 tokens, 2 s so far
[strata] answering: 2 of max 64 tokens, 23.4 tok/s, 2 s
[strata] done: 10 tokens in 3 s (18.8 tok/s) (stop, cancel=False)
[strata] reading the prompt: 2,304 of 3,037 tokens, 3 s so far
[strata] reading the prompt: 32 of 43 tokens, 3 s so far
[strata] done: 10 tokens in 3 s (36.9 tok/s) (stop, cancel=False)
[strata] done: 10 tokens in 3 s (31.8 tok/s) (stop, cancel=False)
.........[strata] answering: 36 of max 64 tokens, 36.9 tok/s, 1 s
[strata] answering: 37 of max 64 tokens, 37.5 tok/s, 1 s
[strata] answering: 38 of max 64 tokens, 38.2 tok/s, 1 s
[strata] done: 51 tokens in 1 s (38.4 tok/s) (stop, cancel=False)
[strata] done: 51 tokens in 1 s (37.8 tok/s) (stop, cancel=False)
[strata] done: 51 tokens in 1 s (36.9 tok/s) (stop, cancel=False)
.[strata] done: 22 tokens in 0 s (167772.2 tok/s) (stop, cancel=False)
.....[strata] done: 3 tokens in 0 s (10672.5 tok/s) (stop, cancel=False)
...[strata] done: 0 tokens in 1 s (0.0 tok/s) (cancel, cancel=True)
[strata] done: 1 tokens in 0 s (7145.3 tok/s) (length, cancel=False)
.[strata] done: 0 tokens in 1 s (0.0 tok/s) (cancel, cancel=True)
[strata] done: 1 tokens in 1 s (5622.4 tok/s) (length, cancel=False)
.[strata] done: 0 tokens in 1 s (0.0 tok/s) (cancel, cancel=True)
[strata] done: 1 tokens in 0 s (7307.1 tok/s) (length, cancel=False)
[strata] done: 0 tokens in 1 s (0.0 tok/s) (cancel, cancel=True)
[strata] done: 1 tokens in 1 s (5592.4 tok/s) (length, cancel=False)
[strata] done: 0 tokens in 1 s (0.0 tok/s) (cancel, cancel=True)
[strata] done: 1 tokens in 0 s (6932.7 tok/s) (length, cancel=False)
[strata] done: 0 tokens in 1 s (0.0 tok/s) (cancel, cancel=True)
[strata] done: 1 tokens in 1 s (5915.8 tok/s) (length, cancel=False)
[strata] done: 0 tokens in 1 s (0.0 tok/s) (cancel, cancel=True)
[strata] done: 1 tokens in 0 s (5745.6 tok/s) (length, cancel=False)
[strata] done: 0 tokens in 1 s (0.0 tok/s) (cancel, cancel=True)
[strata] answering: 1 of max 1 tokens, 161319.4 tok/s, 1 s
[strata] done: 1 tokens in 1 s (4424.4 tok/s) (length, cancel=False)
[strata] done: 0 tokens in 1 s (0.0 tok/s) (cancel, cancel=True)
[strata] done: 1 tokens in 1 s (6017.7 tok/s) (length, cancel=False)
[strata] done: 0 tokens in 1 s (0.0 tok/s) (cancel, cancel=True)
[strata] done: 1 tokens in 0 s (6668.2 tok/s) (length, cancel=False)
[strata] done: 0 tokens in 1 s (0.0 tok/s) (cancel, cancel=True)
[strata] answering: 1 of max 1 tokens, 161319.4 tok/s, 1 s
[strata] done: 1 tokens in 1 s (4401.2 tok/s) (length, cancel=False)
[strata] done: 0 tokens in 1 s (0.0 tok/s) (cancel, cancel=True)
[strata] done: 1 tokens in 0 s (12052.6 tok/s) (length, cancel=False)
[strata] done: 0 tokens in 1 s (0.0 tok/s) (cancel, cancel=True)
[strata] answering: 1 of max 1 tokens, 199728.8 tok/s, 1 s
[strata] done: 1 tokens in 1 s (4922.9 tok/s) (length, cancel=False)
...[strata] loading the model again (it was unloaded) ...
[strata] the engine did not start (try 1 of 3); again in 0 s
[strata] the engine did not start (try 2 of 3); again in 0 s
.[strata] loading the model again (it was unloaded) ...
[strata] the engine is running again
[strata] done: 1 tokens in 0 s (20068.4 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] the engine had stopped (exit code -9); starting it again (a minute or two) ...
[strata] the engine did not start (try 1 of 3); again in 0 s
[strata] the engine did not start (try 2 of 3); again in 0 s
..[strata] repeated reasoning detected at 2048 tokens (coverage=1.000); resuming the same output with the low-effort instruction (reasoning_loop_recovery)
[strata] done: 2086 tokens in 0 s (256300.1 tok/s) (stop, cancel=False)
.[strata] repeated reasoning detected at 2048 tokens (coverage=1.000); resuming the same output with the low-effort instruction (reasoning_loop_recovery)
[strata] done: 2071 tokens in 0 s (361301.2 tok/s) (stop, cancel=False)
.[strata] done: 1 tokens in 0 s (38479.9 tok/s) (cancel, cancel=True)
.[strata] done: 16384 tokens in 0 s (504418.7 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
.[strata] done: 28001 tokens in 0 s (516326.7 tok/s) (stop, cancel=False)
.[strata] repeated reasoning detected at 2048 tokens (coverage=1.000); resuming the same output with the low-effort instruction (reasoning_loop_recovery)
[strata] done: 2082 tokens in 0 s (232026.3 tok/s) (stop, cancel=False)
.[strata] done: 28001 tokens in 0 s (493975.7 tok/s) (stop, cancel=False)
.[strata] repeated reasoning detected at 2048 tokens (coverage=1.000); resuming the same output with the low-effort instruction (reasoning_loop_recovery)
[strata] done: 2106 tokens in 0 s (480274.3 tok/s) (stop, cancel=False)
.[strata] repeated reasoning detected at 2048 tokens (coverage=1.000); resuming the same output with the low-effort instruction (reasoning_loop_recovery)
[strata] done: 2086 tokens in 0 s (460611.6 tok/s) (stop, cancel=False)
..[strata] repeated reasoning detected at 2048 tokens (coverage=1.000); resuming the same output with the low-effort instruction (reasoning_loop_recovery)
[strata] done: 16384 tokens in 0 s (490629.1 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
.[strata] done: 28001 tokens in 0 s (426810.9 tok/s) (stop, cancel=False)
..[strata] the thinking repeated the same passages (coverage=1.000) at 2560 tokens: ended as "length" (reasoning_loop_recovery: "stop" in strata-<model>.json; remove it to turn this off)
[strata] done: 2560 tokens in 0 s (480916.3 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
.[strata] the thinking repeated the same passages (coverage=1.000) at 2048 tokens: ended as "length" (reasoning_loop_recovery: "stop" in strata-<model>.json; remove it to turn this off)
[strata] done: 2048 tokens in 0 s (467148.9 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
..................[strata] done: 116 tokens in 0 s (212555.4 tok/s) (stop, cancel=False)
[strata] tool calls inside the thinking: 1 read as calls, 0 kept as reasoning (quoted, or the turn did not end on a stop)
[strata] done: 116 tokens in 0 s (153627.8 tok/s) (stop, cancel=False)
[strata] tool calls inside the thinking: 1 read as calls, 0 kept as reasoning (quoted, or the turn did not end on a stop)
[strata] done: 116 tokens in 0 s (215569.0 tok/s) (stop, cancel=False)
[strata] tool calls inside the thinking: 1 read as calls, 0 kept as reasoning (quoted, or the turn did not end on a stop)
[strata] done: 116 tokens in 0 s (171075.7 tok/s) (stop, cancel=False)
[strata] tool calls inside the thinking: 1 read as calls, 0 kept as reasoning (quoted, or the turn did not end on a stop)
[strata] done: 116 tokens in 0 s (212092.1 tok/s) (stop, cancel=False)
[strata] tool calls inside the thinking: 1 read as calls, 0 kept as reasoning (quoted, or the turn did not end on a stop)
[strata] done: 116 tokens in 0 s (159155.8 tok/s) (stop, cancel=False)
[strata] tool calls inside the thinking: 1 read as calls, 0 kept as reasoning (quoted, or the turn did not end on a stop)
.[strata] done: 133 tokens in 0 s (95619.2 tok/s) (stop, cancel=False)
[strata] done: 133 tokens in 0 s (59477.8 tok/s) (stop, cancel=False)
[strata] done: 133 tokens in 0 s (109380.9 tok/s) (stop, cancel=False)
[strata] done: 133 tokens in 0 s (71692.9 tok/s) (stop, cancel=False)
[strata] done: 133 tokens in 0 s (110006.4 tok/s) (stop, cancel=False)
[strata] done: 133 tokens in 0 s (72007.5 tok/s) (stop, cancel=False)
[strata] done: 117 tokens in 0 s (95977.6 tok/s) (stop, cancel=False)
[strata] done: 117 tokens in 0 s (55556.8 tok/s) (stop, cancel=False)
[strata] done: 117 tokens in 0 s (105852.8 tok/s) (stop, cancel=False)
[strata] done: 117 tokens in 0 s (68991.1 tok/s) (stop, cancel=False)
[strata] done: 117 tokens in 0 s (105898.5 tok/s) (stop, cancel=False)
[strata] done: 117 tokens in 0 s (70609.1 tok/s) (stop, cancel=False)
[strata] done: 150 tokens in 0 s (107915.2 tok/s) (stop, cancel=False)
[strata] tool calls inside the thinking: 0 read as calls, 1 kept as reasoning (quoted, or the turn did not end on a stop)
[strata] done: 150 tokens in 0 s (83055.5 tok/s) (stop, cancel=False)
[strata] tool calls inside the thinking: 0 read as calls, 1 kept as reasoning (quoted, or the turn did not end on a stop)
[strata] done: 150 tokens in 0 s (118193.8 tok/s) (stop, cancel=False)
[strata] tool calls inside the thinking: 0 read as calls, 1 kept as reasoning (quoted, or the turn did not end on a stop)
[strata] done: 150 tokens in 0 s (89596.4 tok/s) (stop, cancel=False)
[strata] tool calls inside the thinking: 0 read as calls, 1 kept as reasoning (quoted, or the turn did not end on a stop)
[strata] done: 150 tokens in 0 s (124165.3 tok/s) (stop, cancel=False)
[strata] tool calls inside the thinking: 0 read as calls, 1 kept as reasoning (quoted, or the turn did not end on a stop)
[strata] done: 150 tokens in 0 s (96096.8 tok/s) (stop, cancel=False)
[strata] tool calls inside the thinking: 0 read as calls, 1 kept as reasoning (quoted, or the turn did not end on a stop)
[strata] done: 108 tokens in 0 s (120957.2 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] tool calls inside the thinking: 0 read as calls, 1 kept as reasoning (quoted, or the turn did not end on a stop)
[strata] done: 108 tokens in 0 s (100551.6 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] tool calls inside the thinking: 0 read as calls, 1 kept as reasoning (quoted, or the turn did not end on a stop)
[strata] done: 108 tokens in 0 s (121346.1 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] tool calls inside the thinking: 0 read as calls, 1 kept as reasoning (quoted, or the turn did not end on a stop)
[strata] done: 108 tokens in 0 s (111903.4 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] tool calls inside the thinking: 0 read as calls, 1 kept as reasoning (quoted, or the turn did not end on a stop)
[strata] done: 108 tokens in 0 s (134816.9 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] tool calls inside the thinking: 0 read as calls, 1 kept as reasoning (quoted, or the turn did not end on a stop)
[strata] done: 108 tokens in 0 s (110998.5 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] tool calls inside the thinking: 0 read as calls, 1 kept as reasoning (quoted, or the turn did not end on a stop)
[strata] done: 97 tokens in 0 s (128505.2 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] tool calls inside the thinking: 0 read as calls, 1 kept as reasoning (quoted, or the turn did not end on a stop)
[strata] done: 97 tokens in 0 s (114766.6 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] tool calls inside the thinking: 0 read as calls, 1 kept as reasoning (quoted, or the turn did not end on a stop)
[strata] done: 97 tokens in 0 s (146085.3 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] tool calls inside the thinking: 0 read as calls, 1 kept as reasoning (quoted, or the turn did not end on a stop)
[strata] done: 97 tokens in 0 s (135300.1 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] tool calls inside the thinking: 0 read as calls, 1 kept as reasoning (quoted, or the turn did not end on a stop)
[strata] done: 97 tokens in 0 s (144221.0 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] tool calls inside the thinking: 0 read as calls, 1 kept as reasoning (quoted, or the turn did not end on a stop)
[strata] done: 97 tokens in 0 s (143711.6 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] tool calls inside the thinking: 0 read as calls, 1 kept as reasoning (quoted, or the turn did not end on a stop)
.[strata] done: 134 tokens in 0 s (98103.8 tok/s) (stop, cancel=False)
[strata] done: 134 tokens in 0 s (59765.7 tok/s) (stop, cancel=False)
[strata] done: 134 tokens in 0 s (107381.9 tok/s) (stop, cancel=False)
[strata] done: 134 tokens in 0 s (73143.8 tok/s) (stop, cancel=False)
[strata] done: 134 tokens in 0 s (114235.1 tok/s) (stop, cancel=False)
[strata] done: 134 tokens in 0 s (73029.7 tok/s) (stop, cancel=False)
[strata] done: 121 tokens in 0 s (101848.4 tok/s) (stop, cancel=False)
[strata] done: 121 tokens in 0 s (64429.5 tok/s) (stop, cancel=False)
[strata] done: 121 tokens in 0 s (116374.9 tok/s) (stop, cancel=False)
[strata] done: 121 tokens in 0 s (76872.3 tok/s) (stop, cancel=False)
[strata] done: 121 tokens in 0 s (116135.2 tok/s) (stop, cancel=False)
[strata] done: 121 tokens in 0 s (73562.9 tok/s) (stop, cancel=False)
[strata] done: 116 tokens in 0 s (111336.2 tok/s) (stop, cancel=False)
[strata] done: 116 tokens in 0 s (94934.5 tok/s) (stop, cancel=False)
[strata] done: 116 tokens in 0 s (119572.2 tok/s) (stop, cancel=False)
[strata] done: 116 tokens in 0 s (95008.6 tok/s) (stop, cancel=False)
[strata] done: 116 tokens in 0 s (120311.4 tok/s) (stop, cancel=False)
[strata] done: 116 tokens in 0 s (95794.3 tok/s) (stop, cancel=False)
.....[strata] done: 121 tokens in 0 s (124634.3 tok/s) (stop, cancel=False)
[strata] tool calls inside the thinking: 1 read as calls, 0 kept as reasoning (quoted, or the turn did not end on a stop)
[strata] done: 121 tokens in 0 s (108142.1 tok/s) (stop, cancel=False)
[strata] tool calls inside the thinking: 1 read as calls, 0 kept as reasoning (quoted, or the turn did not end on a stop)
[strata] done: 121 tokens in 0 s (139387.7 tok/s) (stop, cancel=False)
[strata] tool calls inside the thinking: 1 read as calls, 0 kept as reasoning (quoted, or the turn did not end on a stop)
[strata] done: 121 tokens in 0 s (114821.4 tok/s) (stop, cancel=False)
[strata] tool calls inside the thinking: 1 read as calls, 0 kept as reasoning (quoted, or the turn did not end on a stop)
[strata] done: 121 tokens in 0 s (78769.3 tok/s) (stop, cancel=False)
[strata] tool calls inside the thinking: 1 read as calls, 0 kept as reasoning (quoted, or the turn did not end on a stop)
.............[strata] done: 119 tokens in 0 s (117440.5 tok/s) (length, cancel=False)
[strata] done: 119 tokens in 0 s (89065.3 tok/s) (length, cancel=False)
[strata] done: 119 tokens in 0 s (131209.8 tok/s) (length, cancel=False)
[strata] done: 119 tokens in 0 s (103124.4 tok/s) (length, cancel=False)
.[strata] done: 120 tokens in 0 s (96550.3 tok/s) (stop, cancel=False)
[strata] done: 120 tokens in 0 s (78790.9 tok/s) (stop, cancel=False)
[strata] done: 120 tokens in 0 s (110279.7 tok/s) (stop, cancel=False)
[strata] done: 120 tokens in 0 s (85264.5 tok/s) (stop, cancel=False)
.[strata] done: 147 tokens in 0 s (78184.5 tok/s) (stop, cancel=False)
[strata] done: 147 tokens in 0 s (71386.2 tok/s) (stop, cancel=False)
[strata] done: 147 tokens in 0 s (89904.2 tok/s) (stop, cancel=False)
[strata] done: 147 tokens in 0 s (83296.8 tok/s) (stop, cancel=False)
........[strata] done: 10 tokens in 0 s (37.8 tok/s) (stop, cancel=False)
[strata] done: 10 tokens in 1 s (37.3 tok/s) (stop, cancel=False)
.[strata] done: 10 tokens in 0 s (36.7 tok/s) (stop, cancel=False)
[strata] done: 10 tokens in 0 s (37.5 tok/s) (stop, cancel=False)
[strata] done: 10 tokens in 0 s (36.6 tok/s) (stop, cancel=False)
.[strata] done: 10 tokens in 0 s (36.8 tok/s) (stop, cancel=False)
[strata] done: 10 tokens in 0 s (36.1 tok/s) (stop, cancel=False)
..[strata] done: 10 tokens in 0 s (34.8 tok/s) (stop, cancel=False)
[strata] done: 10 tokens in 1 s (14.9 tok/s) (stop, cancel=False)
[strata] done: 10 tokens in 1 s (14.2 tok/s) (stop, cancel=False)
[strata] done: 10 tokens in 1 s (25.9 tok/s) (stop, cancel=False)
[strata] done: 10 tokens in 1 s (38.6 tok/s) (stop, cancel=False)
[strata] done: 10 tokens in 1 s (24.3 tok/s) (stop, cancel=False)
[strata] done: 10 tokens in 1 s (35.2 tok/s) (stop, cancel=False)
..........[strata] thinking budget reached (20 tokens): wrapping up the thinking
[strata] done: 112 tokens in 0 s (103221.7 tok/s) (stop, cancel=False), expert cache 88.9% hit
.[strata] thinking budget reached (20 tokens): wrapping up the thinking
[strata] done: 112 tokens in 0 s (65371.8 tok/s) (stop, cancel=False), expert cache 88.9% hit
.[strata] thinking budget reached (20 tokens): wrapping up the thinking
[strata] done: 98 tokens in 0 s (48945.2 tok/s) (cancel, cancel=True), expert cache 88.9% hit
.[strata] thinking budget reached (20 tokens): wrapping up the thinking
[strata] the continuation ended without a DONE line.  The next request starts the engine again.
[strata] done: 95 tokens in 0 s (53794.9 tok/s) (error, cancel=False), expert cache 90.0% hit
.[strata] thinking budget reached (20 tokens): wrapping up the thinking
[strata] done: 112 tokens in 0 s (96878.1 tok/s) (stop, cancel=False), expert cache 88.9% hit
.[strata] thinking budget reached (20 tokens): wrapping up the thinking
[strata] done: 112 tokens in 0 s (57873.9 tok/s) (stop, cancel=False), expert cache 88.9% hit
.[strata] thinking capped at 200 of max_tokens 400 to leave room for the answer (budget 10000)
[strata] done: 211 tokens in 0 s (68530.1 tok/s) (stop, cancel=False), expert cache 90.0% hit
....[strata] done: 8 tokens in 0 s (139810.1 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
...[strata] done: 8 tokens in 0 s (163680.2 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] done: 8 tokens in 0 s (159025.7 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] done: 8 tokens in 0 s (127100.1 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
.[strata] done: 8 tokens in 0 s (195083.9 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
...[strata] done: 8 tokens in 0 s (177536.7 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
...............s......[strata] 400 invalid request: Expecting property name enclosed in double quotes: line 1 column 2 (char 1)
.....................[strata] the engine stopped while this request waited; it was not sent. The usual cause is running out of RAM: Linux then ends the biggest program (check: sudo dmesg | grep -i -E 'killed process|out of memory'); Windows slows down instead. Close other programs or use a smaller model (Q2_0 / IQ2_XS). The next request starts the engine again.
[strata] the engine stopped while this request waited; it was not sent. The usual cause is running out of RAM: Linux then ends the biggest program (check: sudo dmesg | grep -i -E 'killed process|out of memory'); Windows slows down instead. Close other programs or use a smaller model (Q2_0 / IQ2_XS). The next request starts the engine again.
[strata] done: 0 tokens in 1 s (0.0 tok/s) (error, cancel=False)
[strata] done: 0 tokens in 1 s (0.0 tok/s) (error, cancel=False)
.[strata] the engine reported an error: refused: images are not enabled
[strata] done: 0 tokens in 0 s (0.0 tok/s) (error, cancel=False)
[strata] 400 invalid request: refused: images are not enabled
[strata] done: 10 tokens in 0 s (36.8 tok/s) (stop, cancel=False)
.[strata] the engine reported an error: refused: images are not enabled
[strata] done: 0 tokens in 0 s (0.0 tok/s) (error, cancel=False)
[strata] 400 invalid request: refused: images are not enabled
[strata] done: 10 tokens in 0 s (35.1 tok/s) (stop, cancel=False)
..[strata] the engine stopped unexpectedly (exit code -9). The usual cause is running out of RAM: Linux then ends the biggest program (check: sudo dmesg | grep -i -E 'killed process|out of memory'); Windows slows down instead. Close other programs or use a smaller model (Q2_0 / IQ2_XS). The next request starts the engine again.
[strata] done: 0 tokens in 0 s (0.0 tok/s) (error, cancel=False)
[strata] the engine had stopped (exit code -9); starting it again (a minute or two) ...
[strata] the engine is running again
[strata] done: 10 tokens in 0 s (34.3 tok/s) (stop, cancel=False)
.[strata] the engine stopped unexpectedly (exit code -9). The usual cause is running out of RAM: Linux then ends the biggest program (check: sudo dmesg | grep -i -E 'killed process|out of memory'); Windows slows down instead. Close other programs or use a smaller model (Q2_0 / IQ2_XS). The next request starts the engine again.
[strata] done: 0 tokens in 0 s (0.0 tok/s) (error, cancel=False)
[strata] the engine stopped unexpectedly (exit code -9). The usual cause is running out of RAM: Linux then ends the biggest program (check: sudo dmesg | grep -i -E 'killed process|out of memory'); Windows slows down instead. Close other programs or use a smaller model (Q2_0 / IQ2_XS). The next request starts the engine again.
[strata] the engine stopped while this request waited; it was not sent. The usual cause is running out of RAM: Linux then ends the biggest program (check: sudo dmesg | grep -i -E 'killed process|out of memory'); Windows slows down instead. Close other programs or use a smaller model (Q2_0 / IQ2_XS). The next request starts the engine again.
[strata] done: 2 tokens in 0 s (10.7 tok/s) (error, cancel=False)
[strata] done: 0 tokens in 0 s (0.0 tok/s) (error, cancel=False)
[strata] the engine had stopped (exit code -9); starting it again (a minute or two) ...
[strata] the engine is running again
[strata] done: 10 tokens in 0 s (38.8 tok/s) (stop, cancel=False)
.[strata] parallel requests: 4 asked, the engine runs one at a time (its log says why)
[strata] the engine had stopped (exit code -9); starting it again (a minute or two) ...
[strata] parallel requests: 4 asked, the engine runs one at a time (its log says why)
[strata] the engine is running again
[strata] done: 10 tokens in 0 s (37.5 tok/s) (stop, cancel=False)
.[strata] the engine stopped while this request waited; it was not sent. The usual cause is running out of RAM: Linux then ends the biggest program (check: sudo dmesg | grep -i -E 'killed process|out of memory'); Windows slows down instead. Close other programs or use a smaller model (Q2_0 / IQ2_XS). The next request starts the engine again.
[strata] the engine stopped while this request waited; it was not sent. The usual cause is running out of RAM: Linux then ends the biggest program (check: sudo dmesg | grep -i -E 'killed process|out of memory'); Windows slows down instead. Close other programs or use a smaller model (Q2_0 / IQ2_XS). The next request starts the engine again.
[strata] done: 0 tokens in 1 s (0.0 tok/s) (error, cancel=False)
[strata] the engine stopped while this request waited; it was not sent. The usual cause is running out of RAM: Linux then ends the biggest program (check: sudo dmesg | grep -i -E 'killed process|out of memory'); Windows slows down instead. Close other programs or use a smaller model (Q2_0 / IQ2_XS). The next request starts the engine again.
[strata] done: 0 tokens in 1 s (0.0 tok/s) (error, cancel=False)
[strata] done: 0 tokens in 1 s (0.0 tok/s) (error, cancel=False)
[strata] the engine had stopped (exit code -9); starting it again (a minute or two) ...
[strata] the engine is running again
[strata] done: 10 tokens in 0 s (35.9 tok/s) (stop, cancel=False)
.[strata] the engine stopped while this request waited; it was not sent. The usual cause is running out of RAM: Linux then ends the biggest program (check: sudo dmesg | grep -i -E 'killed process|out of memory'); Windows slows down instead. Close other programs or use a smaller model (Q2_0 / IQ2_XS). The next request starts the engine again.
[strata] the engine stopped while this request waited; it was not sent. The usual cause is running out of RAM: Linux then ends the biggest program (check: sudo dmesg | grep -i -E 'killed process|out of memory'); Windows slows down instead. Close other programs or use a smaller model (Q2_0 / IQ2_XS). The next request starts the engine again.
[strata] done: 0 tokens in 1 s (0.0 tok/s) (error, cancel=False)
[strata] the engine stopped while this request waited; it was not sent. The usual cause is running out of RAM: Linux then ends the biggest program (check: sudo dmesg | grep -i -E 'killed process|out of memory'); Windows slows down instead. Close other programs or use a smaller model (Q2_0 / IQ2_XS). The next request starts the engine again.
[strata] done: 0 tokens in 1 s (0.0 tok/s) (error, cancel=False)
[strata] done: 0 tokens in 1 s (0.0 tok/s) (error, cancel=False)
[strata] the engine had stopped (exit code -9); starting it again (a minute or two) ...
[strata] the engine is running again
[strata] done: 10 tokens in 0 s (37.5 tok/s) (stop, cancel=False)
.[strata] done: 10 tokens in 1 s (36.0 tok/s) (stop, cancel=False)
[strata] done: 10 tokens in 1 s (31.3 tok/s) (stop, cancel=False)
[strata] done: 10 tokens in 1 s (34.1 tok/s) (stop, cancel=False)
.[strata] done: 10 tokens in 1 s (27.3 tok/s) (stop, cancel=False)
[strata] done: 10 tokens in 1 s (35.4 tok/s) (stop, cancel=False)
[strata] done: 10 tokens in 1 s (30.6 tok/s) (stop, cancel=False)
.......................................[strata] model unloaded; the next request loads it again
..[strata] refused a request for Host 'rebind.example.com' from 127.0.0.1: not a name this server answers to (add it to "allowed_hosts" in the config or STRATA_ALLOWED_HOSTS, or set an API key)
....[strata] model unloaded; the next request loads it again
[strata] loading the model again (it was unloaded) ...
[strata] the engine is running again
...........[strata] done: 10 tokens in 0 s (117487.5 tok/s) (length, cancel=False)
[strata] done: 10 tokens in 0 s (131896.4 tok/s) (length, cancel=False)
[strata] done: 10 tokens in 0 s (158875.2 tok/s) (length, cancel=False)
..........[strata] done: 0 tokens in 1 s (0.0 tok/s) (cancel, cancel=True)
.[strata] done: 0 tokens in 1 s (0.0 tok/s) (cancel, cancel=True)
.[strata] 400 invalid request: tools[0] (f): "parameters" must be an object (the JSON schema of its parameters), not str
[strata] 400 invalid request: tools[0] (f): "parameters" must be an object (the JSON schema of its parameters), not list
[strata] 400 invalid request: tools[0] (f): "parameters" must be an object (the JSON schema of its parameters), not int
[strata] 400 invalid request: tools[0] (f): "input_schema" must be an object (the JSON schema of its parameters), not str
[strata] 400 invalid request: tools[0] (f): "input_schema" must be an object (the JSON schema of its parameters), not list
[strata] 400 invalid request: tools[0] (f): "input_schema" must be an object (the JSON schema of its parameters), not bool
[strata] done: 8 tokens in 0 s (151146.1 tok/s) (length, cancel=False)
[strata] done: 8 tokens in 0 s (159783.0 tok/s) (length, cancel=False)
[strata] done: 8 tokens in 0 s (173857.2 tok/s) (length, cancel=False)
.[strata] done: 12 tokens in 0 s (245520.2 tok/s) (stop, cancel=False)
..[strata] 400 invalid request: tools must be a list of tool objects, each {"type": "function", "function": {"name": ..., "parameters": {...}}}
[strata] 400 invalid request: tools must be a list of tool objects, each {"type": "function", "function": {"name": ..., "parameters": {...}}}
[strata] 400 invalid request: tools[0] has no name: each tool must be {"type": "function", "function": {"name": ..., "parameters": {...}}}
[strata] 400 invalid request: tools must be a list of tool objects, each {"type": "function", "function": {"name": ..., "parameters": {...}}}
[strata] 400 invalid request: tools[0] has no name: each tool must be {"type": "function", "function": {"name": ..., "parameters": {...}}}
[strata] 400 invalid request: tools[0] has no name: each tool must be {"type": "function", "function": {"name": ..., "parameters": {...}}}
[strata] 400 invalid request: tools must be a list of tool objects, each {"name": ..., "input_schema": {...}}
[strata] 400 invalid request: tools must be a list of tool objects, each {"name": ..., "input_schema": {...}}
[strata] 400 invalid request: tools[0] has no name: each tool must be {"name": ..., "input_schema": {...}}
[strata] 400 invalid request: tools must be a list of tool objects, each {"name": ..., "input_schema": {...}}
[strata] 400 invalid request: tools[0] has no name: each tool must be {"name": ..., "input_schema": {...}}
[strata] 400 invalid request: tools[0] has no name: each tool must be {"name": ..., "input_schema": {...}}
[strata] done: 8 tokens in 0 s (250406.2 tok/s) (length, cancel=False)
.[strata] done: 12 tokens in 0 s (294337.1 tok/s) (stop, cancel=False)
[strata] 400 invalid request: messages must be a list of objects
[strata] done: 12 tokens in 0 s (272063.0 tok/s) (stop, cancel=False)
[strata] 400 invalid request: messages must be a list of objects
..[strata] 400 invalid request: No user query found in messages.
[strata] done: 12 tokens in 0 s (284359.6 tok/s) (stop, cancel=False)
.[strata] done: 12 tokens in 0 s (292625.9 tok/s) (stop, cancel=False)
.[strata] done: 12 tokens in 0 s (266305.0 tok/s) (stop, cancel=False)
[strata] done: 12 tokens in 0 s (316551.2 tok/s) (stop, cancel=False)
[strata] done: 12 tokens in 0 s (266305.0 tok/s) (stop, cancel=False)
...[strata] done: 8 tokens in 0 s (258111.0 tok/s) (length, cancel=False)
[strata] done: 8 tokens in 0 s (277309.4 tok/s) (length, cancel=False)
[strata] done: 8 tokens in 0 s (264208.1 tok/s) (length, cancel=False)
[strata] done: 8 tokens in 0 s (332222.1 tok/s) (length, cancel=False)
[strata] done: 8 tokens in 0 s (319566.0 tok/s) (length, cancel=False)
[strata] done: 8 tokens in 0 s (266305.0 tok/s) (length, cancel=False)
[strata] done: 8 tokens in 0 s (335544.3 tok/s) (length, cancel=False)
........[strata] done: 13 tokens in 0 s (354064.6 tok/s) (stop, cancel=False)
.[strata] done: 13 tokens in 0 s (232025.3 tok/s) (stop, cancel=False)
....[strata] done: 10 tokens in 0 s (137068.8 tok/s) (length, cancel=False)
[strata] done: 10 tokens in 0 s (158875.2 tok/s) (length, cancel=False)
[strata] done: 10 tokens in 0 s (145131.6 tok/s) (length, cancel=False), expert cache 90.0% hit
.........[strata] the engine reported an error: verify: layer 31 never rang (an illegal memory access was encountered)
[strata] done: 0 tokens in 0 s (0.0 tok/s) (error, cancel=False)
[strata] the engine reported an error: verify: layer 31 never rang (an illegal memory access was encountered)
[strata] done: 0 tokens in 0 s (0.0 tok/s) (error, cancel=False)
.[strata] the engine stopped unexpectedly (exit code -9).  The next request starts the engine again.
[strata] done: 5 tokens in 0 s (45491.4 tok/s) (error, cancel=False)
[strata] the engine had stopped (exit code None); starting it again (a minute or two) ...
[strata] the engine is running again
[strata] done: 50 tokens in 0 s (137789.2 tok/s) (length, cancel=False)
.[strata] done: 50 tokens in 0 s (139624.0 tok/s) (length, cancel=False)
.[strata] done: 1 tokens in 0 s (91180.5 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] 400 invalid request: request exceeds the context window: prompt (4088 tokens) leaves no room to answer in the context (4096); requests are never truncated
.[strata] done: 2011 tokens in 0 s (19299.7 tok/s) (stop, cancel=False)
[strata] done: 2011 tokens in 0 s (21506.2 tok/s) (stop, cancel=False)
.[strata] done: 5 tokens in 0 s (153076.8 tok/s) (length, cancel=False)
.[strata] done: 120 tokens in 0 s (73476.9 tok/s) (stop, cancel=False)
[strata] done: 120 tokens in 0 s (62461.7 tok/s) (stop, cancel=False)
.[strata] done: 272 tokens in 0 s (63578.4 tok/s) (stop, cancel=False)
[strata] done: 272 tokens in 0 s (56581.4 tok/s) (stop, cancel=False)
[strata] done: 272 tokens in 0 s (76382.6 tok/s) (stop, cancel=False)
[strata] done: 272 tokens in 0 s (65551.1 tok/s) (stop, cancel=False)
[strata] done: 203 tokens in 0 s (106844.5 tok/s) (stop, cancel=False)
[strata] done: 203 tokens in 0 s (78286.5 tok/s) (stop, cancel=False)
[strata] done: 203 tokens in 0 s (122369.0 tok/s) (stop, cancel=False)
[strata] done: 203 tokens in 0 s (79790.4 tok/s) (stop, cancel=False)
[strata] tool_choice {"type": "tool", "name": "nope"} is not supported here (or names no tool of the request): the model decides, as with "auto"
[strata] done: 203 tokens in 0 s (116269.8 tok/s) (stop, cancel=False)
[strata] tool_choice {"type": "tool", "name": "nope"} is not supported here (or names no tool of the request): the model decides, as with "auto"
[strata] done: 203 tokens in 0 s (81759.5 tok/s) (stop, cancel=False)
.[strata] done: 203 tokens in 0 s (69687.7 tok/s) (stop, cancel=False)
[strata] done: 203 tokens in 0 s (79574.2 tok/s) (stop, cancel=False)
[strata] done: 203 tokens in 0 s (88269.1 tok/s) (stop, cancel=False)
.[strata] done: 272 tokens in 0 s (62246.3 tok/s) (stop, cancel=False)
[strata] done: 272 tokens in 0 s (52624.7 tok/s) (stop, cancel=False)
[strata] done: 272 tokens in 0 s (74702.1 tok/s) (stop, cancel=False)
[strata] done: 272 tokens in 0 s (61402.1 tok/s) (stop, cancel=False)
.[strata] thinking budget reached (20 tokens): wrapping up the thinking
[strata] done: 181 tokens in 0 s (78499.5 tok/s) (stop, cancel=False)
.[strata] done: 272 tokens in 0 s (60378.4 tok/s) (stop, cancel=False)
.[strata] tool_choice {"type": "function", "function": {"name": "nope"}} is not supported here (or names no tool of the request): the model decides, as with "auto"
[strata] done: 203 tokens in 0 s (81720.3 tok/s) (stop, cancel=False)
[strata] tool_choice {"type": "function"} is not supported here (or names no tool of the request): the model decides, as with "auto"
[strata] done: 203 tokens in 0 s (89119.1 tok/s) (stop, cancel=False)
[strata] tool_choice "required" is not supported here (or names no tool of the request): the model decides, as with "auto"
[strata] done: 203 tokens in 0 s (98058.7 tok/s) (stop, cancel=False)
[strata] tool_choice {"type": "banana"} is not supported here (or names no tool of the request): the model decides, as with "auto"
[strata] done: 203 tokens in 0 s (94636.4 tok/s) (stop, cancel=False)
[strata] tool_choice "sometimes" is not supported here (or names no tool of the request): the model decides, as with "auto"
[strata] done: 203 tokens in 0 s (99120.3 tok/s) (stop, cancel=False)
.[strata] done: 64 tokens in 0 s (138869.9 tok/s) (stop, cancel=False)
[strata] done: 64 tokens in 0 s (114033.8 tok/s) (stop, cancel=False)
[strata] done: 56 tokens in 0 s (165292.8 tok/s) (stop, cancel=False)
[strata] done: 56 tokens in 0 s (126688.8 tok/s) (stop, cancel=False)
.[strata] layer split: card order 2,0 (the faster card last; "gpu_order": "as_given" keeps 0,2, #1352)
[strata] layer split: card order 2,0 (the faster card last; "gpu_order": "as_given" keeps 0,2, #1352)
[strata] layer split: card order 2,0 (the faster card last; "gpu_order": "as_given" keeps 0,2, #1352)
[strata] layer split: card order 0,2,1 (the faster card last; "gpu_order": "as_given" keeps 0,1,2, #1352)
[strata] layer split: keeping card order 0,1 - the faster card has less VRAM than the one the split ends on (12288 vs 22528 MiB, #1576)
[strata] layer split: card order 1,0 (the faster card last; "gpu_order": "as_given" keeps 0,1, #1352)
[strata] layer split: card order 1,0 (the faster card last; "gpu_order": "as_given" keeps 0,1, #1352)
[strata] layer split: card order 1,0 (the faster card last; "gpu_order": "as_given" keeps 0,1, #1352)
[strata] layer split: keeping card order 0,1,2 - the faster card has less VRAM than the one the split ends on (12288 vs 24576 MiB, #1576)
.../Users/nikoveit/Documents/deepseek-harness/strata-work/strata-rebuild/serve/server.py:2880: ResourceWarning: unclosed file <_io.TextIOWrapper name='/var/folders/jr/5sbp8w_97bgdkv1n_tr64_840000gn/T/tmpjprfvv4t/0/properties' mode='r' encoding='UTF-8'>
  props = dict(line.split() for line in open(os.path.join(root, str(n), "properties")) if len(line.split()) == 2)
ResourceWarning: Enable tracemalloc to get the object allocation traceback
/Users/nikoveit/Documents/deepseek-harness/strata-work/strata-rebuild/serve/server.py:2880: ResourceWarning: unclosed file <_io.TextIOWrapper name='/var/folders/jr/5sbp8w_97bgdkv1n_tr64_840000gn/T/tmpjprfvv4t/1/properties' mode='r' encoding='UTF-8'>
  props = dict(line.split() for line in open(os.path.join(root, str(n), "properties")) if len(line.split()) == 2)
ResourceWarning: Enable tracemalloc to get the object allocation traceback
/Users/nikoveit/Documents/deepseek-harness/strata-work/strata-rebuild/serve/server.py:2880: ResourceWarning: unclosed file <_io.TextIOWrapper name='/var/folders/jr/5sbp8w_97bgdkv1n_tr64_840000gn/T/tmpjprfvv4t/2/properties' mode='r' encoding='UTF-8'>
  props = dict(line.split() for line in open(os.path.join(root, str(n), "properties")) if len(line.split()) == 2)
ResourceWarning: Enable tracemalloc to get the object allocation traceback
/Users/nikoveit/Documents/deepseek-harness/strata-work/strata-rebuild/serve/server.py:2880: ResourceWarning: unclosed file <_io.TextIOWrapper name='/var/folders/jr/5sbp8w_97bgdkv1n_tr64_840000gn/T/tmpjprfvv4t/3/properties' mode='r' encoding='UTF-8'>
  props = dict(line.split() for line in open(os.path.join(root, str(n), "properties")) if len(line.split()) == 2)
ResourceWarning: Enable tracemalloc to get the object allocation traceback
..[strata] done: 54 tokens in 0 s (173159.3 tok/s) (stop, cancel=False)
.[strata] done: 3 tokens in 0 s (187804.7 tok/s) (stop, cancel=False)
..strata serve: AMD: HIP_PATH=Z:\definitely\not\here does not exist: not passed to the engine
.strata serve: AMD: HIP_PATH=/var/folders/jr/5sbp8w_97bgdkv1n_tr64_840000gn/T/tmpf3q7dk5o/TheRock/build does not exist: not passed to the engine
strata serve: AMD: HIP_DEVICE_LIB_PATH=/var/folders/jr/5sbp8w_97bgdkv1n_tr64_840000gn/T/tmpf3q7dk5o/TheRock/build does not exist: not passed to the engine
.strata serve: AMD: TEMP=/var/folders/jr/5sbp8w_97bgdkv1n_tr64_840000gn/T/tmp439y3i92/no/such/dir is not writable: using /private/var/folders/jr/5sbp8w_97bgdkv1n_tr64_840000gn/T/tmp439y3i92/tmp
.[strata] a picture a tool returned was left out of the prompt: this server has no image encoder
[strata] a picture a tool returned was left out of the prompt: this server has no image encoder
[strata] a picture a tool returned was left out of the prompt: this image format needs Pillow
[strata] a picture a tool returned was left out of the prompt: the image URL could not be read
....[strata] refused an API request from the web page 'https://evil.example' (no API key; add its host to "allowed_hosts" or its origin to "cors_origins" in the config)
[strata] 400 invalid request: a web page of another origin cannot have a file on this computer read as an image: send it as a data: URL (or add the page's origin to the config's trusted_origins)
[strata] 400 invalid request: a web page of another origin cannot have a file on this computer read as an image: send it as a data: URL (or add the page's origin to the config's trusted_origins)
[strata] 400 invalid request: a web page of another origin cannot have a file on this computer read as an image: send it as a data: URL (or add the page's origin to the config's trusted_origins)
[strata] 400 invalid request: a web page of another origin cannot have a file on this computer read as an image: send it as a data: URL (or add the page's origin to the config's trusted_origins)
[strata] done: 8 tokens in 0 s (322638.8 tok/s) (length, cancel=False)
[strata] done: 8 tokens in 0 s (345922.0 tok/s) (length, cancel=False)
[strata] done: 8 tokens in 0 s (332222.1 tok/s) (length, cancel=False)
[strata] done: 8 tokens in 0 s (364722.1 tok/s) (length, cancel=False)
...........................[strata] the engine stopped unexpectedly (exit code -9).  The next request starts the engine again.
[strata] done: 3 tokens in 0 s (33288.1 tok/s) (error, cancel=False)
..[strata] done: 30 tokens in 1 s (38.4 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
.[strata] the engine said nothing for 1 s during the request; the server ended the engine. The engine and the server lost step (issue #481; a very slow PC can raise "engine_silence_s" in the config, 0 = wait forever). If it happens again, please add the end of the engine log to github.com/Niko1221/Strata/issues/481. The next request starts the engine again.
[strata] done: 1 tokens in 1 s (1.9 tok/s) (error, cancel=False)
[strata] the engine had stopped (exit code -9); starting it again (a minute or two) ...
[strata] the engine is running again
[strata] done: 2 tokens in 0 s (26630.5 tok/s) (length, cancel=False)
.[strata] the engine said nothing for 1 s during the request; the server ended the engine. The engine and the server lost step (issue #481; a very slow PC can raise "engine_silence_s" in the config, 0 = wait forever). If it happens again, please add the end of the engine log to github.com/Niko1221/Strata/issues/481. The next request starts the engine again.
[strata] done: 1 tokens in 1 s (1.9 tok/s) (error, cancel=False)
[strata] the engine had stopped (exit code -9); starting it again (a minute or two) ...
[strata] the engine is running again
[strata] done: 2 tokens in 0 s (20360.7 tok/s) (length, cancel=False)
.[strata] the engine did not finish the request after it was stopped (STOP) within 0 s; the server ended the engine. The engine and the server lost step (issue #481; a very slow PC can raise "engine_silence_s" in the config, 0 = wait forever). If it happens again, please add the end of the engine log to github.com/Niko1221/Strata/issues/481. The next request starts the engine again.
[strata] done: 2 tokens in 1 s (3.9 tok/s) (error, cancel=False)
[strata] the engine had stopped (exit code -9); starting it again (a minute or two) ...
[strata] the engine is running again
[strata] done: 2 tokens in 0 s (26296.6 tok/s) (length, cancel=False)
..[strata] done: 8 tokens in 0 s (174762.7 tok/s) (length, cancel=False)
..[strata] done: 50 tokens in 0 s (277768.5 tok/s) (length, cancel=False)
[strata] done: 50 tokens in 0 s (274856.1 tok/s) (length, cancel=False)
[strata] done: 50 tokens in 0 s (277768.5 tok/s) (length, cancel=False)
[strata] done: 50 tokens in 0 s (274856.1 tok/s) (length, cancel=False)
[strata] done: 1500 tokens in 0 s (28221.5 tok/s) (length, cancel=False)
[strata] done: 1500 tokens in 0 s (27466.9 tok/s) (length, cancel=False)
.[strata] 400 invalid request: request exceeds the context window: prompt (246 tokens) + max tokens (4096) exceeds the context (4096); requests are never truncated. Send a smaller max_tokens (at most 3842 here), or add "fit_max_tokens": true to the model's strata-<model>.json to shorten it to the room left (#545)
[strata] 400 invalid request: request exceeds the context window: prompt (246 tokens) + max tokens (4096) exceeds the context (4096); requests are never truncated. Send a smaller max_tokens (at most 3842 here), or add "fit_max_tokens": true to the model's strata-<model>.json to shorten it to the room left (#545)
..[strata] done: 2011 tokens in 0 s (21369.3 tok/s) (stop, cancel=False)
[strata] done: 2011 tokens in 0 s (21225.6 tok/s) (stop, cancel=False)
[strata] done: 2011 tokens in 0 s (21048.8 tok/s) (stop, cancel=False)
[strata] done: 2011 tokens in 0 s (21424.1 tok/s) (stop, cancel=False)
[strata] done: 2011 tokens in 0 s (21260.9 tok/s) (stop, cancel=False)
[strata] done: 2011 tokens in 0 s (21122.8 tok/s) (stop, cancel=False)
[strata] done: 2011 tokens in 0 s (20995.6 tok/s) (stop, cancel=False)
[strata] done: 2011 tokens in 0 s (21279.0 tok/s) (stop, cancel=False)
[strata] done: 2011 tokens in 0 s (20948.1 tok/s) (stop, cancel=False)
[strata] done: 2011 tokens in 0 s (21201.2 tok/s) (stop, cancel=False)
.[strata] done: 1 tokens in 0 s (174762.7 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] done: 1 tokens in 0 s (167772.2 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] done: 5 tokens in 0 s (327680.0 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] 400 invalid request: request exceeds the context window: prompt (4088 tokens) leaves no room to answer in the context (4096); requests are never truncated
[strata] done: 1 tokens in 0 s (161319.4 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] done: 5 tokens in 0 s (355449.5 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
[strata] 400 invalid request: request exceeds the context window: prompt (4088 tokens) leaves no room to answer in the context (4096); requests are never truncated
..[strata] done: 8 tokens in 0 s (234646.4 tok/s) (length, cancel=False)
[strata] done: 8 tokens in 0 s (277309.4 tok/s) (length, cancel=False)
[strata] done: 8 tokens in 0 s (268435.5 tok/s) (length, cancel=False)
[strata] done: 8 tokens in 0 s (275036.3 tok/s) (length, cancel=False)
[strata] done: 8 tokens in 0 s (286790.0 tok/s) (length, cancel=False)
[strata] done: 8 tokens in 0 s (129055.5 tok/s) (length, cancel=False)
[strata] done: 8 tokens in 0 s (160547.5 tok/s) (length, cancel=False)
[strata] done: 8 tokens in 0 s (170327.1 tok/s) (length, cancel=False)
[strata] done: 8 tokens in 0 s (170327.1 tok/s) (length, cancel=False)
[strata] done: 8 tokens in 0 s (156796.4 tok/s) (length, cancel=False)
[strata] done: 8 tokens in 0 s (173857.2 tok/s) (length, cancel=False)
[strata] done: 8 tokens in 0 s (172961.0 tok/s) (length, cancel=False)
.........[strata] the config has a "vision" section but no --vision in its args: added --vision and --vram-reserve-mib 700 (run setup again with --vision to write them)
[strata] the config has a "vision" section but no --vision in its args: added --vision (run setup again with --vision to write them)
[strata] the config has a "vision" section but no --vision in its args: added --vision (run setup again with --vision to write them)
........[strata] done: 10 tokens in 0 s (175493.9 tok/s) (length, cancel=False)
[strata] done: 10 tokens in 0 s (203607.0 tok/s) (length, cancel=False)
.[strata] done: 40 tokens in 0 s (90297.2 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
.[strata] done: 40 tokens in 0 s (63191.0 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
....[strata] done: 18 tokens in 0 s (177641.1 tok/s) (stop, cancel=False)
.[strata] done: 28 tokens in 0 s (301903.6 tok/s) (stop, cancel=False)
.[strata] done: 36 tokens in 0 s (160632.9 tok/s) (stop, cancel=False)
.[strata] the reply ended inside its thinking with no answer: closing the thinking once and continuing (reasoning_close_retry)
[strata] done: 64 tokens in 0 s (194518.4 tok/s) (stop, cancel=False)
....[strata] done: 13 tokens in 0 s (190650.2 tok/s) (stop, cancel=False)
/opt/homebrew/Cellar/python@3.11/3.11.15/Frameworks/Python.framework/Versions/3.11/lib/python3.11/unittest/case.py:579: ResourceWarning: unclosed <socket.socket fd=3, family=2, type=1, proto=0, laddr=('127.0.0.1', 51562)>
  if method() is not None:
ResourceWarning: Enable tracemalloc to get the object allocation traceback
..[strata] the engine did not start (try 1 of 3); again in 0 s
...........[strata] other apps now use the Chat settings: temperature=0.3
[strata] done: 16 tokens in 0 s (291777.7 tok/s) (stop, cancel=False)
.[strata] other apps use their own settings again
.[strata] other apps now use the Chat settings: temperature=0.3
[strata] other apps use their own settings again
[strata] done: 16 tokens in 0 s (319566.0 tok/s) (stop, cancel=False)
.[strata] other apps now use the Chat settings: temperature=1.0
.[strata] other apps now use the Chat settings: temperature=0.3, top_p=0.9, top_k=10, seed=7, max_tokens=77, reasoning_effort=low, experimental_speed_projection=False
[strata] done: 16 tokens in 0 s (327360.3 tok/s) (stop, cancel=False)
[strata] done: 5 tokens in 0 s (249661.0 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
..[strata] other apps now use the Chat settings: temperature=1.0
.[strata] model unloaded; the next request loads it again
[strata] before loading: /Users/nikoveit/Documents/deepseek-harness/strata-work/python311/bin/python -c import sys; sys.exit(1)
[strata] the before_load command failed (it exited with code 1); loading anyway
[strata] loading the model again (it was unloaded) ...
[strata] the engine is running again
[strata] done: 13 tokens in 0 s (188020.5 tok/s) (stop, cancel=False)
.[strata] model unloaded; the next request loads it again
[strata] before loading: /Users/nikoveit/Documents/deepseek-harness/strata-work/python311/bin/python -c open('/var/folders/jr/5sbp8w_97bgdkv1n_tr64_840000gn/T/tmpb0hq1fdv/ran', 'w').close()
[strata] loading the model again (it was unloaded) ...
[strata] the engine is running again
[strata] done: 13 tokens in 0 s (160370.4 tok/s) (stop, cancel=False)
.[strata] model unloaded; the next request loads it again
[strata] before loading: /Users/nikoveit/Documents/deepseek-harness/strata-work/python311/bin/python -c import sys; sys.exit(7)
[strata] the before_load command failed (it exited with code 7); the model stays unloaded and this request is answered 503 - try again (before_load_strict)
.[strata] model unloaded; the next request loads it again
[strata] before loading: /Users/nikoveit/Documents/deepseek-harness/strata-work/python311/bin/python -c import time; time.sleep(30)
[strata] the before_load command failed (it did not finish in 0.5 s (before_load_timeout_s)); the model stays unloaded and this request is answered 503 - try again (before_load_strict)
.[strata] model unloaded; the next request loads it again
[strata] before loading: /Users/nikoveit/Documents/deepseek-harness/strata-work/python311/bin/python -c import sys; sys.exit(7)
[strata] the before_load command failed (it exited with code 7); checking the free VRAM
[strata] the before_load command failed (it exited with code 7), but 20000 MiB of VRAM is free: loading
[strata] loading the model again (it was unloaded) ...
[strata] the engine is running again
[strata] done: 13 tokens in 0 s (194042.5 tok/s) (stop, cancel=False)
.[strata] model unloaded; the next request loads it again
[strata] before loading: /Users/nikoveit/Documents/deepseek-harness/strata-work/python311/bin/python -c import sys; sys.exit(3)
[strata] the before_load command failed (it exited with code 3); checking the free VRAM
[strata] the before_load command failed (it exited with code 3) and only 2000 MiB of VRAM is free (the model needs 8000): not loading; 503
[strata] before loading: /Users/nikoveit/Documents/deepseek-harness/strata-work/python311/bin/python -c import sys; sys.exit(3)
[strata] the before_load command failed (it exited with code 3); checking the free VRAM
[strata] the before_load command failed (it exited with code 3), but 20000 MiB of VRAM is free: loading
[strata] loading the model again (it was unloaded) ...
[strata] the engine is running again
[strata] done: 13 tokens in 0 s (128598.9 tok/s) (stop, cancel=False)
.[strata] model unloaded; the next request loads it again
[strata] before loading: /Users/nikoveit/Documents/deepseek-harness/strata-work/python311/bin/python -c import sys; sys.exit(7)
[strata] the before_load command failed (it exited with code 7); loading anyway (set min_free_vram_mib to have the free VRAM checked, or before_load_strict to refuse)
[strata] loading the model again (it was unloaded) ...
[strata] the engine is running again
[strata] done: 13 tokens in 0 s (199728.8 tok/s) (stop, cancel=False)
.[strata] the model unloads after 1 s without requests
[strata] model unloaded after 1 s idle; the next request loads it again
[strata] loading the model again (it was unloaded) ...
[strata] the engine is running again
[strata] done: 13 tokens in 0 s (48858.4 tok/s) (stop, cancel=False)
.[strata] model unloaded; the next request loads it again
[strata] loading the model again (it was unloaded) ...
[strata] the engine is running again
.[strata] model unloaded; the next request loads it again
[strata] model unloaded after 1 s idle; the next request loads it again
[strata] loading the model again (it was unloaded) ...
[strata] the engine is running again
[strata] done: 13 tokens in 0 s (86003.1 tok/s) (stop, cancel=False)
.[strata] model unloaded; the next request loads it again
[strata] loading the model again (it was unloaded) ...
[strata] the engine is running again
[strata] done: 13 tokens in 0 s (171465.3 tok/s) (stop, cancel=False)
...[strata] model unloaded; the next request loads it again
[strata] loading the model again (it was unloaded) ...
[strata] the engine is running again
[strata] done: 13 tokens in 0 s (180549.5 tok/s) (stop, cancel=False)
..[strata] model unloaded; the next request loads it again
.[strata] model unloaded; the next request loads it again
[strata] starting the vision encoder ...
[strata] loading the model again (it was unloaded) ...
[strata] the engine is running again
[strata] done: 13 tokens in 0 s (169335.3 tok/s) (stop, cancel=False)
.[strata] the engine has said nothing for 1 s but is still working; it is not ended (the limit is engine_silence_s). If it is stuck, "engine_silence_s" can be set lower.
...[strata] the engine has said nothing for 1 s but is still working; it is not ended (the limit is engine_silence_s). If it is stuck, "engine_silence_s" can be set lower.
...................[strata] done: 15 tokens in 0 s (63294.3 tok/s) (disconnect, cancel=False)
[strata] done: 20 tokens in 0 s (181571.6 tok/s) (length, cancel=False)
..[strata] done: 36 tokens in 0 s (128725.4 tok/s) (stop, cancel=False)
[strata] done: 36 tokens in 0 s (73015.0 tok/s) (stop, cancel=False)
[strata] done: 36 tokens in 0 s (142313.8 tok/s) (stop, cancel=False)
[strata] done: 36 tokens in 0 s (75762.6 tok/s) (stop, cancel=False)
.[strata] 400 invalid request: stop takes at most 4 strings
[strata] 400 invalid request: stop must be a string or a list of strings
[strata] 400 invalid request: stop_sequences must be a list of strings
[strata] 400 invalid request: stop_sequences must be a list of strings
.[strata] done: 19 tokens in 0 s (184471.7 tok/s) (stop, cancel=False)
[strata] done: 19 tokens in 0 s (81567.8 tok/s) (stop, cancel=False)
[strata] done: 19 tokens in 0 s (182779.3 tok/s) (stop, cancel=False)
[strata] done: 19 tokens in 0 s (86340.0 tok/s) (stop, cancel=False)
..[strata] done: 36 tokens in 0 s (181921.6 tok/s) (stop, cancel=False)
[strata] done: 36 tokens in 0 s (179116.2 tok/s) (stop, cancel=False)
[strata] done: 36 tokens in 0 s (168145.8 tok/s) (stop, cancel=False)
[strata] done: 36 tokens in 0 s (85259.7 tok/s) (stop, cancel=False)
[strata] done: 36 tokens in 0 s (97040.5 tok/s) (stop, cancel=False)
[strata] done: 36 tokens in 0 s (85939.1 tok/s) (stop, cancel=False)
[strata] done: 36 tokens in 0 s (196608.0 tok/s) (stop, cancel=False)
[strata] done: 36 tokens in 0 s (196608.0 tok/s) (stop, cancel=False)
[strata] done: 36 tokens in 0 s (182581.6 tok/s) (stop, cancel=False)
[strata] done: 36 tokens in 0 s (120314.7 tok/s) (stop, cancel=False)
[strata] done: 36 tokens in 0 s (118800.1 tok/s) (stop, cancel=False)
[strata] done: 36 tokens in 0 s (82964.3 tok/s) (stop, cancel=False)
.[strata] done: 29 tokens in 0 s (205464.2 tok/s) (stop, cancel=False)
.[strata] done: 24 tokens in 0 s (198156.1 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (121281.1 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (196992.8 tok/s) (stop, cancel=False)
[strata] done: 24 tokens in 0 s (131242.9 tok/s) (stop, cancel=False)
...[strata] 400 invalid request: reasoning_budget_tokens='lots': expected a whole number of tokens (0: no budget)
[strata] 400 invalid request: reasoning_budget_tokens=2.5: expected a whole number of tokens (0: no budget)
[strata] 400 invalid request: reasoning_budget_tokens=True: expected a whole number of tokens (0: no budget)
[strata] 400 invalid request: reasoning_budget_tokens=[1]: expected a whole number of tokens (0: no budget)
..[strata] thinking capped at 200 of max_tokens 400 to leave room for the answer (budget 10000)
[strata] done: 211 tokens in 0 s (76306.1 tok/s) (stop, cancel=False)
....[strata] thinking budget reached (20 tokens): wrapping up the thinking
[strata] done: 112 tokens in 0 s (102478.6 tok/s) (stop, cancel=False)
[strata] done: 211 tokens in 0 s (77204.8 tok/s) (stop, cancel=False)
.[strata] thinking budget reached (20 tokens): wrapping up the thinking
[strata] done: 108 tokens in 0 s (102369.5 tok/s) (stop, cancel=False)
.[strata] thinking budget reached (30 tokens): wrapping up the thinking
[strata] done: 122 tokens in 0 s (60902.8 tok/s) (stop, cancel=False)
.[strata] done: 20 tokens in 0 s (109511.9 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
.[strata] done: 211 tokens in 0 s (76122.3 tok/s) (stop, cancel=False)
.[strata] thinking budget reached (20 tokens): wrapping up the thinking
[strata] done: 112 tokens in 0 s (102568.1 tok/s) (stop, cancel=False)
.[strata] thinking budget reached (20 tokens): wrapping up the thinking
[strata] done: 112 tokens in 0 s (60771.3 tok/s) (stop, cancel=False)
[strata] thinking budget reached (20 tokens): wrapping up the thinking
[strata] done: 112 tokens in 0 s (102300.1 tok/s) (stop, cancel=False)
.[strata] thinking budget reached (20 tokens): wrapping up the thinking
[strata] done: 112 tokens in 0 s (102211.1 tok/s) (stop, cancel=False)
[strata] done: 211 tokens in 0 s (76922.9 tok/s) (stop, cancel=False)
..[strata] done: 17 tokens in 0 s (163539.4 tok/s) (stop, cancel=False)
......................[strata] done: 119 tokens in 0 s (153340.1 tok/s) (length, cancel=False)
[strata] done: 119 tokens in 0 s (112465.6 tok/s) (length, cancel=False)
[strata] done: 119 tokens in 0 s (161007.2 tok/s) (length, cancel=False)
[strata] done: 119 tokens in 0 s (126841.7 tok/s) (length, cancel=False)
.[strata] done: 120 tokens in 0 s (85293.4 tok/s) (stop, cancel=False)
[strata] done: 120 tokens in 0 s (68609.1 tok/s) (stop, cancel=False)
[strata] done: 120 tokens in 0 s (108379.9 tok/s) (stop, cancel=False)
[strata] done: 120 tokens in 0 s (87335.8 tok/s) (stop, cancel=False)
.[strata] done: 147 tokens in 0 s (75735.5 tok/s) (stop, cancel=False)
[strata] done: 147 tokens in 0 s (71919.1 tok/s) (stop, cancel=False)
[strata] done: 147 tokens in 0 s (89694.9 tok/s) (stop, cancel=False)
[strata] done: 147 tokens in 0 s (83285.5 tok/s) (stop, cancel=False)
.......[strata] done: 13 tokens in 0 s (131072.0 tok/s) (stop, cancel=False), expert cache 90.0% hit
...[strata] done: 5 tokens in 0 s (216201.2 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
.[strata] done: 13 tokens in 0 s (67734.1 tok/s) (stop, cancel=False), expert cache 90.0% hit
.[strata] done: 13 tokens in 0 s (63035.8 tok/s) (stop, cancel=False), expert cache 90.0% hit
..[strata] done: 13 tokens in 0 s (73386.2 tok/s) (stop, cancel=False), expert cache 90.0% hit
.[strata] done: 13 tokens in 0 s (109051.9 tok/s) (stop, cancel=False), expert cache 90.0% hit
.............[strata] done: 5 tokens in 0 s (249661.0 tok/s) (length, cancel=False)
[strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer
............[strata] SAVE waiting for RAM after cache reclaim: need=1125 MiB, limit=30s; floor unchanged
.[strata] SAVE waiting for RAM after cache reclaim: need=1125 MiB, limit=30s; floor unchanged
..............................................[strata] done: 255 tokens in 0 s (63941.4 tok/s) (stop, cancel=False)
[strata] done: 282 tokens in 0 s (67758.6 tok/s) (stop, cancel=False)
.ss[strata] 400 invalid request: response_format must be an object
[strata] 400 invalid request: response_format.type must be text, json_object or json_schema
[strata] 400 invalid request: response_format.json_schema needs a name
[strata] 400 invalid request: response_format.json_schema.strict must be boolean
[strata] 400 invalid request: structured response_format with tools/MCP is not supported
[strata] 400 invalid request: structured response_format with tools/MCP is not supported
[strata] 400 invalid request: send a JSON object
.[strata] done: 13 tokens in 0 s (145791.3 tok/s) (stop, cancel=False)
[strata] done: 3 tokens in 0 s (136770.8 tok/s) (stop, cancel=False)
[strata] done: 10 tokens in 0 s (184771.1 tok/s) (stop, cancel=False)
[strata] done: 14 tokens in 0 s (187007.2 tok/s) (stop, cancel=False)
[strata] done: 12 tokens in 0 s (187804.7 tok/s) (stop, cancel=False)
[strata] done: 15 tokens in 0 s (210416.6 tok/s) (stop, cancel=False)
[strata] done: 6 tokens in 0 s (187804.7 tok/s) (stop, cancel=False)
[strata] done: 15 tokens in 0 s (197224.3 tok/s) (stop, cancel=False)
[strata] done: 32 tokens in 0 s (191466.1 tok/s) (stop, cancel=False)
[strata] done: 5 tokens in 0 s (171897.7 tok/s) (length, cancel=False)
[strata] done: 7 tokens in 0 s (201096.8 tok/s) (stop, cancel=False)
.[strata] 400 invalid request: response_format.json_schema needs a schema object
[strata] done: 21 tokens in 0 s (166818.9 tok/s) (stop, cancel=False)
.[strata] done: 40 tokens in 0 s (145006.2 tok/s) (stop, cancel=False)
[strata] done: 7 tokens in 0 s (166818.9 tok/s) (stop, cancel=False)
[strata] done: 40 tokens in 0 s (150468.3 tok/s) (stop, cancel=False)
[strata] done: 7 tokens in 0 s (159565.9 tok/s) (stop, cancel=False)
[strata] done: 40 tokens in 0 s (153356.6 tok/s) (stop, cancel=False)
[strata] done: 7 tokens in 0 s (170698.4 tok/s) (stop, cancel=False)
[strata] done: 40 tokens in 0 s (169466.8 tok/s) (stop, cancel=False)
[strata] done: 7 tokens in 0 s (162210.7 tok/s) (stop, cancel=False)
[strata] done: 40 tokens in 0 s (167270.3 tok/s) (stop, cancel=False)
[strata] done: 7 tokens in 0 s (180123.5 tok/s) (stop, cancel=False)
.[strata] 400 invalid request: response_format schema must accept only JSON objects at its root (type object, or anyOf/oneOf of object schemas)
[strata] 400 invalid request: response_format schema must accept only JSON objects at its root (type object, or anyOf/oneOf of object schemas)
[strata] 400 invalid request: response_format schema must accept only JSON objects at its root (type object, or anyOf/oneOf of object schemas)
[strata] 400 invalid request: response_format schema must accept only JSON objects at its root (type object, or anyOf/oneOf of object schemas)
[strata] 400 invalid request: response_format schema must accept only JSON objects at its root (type object, or anyOf/oneOf of object schemas)
[strata] 400 invalid request: response_format schema must accept only JSON objects at its root (type object, or anyOf/oneOf of object schemas)
[strata] 400 invalid request: response_format schema must accept only JSON objects at its root (type object, or anyOf/oneOf of object schemas)
[strata] 400 invalid request: response_format schema must accept only JSON objects at its root (type object, or anyOf/oneOf of object schemas)
[strata] 400 invalid request: response_format schema must accept only JSON objects at its root (type object, or anyOf/oneOf of object schemas)
[strata] 400 invalid request: response_format schema must accept only JSON objects at its root (type object, or anyOf/oneOf of object schemas)
[strata] 400 invalid request: response_format schema must accept only JSON objects at its root (type object, or anyOf/oneOf of object schemas)
..[strata] done: 255 tokens in 0 s (65284.0 tok/s) (stop, cancel=False)
[strata] done: 26 tokens in 0 s (179067.2 tok/s) (stop, cancel=False)
[strata] done: 7 tokens in 0 s (175809.1 tok/s) (stop, cancel=False)
[strata] done: 13 tokens in 0 s (206537.7 tok/s) (stop, cancel=False)
.......[strata] VRAM: 4000 MiB free, expert cache 2000 of 6000 MiB (100 experts)
[strata] images: the expert cache keeps 2048 MiB free for the image encoder (500 of 6000 MiB left)
[strata] images: the image encoder started in 0.0 s
[strata] VRAM: 3048 MiB free, expert cache 2952 of 6000 MiB (952 experts)
[strata] images: the image encoder stopped after 60 s without a picture; the expert cache took its VRAM back (5000 of 6000 MiB)
.[strata] images: the expert cache did not make room for the image encoder (VRAM needs an engine started with --vram-elastic (one NVIDIA GPU, --serve)); starting it anyway
[strata] images: the image encoder started in 0.0 s
.[strata] images: the expert cache keeps 2048 MiB free for the image encoder (3952 of 6000 MiB left)
[strata] images: the image encoder started in 0.0 s
[strata] images: the image encoder stopped after 60 s without a picture; the expert cache took its VRAM back (6000 of 6000 MiB)
[strata] images: the expert cache keeps 2048 MiB free for the image encoder (3952 of 6000 MiB left)
[strata] images: the image encoder started in 0.0 s
.[strata] images: the expert cache keeps 2048 MiB free for the image encoder (3952 of 6000 MiB left)
[strata] images: the image encoder started in 0.0 s
[strata] model unloaded; the next request loads it again
..[strata] images: the expert cache keeps 2048 MiB free for the image encoder (3952 of 6000 MiB left)
[strata] images: the image encoder started in 0.0 s
.....[strata] 400 invalid request: VRAM needs an engine started with --vram-elastic (one NVIDIA GPU, --serve)
.[strata] 400 invalid request: reserve_mib: a whole number of MiB (0 or more), or null for the start's
[strata] 400 invalid request: reserve_mib: a whole number of MiB (0 or more), or null for the start's
[strata] 400 invalid request: reserve_mib: a whole number of MiB (0 or more), or null for the start's
[strata] 400 invalid request: reserve_mib: a whole number of MiB (0 or more), or null for the start's
[strata] refused an API request from the web page 'https://other.example' (no API key; add its host to "allowed_hosts" or its origin to "cors_origins" in the config)
.[strata] VRAM: 4000 MiB free, expert cache 2000 of 6000 MiB (100 experts)
[strata] VRAM: 700 MiB free, expert cache 5300 of 6000 MiB (3300 experts)
.[strata] loading the model again (it was unloaded) ...
[strata] the engine is running again
.sss
----------------------------------------------------------------------
Ran 801 tests in 316.284s

OK (skipped=11)
