 The BROKE Cluster Team
|
fb54f59cd4
|
Release 2.0.0-beta.6: Stop token & compatibility bug fixes
Fixes Issue #32 (generic multi-EOS detection) and Issue #37 (model detection)
- Generic stop token detection: Multi-EOS models (MXFP4, Qwen, Llama) now use eos_token_ids Set instead of
model-specific workarounds
- Private/org MLX model detection: `mlxk run` now works outside `mlx-community/*` namespace
- Commit-pinned compatibility checks: Models with `@commit_hash` validated before inference
- Packaging dependencies: Fixed `pip install -e .` requirements
- ADR-009: Stop Token Detection Fix (generic approach + test strategy)
- ADR-011: E2E Live Test Architecture (planned)
See CHANGELOG.md and TESTING.md for details.
|
2025-10-24 15:46:42 +02:00 |
|