Three major bug fixes for production readiness:
- Issue #21: Fix crash on fresh installations (empty cache directory)
- Issue #22: Suppress urllib3 LibreSSL warnings on macOS Python 3.9
- Issue #23: Fix double rm execution bug - models now deleted in single command
Test improvements:
- 140/140 tests passing (up from 137)
- Added real integration tests for lock cleanup
- Fixed unit tests broken by path corrections
All known cache management issues resolved for stable release.
Issues Resolved:
• Issue #15: Token limits vs natural stop tokens race condition - FIXED
• Issue #16: Interactive vs server token limit policies - FIXED
Major Improvements:
• Automatic optimal token limits - no configuration needed
• Manual --max-tokens control still available when desired
• Eliminates old hardcoded 500/2000 token restrictions
• Performance gains: Up to 524x improvement for large context models
• Enhanced web client with model capabilities display and better UX
Additional Enhancements:
• Enhanced /v1/models API with context_length field
• Comprehensive test expansion: 114 → 131 tests (131/131 passing)
• Python 3.9-3.13 compatibility verified
Known Issues (Beta Status):
• Server deadlock possible under extreme concurrent model loading stress
• Workaround: Avoid simultaneous heavy model operations
- Fix#1: Partial name filtering for `mlxk list` command
- Fix#2: Fuzzy matching for single-model commands
- Fix#3: Default behavior for `mlxk health` (no --all flag required)
- Expanded test suite to 104/104 tests passing
The BROKE Team