mlx-knife

mirror of https://github.com/cloudstack-llc/mlx-knife.git synced 2026-07-18 12:46:54 -04:00

Files

T

The BROKE Team 74239c4e43 Release MLX Knife 1.1.0-beta1 - Dynamic Token Limits & Enhanced Web Client

Issues Resolved:
  • Issue #15: Token limits vs natural stop tokens race condition - FIXED
  • Issue #16: Interactive vs server token limit policies - FIXED

  Major Improvements:
  • Automatic optimal token limits - no configuration needed
  • Manual --max-tokens control still available when desired
  • Eliminates old hardcoded 500/2000 token restrictions
  • Performance gains: Up to 524x improvement for large context models
  • Enhanced web client with model capabilities display and better UX

  Additional Enhancements:
  • Enhanced /v1/models API with context_length field
  • Comprehensive test expansion: 114 → 131 tests (131/131 passing)
  • Python 3.9-3.13 compatibility verified

  Known Issues (Beta Status):
  • Server deadlock possible under extreme concurrent model loading stress
  • Workaround: Avoid simultaneous heavy model operations

2025-08-21 17:36:44 +02:00

__init__.py

Release MLX Knife 1.1.0-beta1 - Dynamic Token Limits & Enhanced Web Client

2025-08-21 17:36:44 +02:00

cache_utils.py

Release MLX Knife 1.0.3 - GitHub Issues Implementation & Enhanced User Experience

2025-08-18 20:21:43 +02:00

cli.py

Release MLX Knife 1.1.0-beta1 - Dynamic Token Limits & Enhanced Web Client

2025-08-21 17:36:44 +02:00

hf_download.py

Release MLX Knife 1.0.3 - GitHub Issues Implementation & Enhanced User Experience