mirror of
https://github.com/cloudstack-llc/mlx-knife.git
synced 2026-07-19 22:53:30 -04:00
The BROKE Cluster Team
57bf6d86be
Major Features Added: • Complete run command implementation with interactive/single-shot modes • MLXRunner core engine ported from 1.x with modular architecture • OpenAI-compatible server with SIGINT-robust supervisor mode • Experimental push feature properly isolated behind environment variable Key Improvements: - Full feature parity with 1.1.1 stable releases - Enhanced human output formatting across all commands - Clean separation of stable (184 tests) vs experimental features - Updated demo GIF showcasing improved 2.0 interface Fixes: - Pull operation cache pollution (Issue #30) with preflight access checks - Test stability improvements across all environments Architecture: - Modular runner design with focused helper modules - Thread-safe model loading and memory management - stable testing across Python 3.9-3.13 Ready for use as comprehensive 1.x alternative.
50 lines
902 B
VHS
50 lines
902 B
VHS
# MLX Knife 2.0 Demo – Enhanced Human Output
|
||
Output mlxk-demo.gif
|
||
Set FontFamily "Menlo"
|
||
Set FontSize 13
|
||
Set Width 800
|
||
Set Height 500
|
||
Set Padding 12
|
||
Set Margin 0
|
||
Set Theme OneHalfDark
|
||
Set Framerate 18
|
||
Set PlaybackSpeed 1.0
|
||
Set TypingSpeed 50ms
|
||
|
||
# Intro
|
||
Type "echo 'MLX Knife 2.0 – quick demo'"
|
||
Enter
|
||
Sleep 1200ms
|
||
|
||
# 1) Health-Listing (improved 2.0 output)
|
||
Type "mlxk2 list --health"
|
||
Enter
|
||
Sleep 1600ms
|
||
|
||
# 2) Start interactive run (2.0 run command)
|
||
Type "mlxk2 run gpt-oss-20b-MXFP4-Q8"
|
||
Enter
|
||
Sleep 2500ms
|
||
|
||
# 3) Enter prompt (show streaming)
|
||
Type "Explain in three sentences how beam search works in LLMs."
|
||
Enter
|
||
Sleep 3500ms
|
||
|
||
# 4) Leave chat
|
||
Type "exit"
|
||
Enter
|
||
Sleep 1000ms
|
||
|
||
# 5) Show model details (enhanced formatting)
|
||
Type "mlxk2 show gpt-oss-20b-MXFP4-Q8"
|
||
Enter
|
||
Sleep 1400ms
|
||
|
||
# 6) Show JSON output capability
|
||
Type "mlxk2 show gpt-oss-20b-MXFP4-Q8 --json"
|
||
Enter
|
||
Sleep 1500ms
|
||
|
||
# Ende
|
||
Sleep 2000ms |