bf7480d042
Release 2.0.4-beta.9: Audio transcription via mlx-audio
...
Major Features:
- Audio transcription via mlx-audio backend (Whisper, >10min duration)
- OpenAI /v1/audio/transcriptions endpoint
- Memory Gate System (Vision: 8GB, Audio: 4GB)
- Config-based backend routing (ADR-020)
- Benchmark toolchain (memmon/memplot, Schema v0.2.2)
Key Fixes:
- EuroLLM tokenizer decoding
- Vision-model text-only routing regression
- Multimodal model context length detection
- Memory cleanup bug (mx.metal.clear_cache)
- Orphan process bug
Test Results:
- Unit tests: 647 passed, 11 skipped (Python 3.10-3.12)
- wet-umbrella: 171 passed total
See CHANGELOG.md for complete details and known issues.
2026-02-04 03:10:30 +01:00
8c873530da
feat: Experimental Voxtral audio support
...
Add experimental support for Voxtral audio models:
- Add "voxtral" to AUDIO_MODEL_TYPES
- Increase audio limit: 5MB → 50MB (CLI + Server)
- Gemma-3n: ~30s duration (188 tokens @ 6.25 tokens/s)
- Voxtral: >10min duration (>2000 tokens)
- Token count is real constraint, file size is sanity check
Requirements:
- mlx-vlm with Voxtral support (upstream merge pending)
- mistral-common for tekken tokenizer
Status: EXPERIMENTAL - pending mlx-vlm upstream integration
2026-01-26 17:20:50 +01:00
e8b10ea10b
Release 2.0.4-beta.8: Audio transcription support (experimental)
...
Audio input via --audio flag (CLI) and input_audio content type (Server API).
Uses mlx-vlm native audio processing. ~30s duration limit (model constraint).
Currently only Gemma-3n tested (requires --repair-index fix).
Also includes:
- SERVER-HANDBOOK compliance (image limits, validation error envelopes)
- Dependency updates: mlx>=0.30.0, mlx-lm>=0.30.0, huggingface-hub>=1.0.0
- Audio E2E test suite + ADR-019
2026-01-23 20:20:59 +01:00
53d9cca82d
Release 2.0.4-beta.6: Local workspace workflow + Vision batch processing
...
- Complete local development cycle: clone → repair → run/show/server on
workspace paths without HuggingFace round-trips
- Vision processing now defaults to safe chunking (one image at a time,
prevents OOM + hallucination)
- Resumable clone with --force-resume and deterministic temp cache naming
- Improved test infrastructure (umbrella marker convention)
- 161 Wet Umbrella tests passing including new Vision→Geo pipe integration tests
See CHANGELOG.md for complete details.
2026-01-07 17:11:07 +01:00
86f669dc82
Release 2.0.4-beta.1: Vision + Pipes + Memory
...
- Vision Support (Issue #45 ): CLI + Server with OpenAI-compatible image API, EXIF metadata
- Unix Pipes (ADR-014): stdin support, isatty detection, SIGPIPE handling
- Memory-Aware Loading (ADR-016): Pre-load checks with >70% RAM warnings
- Python 3.9-3.14: Full compatibility verified (476-485 tests passing)
- Fixed: --log-json regression (Issue #44 ), Vision multimodal history filtering
See CHANGELOG.md for complete details.
2025-12-16 19:35:30 +01:00
The BROKE Cluster Team