Files
mlx-knife/pytest.ini
T
The BROKE Cluster Team d32d3185dd Release 2.0.2: Test infrastructure hardening & empirical validation
Stable release completing Issue #32 recovery plan - all tests passing.

Bug Fixes:
- Test collection regression (E2E suite parametrization)
- Stop token ordering (batch + streaming modes)
- E2E test temperature flakiness (deterministic sampling)
- Web API framework detection (PR #42 by @limey, fixes #41)
- E2E test marker fix (show_model_portfolio diagnostics)

Architecture:
- mlx-lm API evaluation: Keep manual text-based implementation
- Stop token workarounds: All 3 validated (Phi-3, DeepSeek-R1, GPT-oss)

Testing:
- Portfolio Discovery: 73/81 tests, 17 models, 0 failures
- E2E infrastructure hardened (TOKENIZERS, polling, gc.collect())
- Multi-Python validation: 3.9-3.13 passing

Documentation:
- ADR-009 Outstanding Work completed + Implementation Plan removed
- TESTING-DETAILS.md: Portfolio Discovery + E2E Architecture updated
- CHANGELOG.md: Complete 2.0.2 stable release notes
2025-11-15 22:10:08 +01:00

20 lines
945 B
INI

[pytest]
testpaths = tests_2.0
python_files = test_*.py
python_classes = Test*
python_functions = test_*
markers =
spec: JSON API contract tests (current spec only)
wet: Opt-in live tests against Hugging Face (require env)
live_push: Alias for wet; push live tests (require env)
live_list: Alias for wet; list human live tests (require env)
live_clone: Alias for wet; clone live tests (require env, ADR-007 Phase 1)
live_run: Opt-in run command tests with real models (require user cache model)
live_stop_tokens: Opt-in stop token tests with real models (Issue #32, ADR-009)
live_e2e: E2E tests with real models and server (require HF_HOME, ADR-011)
show_model_portfolio: Display E2E test portfolio (convenience, no testing)
issue27: Real-model health policy tests (opt-in; read-only user cache)
slow: Tests that take >1 minute to run
filterwarnings =
ignore::urllib3.exceptions.NotOpenSSLWarning