mirror of
https://github.com/linkedin/Liger-Kernel.git
synced 2026-10-12 02:17:47 +00:00
9b10f48f17
## Summary Add monkeypatch to support [Llama 3.2-Vision](https://github.com/huggingface/transformers/pull/33703/files#diff-d804e851851cdebeb8048938f1f8beec1cfa78bf7b1f06af86faa450f9d18def) models. ## Details Llama 3.2-Vision is a multimodal model. It is also only available in transformers>=4.45.0. Torchvision is required to run the multimodal tests for Llama 3.2-Vision (the image processor requires it). ## Testing Done - Hardware Type: RTX 4090 - [x] run `make test` to ensure correctness - [x] run `make checkstyle` to ensure code style - [x] run `make test-convergence` to ensure convergence --------- Co-authored-by: Shao Tang <[email protected]> Co-authored-by: Steven Shimizu <[email protected]> Co-authored-by: shivam15s <[email protected]>