mirror of
https://github.com/linkedin/Liger-Kernel.git
synced 2026-10-12 02:17:47 +00:00
MilkCloudsandTcc0403
f7c17b586a
## Summary This PR adds support for SmolVLM2 to liger-kernel. SmolVLM2 is present on transformers after 4.50.0 version: https://github.com/huggingface/transformers/releases/tag/v4.50.0 ## Testing Done <!-- Replace BLANK with your device type. For example, A100-80G-PCIe Complete the following tasks before sending your PR, and replace `[ ]` with `[x]` to indicate you have done them. --> - Hardware Type: A100 - [x] run `make test` to ensure correctness ``` (4480 durations < 0.005s hidden. Use -vv to show these durations.) =============================================================================================== 2142 passed, 215 skipped, 45 warnings in 1941.33s (0:32:21) =============================================================================================== ``` - [x] run `make checkstyle` to ensure code style - [x] run `make test-convergence` to ensure convergence ``` (35 durations < 0.005s hidden. Use -vv to show these durations.) ================================================================================================================= short test summary info ================================================================================================================= FAILED test/convergence/bf16/test_mini_models_with_logits.py::test_mini_model[mini_glm4v_moe-32-1e-05-dtype17-0.01-0.01-0.1-0.01-0.01-0.01] - AssertionError: [Loss]Number of mismatched elements: 2 =================================================================================================== 1 failed, 22 passed, 1 warning in 262.08s (0:04:22) =================================================================================================== make: *** [Makefile:36: test-convergence] Error 1 ``` There's no test failure for smolvlm2! --------- Co-authored-by: Tcc0403 <[email protected]>