mirror of
https://github.com/linkedin/Liger-Kernel.git
synced 2026-10-12 02:17:47 +00:00
add todo
This commit is contained in:
@@ -78,6 +78,10 @@ apply_liger_kernel_to_llama()
|
||||
model = transformers.AutoModelForCausalLM.from_pretrained("<some llama model>")
|
||||
```
|
||||
|
||||
[TODO] huggingface trainer
|
||||
[TODO] lightning trainer
|
||||
|
||||
|
||||
### 2. 🧩 Compose Your Own Model
|
||||
|
||||
```python
|
||||
@@ -97,6 +101,9 @@ loss = loss_fn(model.weight, input, target)
|
||||
loss.backward()
|
||||
```
|
||||
|
||||
[TODO] multi-head llama3 model
|
||||
[TODO] large vocab model
|
||||
|
||||
## ⚙️ Note on ML Compiler
|
||||
|
||||
### 1. ⚡ Torch Compile
|
||||
|
||||
Reference in New Issue
Block a user