Commit Graph

3 Commits

Author SHA1 Message Date
leejet
2e79a82f85 refactor: reorganize code and use c api (#133) 2024-01-01 16:22:18 +08:00
leejet
8f6b4a39d6 fix: enhance the tokenizer's handing of Unicode (#120) 2023-12-21 00:22:03 +08:00
leejet
d7af2c2ba9 feat: load weights from safetensors and ckpt (#101) 2023-12-03 15:47:20 +08:00