ollama/ollama-python
1
0
Fork 0
mirror of https://github.com/ollama/ollama-python.git synced 2026-07-21 09:05:23 -04:00
Code Issues 101 Packages Projects Releases 10 Wiki Activity

Clone the HuggingFace repository (optional) llm/llama.cpp/convert.py can't find this file. #55

New Issue
Open
opened 2026-02-15 16:27:46 -05:00 by yindo · 0 comments
yindo commented 2026-02-15 16:27:46 -05:00
Owner
Copy Link
Copy Source

Originally created by @tigerzhanglaihu on GitHub (Mar 20, 2024).

I want to use model glmchat-6b , read doc :

Clone the HuggingFace repository (optional)
If the model is currently hosted in a HuggingFace repository, first clone that repository to download the raw model.

Install Git LFS, verify it's installed, and then clone the model's repository:

git lfs install
git clone https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.1 model
Convert the model
Note: some model architectures require using specific convert scripts. For example, Qwen models require running convert-hf-to-gguf.py instead of convert.py

python llm/llama.cpp/convert.py ./model --outtype f16 --outfile converted.bin
Quantize the model
llm/llama.cpp/quantize converted.bin quantized.bin q4_0

But , I can't find convert.py this file.

Originally created by @tigerzhanglaihu on GitHub (Mar 20, 2024). I want to use model glmchat-6b , read doc : Clone the HuggingFace repository (optional) If the model is currently hosted in a HuggingFace repository, first clone that repository to download the raw model. Install [Git LFS](https://docs.github.com/en/repositories/working-with-files/managing-large-files/installing-git-large-file-storage), verify it's installed, and then clone the model's repository: git lfs install git clone https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.1 model Convert the model Note: some model architectures require using specific convert scripts. For example, Qwen models require running convert-hf-to-gguf.py instead of convert.py python llm/llama.cpp/convert.py ./model --outtype f16 --outfile converted.bin Quantize the model llm/llama.cpp/quantize converted.bin quantized.bin q4_0 But , I can't find convert.py this file.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
enhancement
pull-request
Mirrored from GitHub Pull Request
 thinking
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: ollama/ollama-python#55
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?