Leftovers of a chat template. (Ollama, Llama 3.2) #152

New Issue

2026-02-15T16:28:20-05:00

yindo commented

2026-02-15 16:28:20 -05:00

Originally created by @IDiMooo on GitHub (Oct 15, 2024).

Hello, I've been working on a conversational model based on Cyn from Murder Drones. I've been using Unsloth's Llama 3 notebook for finetuning Llama 3.2 3B Instruct with my own dataset. The results are mostly great but sometimes I get responses like those on the pictures. It looks like the chat template I used for training. I have this chat template set in the Modelfile so I don't know why that happens. It happens rarely but often enough to notice...

Here is what my model file looks like:


TEMPLATE """{{ if .System }}{{ .System }}{{ end }}{{ if .Prompt }}
USER: {{ .Prompt }}{{ end }}
ASSISTANT: {{ .Response }}<|eot_id|>"""

PARAMETER stop "<|end_header_id|>"
PARAMETER stop "<|eom_id|>"
PARAMETER stop "<|python_tag|>"
PARAMETER stop "<|finetune_right_pad_id|>"
PARAMETER stop "<|start_header_id|>"
PARAMETER stop "<|end_of_text|>"
PARAMETER stop "<|eot_id|>"
PARAMETER stop "<|reserved_special_token_"

PARAMETER temperature 1.5
PARAMETER min_p 0.1

SYSTEM "You are Cyn. You are a positive and silly person. You tend to narrate her actions from time to time.

I should add that I am a silly person who just jumped on a very hard task and I am very much a beginner.

Here are all the links that may be useful:

Originally created by @IDiMooo on GitHub (Oct 15, 2024). Hello, I've been working on a **conversational model** based on Cyn from Murder Drones. I've been using **Unsloth's Llama 3 notebook** for finetuning **Llama 3.2 3B Instruct** with **my own dataset**. The results are mostly great but sometimes I get responses like those on the pictures. It looks like the chat template I used for training. I have this chat template set in the Modelfile so I don't know why that happens. It happens rarely but often enough to notice... ![template1](https://github.com/user-attachments/assets/cf171ac3-b75b-41c5-86eb-a0f474cdde66) ![template2](https://github.com/user-attachments/assets/cf365afe-33de-4eef-bec1-e28a714717d6) Here is what my model file looks like: ```FROM D:\CynAI_Test\Models\CynFineTuned13102024.gguf TEMPLATE """{{ if .System }}{{ .System }}{{ end }}{{ if .Prompt }} USER: {{ .Prompt }}{{ end }} ASSISTANT: {{ .Response }}<|eot_id|>""" PARAMETER stop "<|end_header_id|>" PARAMETER stop "<|eom_id|>" PARAMETER stop "<|python_tag|>" PARAMETER stop "<|finetune_right_pad_id|>" PARAMETER stop "<|start_header_id|>" PARAMETER stop "<|end_of_text|>" PARAMETER stop "<|eot_id|>" PARAMETER stop "<|reserved_special_token_" PARAMETER temperature 1.5 PARAMETER min_p 0.1 SYSTEM "You are Cyn. You are a positive and silly person. You tend to narrate her actions from time to time. ``` I should add that I am a silly person who just jumped on a very hard task and I am very much a beginner. Here are all the links that may be useful: - [Unsloth's Notebook I used](https://colab.research.google.com/drive/1WZDi7APtQ9VsvOrQSSC5DDtxq159j8iZ?usp=sharingl) - [My Cyn Dataset](https://huggingface.co/datasets/IDiMooo/Cyn)

yindo closed this issue

2026-02-15 16:28:20 -05:00

yindo referenced this issue

2026-02-15 16:30:11 -05:00

[PR #152] [MERGED] remove old options #383

Sign in to join this conversation.

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: ollama/ollama-python#152