abdullah00111/syntax

1 2FROM /content/abdullah00111/syntax/unsloth.F16.gguf3TEMPLATE """{{ if .Messages }}4{{- if or .System .Tools }}<|start_header_id|>system<|end_header_id|>5{{- if .System }}6 7{{ .System }}8{{- end }}9{{- if .Tools }}10 11You are a helpful assistant with tool calling capabilities. When you receive a tool call response, use the output to format an answer to the original use question.12{{- end }}13{{- end }}<|eot_id|>14{{- range $i, $_ := .Messages }}15{{- $last := eq (len (slice $.Messages $i)) 1 }}16{{- if eq .Role "user" }}<|start_header_id|>user<|end_header_id|>17{{- if and $.Tools $last }}18 19Given the following functions, please respond with a JSON for a function call with its proper arguments that best answers the given prompt.20 21Respond in the format {"name": function name, "parameters": dictionary of argument name and its value}. Do not use variables.22 23{{ $.Tools }}24{{- end }}25 26{{ .Content }}<|eot_id|>{{ if $last }}<|start_header_id|>assistant<|end_header_id|>27 28{{ end }}29{{- else if eq .Role "assistant" }}<|start_header_id|>assistant<|end_header_id|>30{{- if .ToolCalls }}31 32{{- range .ToolCalls }}{"name": "{{ .Function.Name }}", "parameters": {{ .Function.Arguments }}}{{ end }}33{{- else }}34 35{{ .Content }}{{ if not $last }}<|eot_id|>{{ end }}36{{- end }}37{{- else if eq .Role "tool" }}<|start_header_id|>ipython<|end_header_id|>38 39{{ .Content }}<|eot_id|>{{ if $last }}<|start_header_id|>assistant<|end_header_id|>40 41{{ end }}42{{- end }}43{{- end }}44{{- else }}45{{- if .System }}<|start_header_id|>system<|end_header_id|>46 47{{ .System }}<|eot_id|>{{ end }}{{ if .Prompt }}<|start_header_id|>user<|end_header_id|>48 49{{ .Prompt }}<|eot_id|>{{ end }}<|start_header_id|>assistant<|end_header_id|>50 51{{ end }}{{ .Response }}{{ if .Response }}<|eot_id|>{{ end }}"""52PARAMETER stop "<|start_header_id|>"53PARAMETER stop "<|end_header_id|>"54PARAMETER stop "<|eot_id|>"55PARAMETER stop "<|eom_id|>"56PARAMETER temperature 1.557PARAMETER min_p 0.1