brittlewis12/s1.1-32B-GGUF

s1.1 32B GGUF

Original model: s1.1 32B

Model creator: simplescaling

s1.1 is our sucessor of s1 with better reasoning performance by leveraging reasoning traces from r1 instead of Gemini.

s1 is a reasoning model finetuned from Qwen2.5-32B-Instruct on just 1,000 examples. It matches o1-preview & exhibits test-time scaling via budget forcing.

This repo contains GGUF format model files for simplescaling’s s1.1 32B, an open reproduction of OpenAI’s o1-preview including model, source code, and data (see s1K).

Learn more on simplescaling’s s1 github repo, arxiv preprint, and on twitter.

What is GGUF?

GGUF is a file format for representing AI models. It is the third version of the format, introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp. Converted with llama.cpp build 4689 (revision 90e4dba), using autogguf-rs.

Prompt template: ChatML

<|im_start|>system
{{system_message}}<|im_end|>
<|im_start|>user
{{prompt}}<|im_end|>
<|im_start|>assistant

Download & run with cnvrs on iPhone, iPad, and Mac!

cnvrs is the best app for private, local AI on your device:

• —create & save Characters with custom system prompts & temperature settings
• —download and experiment with any GGUF model you can find on HuggingFace!
• —or, use an API key with the chat completions-compatible model provider of your choice -- ChatGPT, Claude, Gemini, DeepSeek, & more!
• —make it your own with custom Theme colors
• —powered by Metal ⚡️ & Llama.cpp, with haptics during response streaming!
• —try it out yourself today, on Testflight!
• —follow cnvrs on twitter to stay up to date

Original Model Evaluation

Note that s1-32B and s1.1-32B use budget forcing in this table; specifically ignoring end-of-thinking and appending "Wait" once or twice.