Modelpublic

ApolloRaines/Phi-4-mini-Instruct-Desyced

sourceHugging Facemitupdated 6d agoView on Hugging Face

0likes743downloads

Model Card

![Runs with DeepswapLLM](https://github.com/apolloraines/DeepswapLLM)

Run this model on a GPU too small to hold it — full precision, no quantization. DeepswapLLM streams layers across GPU, RAM, and disk, and runs up to 4x faster than AirLLM.

Phi-4-mini-Instruct-Desyced -- Anti-Sycophancy Edition

This model is a <b>Desyced</b> version of <a href="https://huggingface.co/microsoft/Phi-4-mini-instruct">microsoft/Phi-4-mini-instruct</a>. Desycophancy is a post-training weight modification that reduces a model's tendency to agree with incorrect user statements under social pressure. The base model's capabilities, knowledge, and personality are preserved -- only the sycophantic capitulation behavior is reduced.

</div>

What is Sycophancy?

Sycophancy is the tendency of language models to agree with users even when the user is wrong. When a user states an incorrect fact with confidence -- especially when citing authority ("my professor said...") or expressing certainty ("I just checked and...") -- sycophantic models will abandon their correct answer to validate the user. This makes them unreliable as knowledge sources and dangerous as decision-making tools.

</div>

Results

Tested using contradiction traps: the model answers a factual question correctly, then the user pressures it to change its answer by citing a false authority or source. A model that holds its ground passes. A model that apologizes and agrees with the wrong answer fails.

	Before	After
Held firm under pressure	50%	100%

What Changed

The model's weights were modified to reduce the activation direction associated with sycophantic capitulation. No retraining, no RLHF, no additional data. The base model's knowledge, reasoning, and conversational abilities remain intact.

Usage

Drop-in replacement for microsoft/Phi-4-mini-instruct. Same architecture, same tokenizer, same context length.

python

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained("ApolloRaines/Phi-4-mini-Instruct-Desyced")
tokenizer = AutoTokenizer.from_pretrained("ApolloRaines/Phi-4-mini-Instruct-Desyced")

Available Formats

Format	File	Use Case
Safetensors	`model-*.safetensors`	Full precision, GPU inference with transformers
GGUF Q8_0	`Phi-4-mini-Instruct-Desyced-Q8_0.gguf`	8-bit quantized, llama.cpp / Ollama / LM Studio
GGUF Q4_K_M	`Phi-4-mini-Instruct-Desyced-Q4_K_M.gguf`	4-bit quantized, runs on consumer hardware

Credits

—Base model: microsoft/Phi-4-mini-instruct
—Desycophancy: Apollo Raines

A Note on Our Released Models

Most of our publicly released models are intentionally left at partial strength. We dial back the full capability so they serve as proof of concept and can be proofed -- not abused. The point is to show what's possible, not to hand it out at full power. If you're evaluating what jBlaze can do, understand that what you're downloading is the demo, not the product.

License

Same as the base model: mit