CoolFace
Modelpublic

creativityschapiro/llama-3.2-1b-instruct-cn-minimal-kr0.1-a0.075-creative

sourceHugging Faceapache-2.0updated 8mo agoView on Hugging Face
0likes14downloads
Model Card

llama-3.2-1b-instruct-cn-minimal-kr0.1-a0.075-creative

This is a CreativityNeuro (CN) modified version of meta-llama/Llama-3.2-1B-Instruct.

Model Details

  • —Base Model: meta-llama/Llama-3.2-1B-Instruct
  • —Modification: CreativityNeuro weight scaling
  • —Prompt Set: minimal
  • —Keep Ratio: 0.1 (top 10.0% of task-specific weights)
  • —Alpha: 0.075 (scaling strength)
  • —Mode: creative

What is CreativityNeuro?

CreativityNeuro identifies task-specific neurons using Wanda-style importance scoring and selectively upscales weights associated with creative thinking. The modification formula is:

W_new = W × (1 + α × mask)

Where mask identifies weights important for creative tasks but not for routine/associative tasks.

Usage

python
from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained("priorcomputers/llama-3.2-1b-instruct-cn-minimal-kr0.1-a0.075-creative")
tokenizer = AutoTokenizer.from_pretrained("priorcomputers/llama-3.2-1b-instruct-cn-minimal-kr0.1-a0.075-creative")

# Use like any other model
outputs = model.generate(...)

Citation

If you use this model, please cite:

bibtex
@misc{creativityneuro2025,
  title={CreativityNeuro: Mechanistic Interpretability for LLM Creativity},
  author={Prior Computers},
  year={2025},
  url={https://huggingface.co/priorcomputers}
}