CoolFace
Modelpublic

11-47/GPT2.5.5-Awakened.Thinker-0.1B

sourceHugging Facemitupdated 4mo agoView on Hugging Face
0likes48downloads
Model Card

GPT2.5.5-Awakened.Thinker-0.1B

Forged by WithIn Us AI — a fully fine-tuned GPT-2 awakened on distilled GPT-5.5 thinking patterns.

Model Overview

PropertyValue
ArchitectureGPT-2 (openai-community/gpt2)
Parameters~124M (0.1B class)
Training TypeFull fine-tune — ALL weights updated, zero adapters
Context Window1024 tokens
Best Eval Loss0.4365
Best Perplexity1.55
CreatorGODsStrongestSoldier / WithIn Us AI
Date Trained2026-05-23
Hardware2× NVIDIA Tesla T4 (Kaggle)
PrecisionFP16 mixed precision

Training Methodology

Full fine-tuning — every single parameter in GPT-2 was updated. No LoRA, no QLoRA, no adapters of any kind.

Datasets

DatasetDescription
`WithinUsAI/GPT_5.5_Distilled`Instruction + completion pairs distilled from GPT-5.5
`WithinUsAI/GPT5.5_thinking_max_distill_god_seed_25K`25K chain-of-thought reasoning traces distilled from GPT-5.5

97 / 3 train / eval split.

Hyperparameters

ParameterValue
Peak Learning Rate3e-5
LR ScheduleCosine with 6% warmup
Effective Batch Size64 (4 × 2 GPUs × 8 grad accum)
Epochs5
Weight Decay0.1
Max Sequence Length1024
PrecisionFP16

Quick Start

python
from transformers import GPT2LMHeadModel, GPT2TokenizerFast
import torch

model_id  = "GODsStrongestSoldier/GPT2.5.5-Awakened.Thinker-0.1B"
tokenizer = GPT2TokenizerFast.from_pretrained(model_id)
model     = GPT2LMHeadModel.from_pretrained(model_id, torch_dtype=torch.float16)
model.eval()

prompt = "Let me think through this carefully, step by step:"
inputs = tokenizer(prompt, return_tensors="pt")

with torch.no_grad():
    output = model.generate(
        **inputs,
        max_new_tokens     = 200,
        do_sample          = True,
        temperature        = 0.7,
        top_p              = 0.9,
        repetition_penalty = 1.15,
    )

print(tokenizer.decode(output[0], skip_special_tokens=True))

About WithIn Us AI

"Strength through understanding. Awakened from within."