JulianKrgd/julian-600m-40b-instruct-sft100k
0327
Julian 600M-40B Instruct SFT-100K
Fine-tuned version of the Julian 600M base model with 100,000 steps of supervised fine-tuning (SFT) on instruction-following data.
Model Details
Benchmark Results (0-shot)
Julian Models
SFT 30K and 100K yield near-identical benchmark scores. Additional SFT steps beyond 30K don't improve knowledge benchmarks. WinoGrande starts to degrade at 100K (likely overfitting on ~2.2 epochs).
Comparison with Other Models
Julian 600M Base outperforms OPT-1.3B on HellaSwag (53.5% vs 41.5%) despite being 2x smaller and trained on 8x fewer tokens. The SFT version trades some HellaSwag performance for instruction-following ability, while maintaining competitive scores on PIQA, ARC, and WinoGrande. Sources: GPT-2 — OpenAI; OPT — Meta; Pythia — EleutherAI
Training
Base Model
- Pre-training: ~40B tokens (70% EN / 30% FR)
- Data: Wikipedia, OSCAR, Gutenberg, The Stack
- Infrastructure: TPU v4-32, JAX/Flax
SFT Fine-tuning
- Steps: 100,000 (from pretrained checkpoint_300000)
- Dataset: 2.47M instruction examples (tokenized)
- Batch size: 32 global (2/device × 4 devices × 4 hosts)
- Sequence length: 2048
- Epochs: ~2.2
- Tokens seen: ~6.55B
- Final loss: 1.69
- Infrastructure: TPU v4-32, JAX/Flax
Usage
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained("JulianKrgd/julian-600m-40b-instruct-sft100k", torch_dtype="bfloat16")
tokenizer = AutoTokenizer.from_pretrained("JulianKrgd/julian-600m-40b-instruct-sft100k")
inputs = tokenizer("Explain quantum computing in simple terms:", return_tensors="pt")
outputs = model.generate(**inputs, max_new_tokens=200, temperature=0.8)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))Limitations
- Small model (600M params) — limited reasoning and factual accuracy
- Instruction following is basic compared to larger models
- May hallucinate or generate incorrect information
- Bilingual (EN/FR) but stronger in English
- 2.2 epochs over training data — some overfitting possible
Framework
Trained from scratch using JAX/Flax on Google Cloud TPU v4-32. Converted to HuggingFace safetensors format for compatibility.
License
Apache 2.0
