Modelpublic

realrick/olmo3-190m-zh-nano-continue

sourceHugging Faceapache-2.0updated 3mo agoView on Hugging Face

0likes10downloads

Model Card

realrick/olmo3-190m-zh-nano-continue

持续预训练版本：基于 realrick/olmo3-190m-zh-nano，在持续预训练数据上继续训练。

训练配置

—数据：cmz1024/llm101-olmo3-zh-demo-data/continue/full_v31.bin
—LR：2e-4（低 LR 防止灾难性遗忘）
—Warmup：10%

用法

python

from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained("realrick/olmo3-190m-zh-nano-continue")
tok = AutoTokenizer.from_pretrained("realrick/olmo3-190m-zh-nano-continue")