CoolFace
Modelpublic

Catniti/catrex-1.0

sourceHugging Faceapache-2.0updated 1mo agoView on Hugging Face
1likes241downloads
Model Card

Catrex 1.0

Bilingual (RU/EN) chat model on 65M parameters, trained from scratch.

Results

MetricValue
val loss4.6802
perplexity107.8
Parameters64.82M
Context512 tokens
Training steps430

Run in LM Studio

  1. 1.Download catrex-1.0-f16.gguf
  2. 2.Put it in ~/.lmstudio/models/Catniti/catrex-1.0/
  3. 3.Load it in LM Studio (chat template is already inside the file)

Run via llama.cpp

bash
llama-cli -hf Catniti/catrex-1.0:f16 -p "Hi!"

Python (transformers)

python
from transformers import AutoModelForCausalLM, AutoTokenizer
tok = AutoTokenizer.from_pretrained("Catniti/catrex-1.0")
model = AutoModelForCausalLM.from_pretrained("Catniti/catrex-1.0")
msgs = [{"role": "user", "content": "Hi!"}]
ids = tok.apply_chat_template(msgs, add_generation_prompt=True, return_tensors="pt")
out = model.generate(ids, max_new_tokens=100, temperature=0.8, do_sample=True)
print(tok.decode(out[0][ids.shape[1]:], skip_special_tokens=True))

Prompt format

ChatML:

<|im_start|>user
Hi!<|im_end|>
<|im_start|>assistant