CoolFace
Modelpublic

RichardErkhov/Ba2han_-_Pretraining_Turkish-10k-step-gguf

sourceHugging Faceupdated 2y agoView on Hugging Face
0likes331downloads
Model Card

Quantization made by Richard Erkhov.

Github

Discord

Request more models

Pretraining_Turkish-10k-step - GGUF

  • —Model creator: https://huggingface.co/Ba2han/
  • —Original model: https://huggingface.co/Ba2han/Pretraining_Turkish-10k-step/

Original model description: --- license: mit language:

  • —tr library_name: transformers ---

Pretrained on roughly 1.6B (mostly Turkish) tokens from HF and "high quality" scraped data using 1 RTX 3090. The training will continue. The model already can be (sort of) fine-tuned for instruction. ___________________________ HF kaynaklı ve scrape edilen yaklaşık 1.6 Milyar (çoğunlukla Türkçe) token ile 1 RTX 3090 kullanılarak eğitilmiştir. Model şimdiden talimatlar için fine-tune edilebiliyor:

image/png

maxlength=256, topk=20, minp=0.1, repetitionpenalty=1.1, temperature=0.1, seed=22366 / TR4kLoRA