tasal9/ZamAI-LIama3-Pashto

ZamAI LIama3 Pashto

Task: text-generation Languages: en, ps Base model: meta-llama/Meta-Llama-3-8B-Instruct Training dataset(s): tasal9/Pashto-Dataset-Creating-Dataset

Overview

This model is part of the ZamAI Pashto language AI collection. It is fine-tuned/adapted for text-generation in Pashto and related languages.

Intended uses & limitations

• —Use for research, prototyping, and production assistance in Pashto NLP.
• —Evaluate outputs carefully before deploying in high-stakes applications.
• —May reflect biases present in the pre-training or fine-tuning data.

How to use

from transformers import AutoModelForCausalLM, AutoTokenizer

model_id = "tasal9/ZamAI-LIama3-Pashto"
model = AutoModelForCausalLM.from_pretrained(model_id, trust_remote_code=True)
tokenizer = AutoTokenizer.from_pretrained(model_id, trust_remote_code=True)

prompt = "سلام دې وي! تاسو څنګه یاست؟"
inputs = tokenizer(prompt, return_tensors="pt")
outputs = model.generate(**inputs, max_new_tokens=128, do_sample=True, temperature=0.7)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))

Training data

The model was trained or fine-tuned on: tasal9/Pashto-Dataset-Creating-Dataset.

Evaluation

Update this table with your measured results and link to the evaluation script/notebook.

Citation

@misc{zamai_pashto,
  title = {{ZamAI LIama3 Pashto}},
  author = {ZamAI / Yaqoob Tasal},
  year = {2024},
  howpublished = {\url{https://huggingface.co/tasal9/ZamAI-LIama3-Pashto}}
}

License

This model is released under the mit license.