sakibalfahim/BanglaNews

BanglaNews (LoRA)

LoRA adapters for a Bangla news writing assistant on unsloth/Meta-Llama-3.1-8B-Instruct.

Links

• —Demo (Space): https://huggingface.co/spaces/sakibalfahim/BanglaNews
• —Code (GitHub): https://github.com/sakibalfahim/BanglaNews
• —This model: https://huggingface.co/sakibalfahim/BanglaNews

Tasks

1. 1.Write article: category + headline -> news body
2. 2.Make headline: news body -> headline

Limitations (important)

• —Hobby / short Kaggle T4 run (~300 + ~200 LoRA steps), not full multi-epoch training.
• —Partial data coverage; generation length was capped in eval/demo.
• —Automatic metrics are modest; outputs can be short.
• —Not a production newsroom system. Further long fine-tuning was not pursued in this phase.
• —ZeroGPU demo: queue, cold start, daily free GPU quota.

Load

from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer, BitsAndBytesConfig
import torch

bnb = BitsAndBytesConfig(load_in_4bit=True, bnb_4bit_compute_dtype=torch.float16)
base = AutoModelForCausalLM.from_pretrained(
    'unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit',
    device_map='auto', quantization_config=bnb)
tok = AutoTokenizer.from_pretrained('sakibalfahim/BanglaNews')
model = PeftModel.from_pretrained(base, 'sakibalfahim/BanglaNews')

Data

Kaggle: durjoychandrapaul/over-11500-bangla-news-for-nlp

Training summary

• —Unsloth QLoRA, r=16, alpha=32, maxseqlength=2048, packing
• —Adapters only (~160MB); not a full 8B merge
• —Code/docs/metrics text: https://github.com/sakibalfahim/BanglaNews