Modelpublic

matsci-llm-anon/Llama2-ft-Combined

sourceHugging Facecc-by-4.0updated 1mo agoView on Hugging Face

0likes15downloads

Model Card

Llama2-ft-Combined

LoRA adapter for multi-task training across the materials tasks.

Released for double-blind review of How Large Language Models Learn Materials Science.


Base model	`NousResearch/Llama-2-7b-chat-hf`
PEFT type	LoRA (r=8, alpha=16, dropout=0.05)
Target modules	`v_proj`, `q_proj`

Usage

python

from peft import PeftModel
from transformers import AutoModelForCausalLM
m = AutoModelForCausalLM.from_pretrained("NousResearch/Llama-2-7b-chat-hf")
m = PeftModel.from_pretrained(m, "matsci-llm-anon/Llama2-ft-Combined")

Citation

bibtex

@inproceedings{anonymous2026learn,
  title={How Large Language Models Learn Materials Science},
  author={Anonymous},
  booktitle={Under review},
  year={2026}
}

Author and affiliation information is withheld during double-blind review.