jminc/llama3-lora-resume-matching-r64
0
π LLaMA 3 LoRA Resume Matching Model (R=64)
μ΄ λͺ¨λΈμ Meta-Llama-3.1-8B-bnb-4bit λͺ¨λΈμ κΈ°λ°μΌλ‘, νκ΅μ΄ μ΄λ ₯μ λ° μκΈ°μκ°μμ μ±μ©κ³΅κ³ κ°μ μ ν©λλ₯Ό νκ°νκΈ° μν LoRA νμΈνλ λͺ¨λΈμ λλ€.
π νμ΅ λ°μ΄ν°μ
- μ΄ 74,147κ° μν
- Hugging Face: jminc/resume-matching-dataset-v2
- λͺ¨λ jobpostλ κ°μμ μ 보μ λλ€.
- μ΄λ ₯μ(resume)μ μκΈ°μκ°μ(selfintro)λ GPT-4o κΈ°λ°μΌλ‘ μμ±λμμΌλ©°, μ€μ μΈλ¬Όκ³Ό 무κ΄ν©λλ€.
ποΈ λ°μ΄ν°μ ν¬λ§·
π§ νμ΅ μ€μ
- λͺ¨λΈ:
unsloth/Meta-Llama-3.1-8B-bnb-4bit - κΈ°λ²: LoRA νμΈνλ (Rank=64, Alpha=64)
- νλ«νΌ: RunPod (12vCPU / 25GB RAM)
π νμ΅ κ²°κ³Ό
- Train Loss / Eval Loss Curve
- Confusion Matrix
π§ͺ μ¬μ© μμ
from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("jminc/llama3-lora-resume-matching-r64/tokenizer")
model = AutoModelForCausalLM.from_pretrained("jminc/llama3-lora-resume-matching-r64")
inputs = tokenizer("μ΄λ ₯μ νκ° ν둬ννΈ", return_tensors="pt").to(model.device)
outputs = model.generate(**inputs, max_new_tokens=256)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))β οΈ μ£Όμ
- λ³Έ λͺ¨λΈμ μ°κ΅¬ λ° κ΅μ‘ λͺ©μ μ ννμ¬ μ¬μ©ν μ μμ΅λλ€.
- μ€μ μΈμ¬ νκ° λλ μ±μ© κ²°μ μλ μ¬μ©νμ§ λ§μΈμ.
