CoolFace
Modelpublic

alinashrestha/patentsbert-m4-final

sourceHugging Faceapache-2.0updated 7mo agoView on Hugging Face
0likes4downloads
Model Card

PatentSBERTa M4 Final — Y02 Green Patent Classifier

Fine-tuned version of AI-Growth-Lab/PatentSBERTa for binary classification of patent claims as GREEN (Y02) or NOT GREEN.

Developed as the final model in a 4-assignment pipeline for the course Applied Deep Learning and Artificial Intelligence at Aalborg University.


Model Performance

DatasetAccuracyPrecisionRecallF1
Eval Silver (10,000 claims)0.80480.80250.80860.8055
Gold 100 (human verified)0.57000.43100.71430.5376

Training Data

  • —30,000 silver-labelled patent claims (Y02 CPC codes)
  • —100 gold-labelled claims (human verified via HITL)
  • —Total: 30,100 training examples — perfectly balanced 50/50

Pipeline Overview

This model is the final step in a 4-stage pipeline:

  1. 1.QLoRA Fine-Tuning — Mistral-7B fine-tuned as Y02 domain expert Judge
  2. 2.3-Agent MAS — Advocate / Skeptic / Judge debate on 100 uncertain claims
  3. 3.HITL Review — Human reviewed only 11 flagged uncertain claims
  4. 4.PatentSBERTa Fine-Tuning — Final classifier trained on 30,100 examples

Training Config

ParameterValue
Base modelAI-Growth-Lab/PatentSBERTa
Epochs1
Learning rate2e-5
Batch size16 train / 32 eval
Max sequence length256
HardwareNVIDIA L4 GPU
Training time~6 minutes

Files in this Repository

FileDescription
model.safetensorsFinal model weights
gold_100_dataset.csv100 gold labelled claims
train_silver_gold_30100.csvFull training dataset
mas_100_results.csvMAS agent outputs
hitl_100_gold.csvHuman reviewed labels
Train_qlora_mistral_v2.PYQLoRA training script
mas_crewai_fewshot_v2.PYMAS pipeline script
train_patentsbert_final.pyPatentSBERTa training script
m4_final_assignmnet.ipynbFull assignment notebook

Citation

bibtex
@misc{shrestha2026greenpatent,
  author = {Alina Shrestha},
  title  = {Green Patent Detection: Advanced Agentic Workflow with QLoRA},
  year   = {2026},
  note   = {AAU Applied Deep Learning and Artificial Intelligence}
}