Modelpublic

llm-semantic-router/mmbert32k-factcheck-classifier-merged

sourceHugging Faceapache-2.0updated 7mo agoView on Hugging Face

1likes9.9kdownloads

Model Card

mmBERT-32K Factcheck Classifier (Merged)

This is the merged version of the mmBERT-32K factcheck classifier model, ready for direct inference without PEFT.

Model Details

—Base Model: llm-semantic-router/mmbert-32k-yarn
—Task: Text Classification
—Number of Labels: 2
—Context Length: 32,768 tokens
—Architecture: ModernBERT with YaRN RoPE scaling

Usage

python

from transformers import AutoModelForSequenceClassification, AutoTokenizer

model = AutoModelForSequenceClassification.from_pretrained(
    "llm-semantic-router/mmbert32k-factcheck-classifier-merged",
    trust_remote_code=True
)
tokenizer = AutoTokenizer.from_pretrained("llm-semantic-router/mmbert32k-factcheck-classifier-merged")

# Inference
inputs = tokenizer("Your text here", return_tensors="pt", truncation=True, max_length=32768)
outputs = model(**inputs)

Related Models

—LoRA Adapter: llm-semantic-router/mmbert32k-factcheck-classifier-lora
—Base Model: llm-semantic-router/mmbert-32k-yarn

License

Apache 2.0