gptmurdock/classifier-main_subjects_basic-information

Fine-tuned roberta-base for detecting paragraphs on the topic of 'Basic Information'

Description

This is a fine tuned roberta-base model for detecting whether paragraphs drawn from ethnographic source material are about 'Basic Information'.

Usage

The easiest way to use this model at inference time is with the HF pipelines API.

from transformers import pipeline

classifier = pipeline("text-classification", model="gptmurdock/classifier-main_subjects_basic-information")
classifier("Example text to classify")

Training data

...

Training procedure

...

We use a 60-20-20 train-val-test split, and fine-tuned roberta-base for 5 epochs (lr = 2e-5, batch size = 40).

Evaluation

Evals on the test set are reported below.