CoolFace
Modelpublic

haipradana/indobert-indonesia-satire-sarcastic-classification-model

sourceHugging Facemitupdated 1y agoView on Hugging Face
0likes7downloads
Model Card

Fine-tuned indoBERT pre-trained model for sarcasm and satire classification

Just check GitHub for full-code and Google Colab: https://github.com/haipradana/indobert-indonesia-sarcastic-satire-classification

How to use this model?

python
import torch
from transformers import AutoTokenizer, AutoModelForSequenceClassification

# Load model
tokenizer = AutoTokenizer.from_pretrained("indobert-indonesia-sarcastic-satire-classification/model")
model = AutoModelForSequenceClassification.from_pretrained("indobert-indonesia-sarcastic-satire-classification/model")

# Predict
def predict(text: str):
    inputs = tokenizer(text, return_tensors='pt', truncation=True, padding=True, max_length=512)
    with torch.no_grad():
        outputs = model(**inputs)
    logits = outputs.logits
    prediction = torch.argmax(logits, dim=1).item()
    return 'sarcasm' if prediction == 1 else 'not sarcasm'

# Example
result = predict("Kamu penulis ya? pandai sekali mengarang cerita")
print(result) #output = sarcasm

Or just using the script in the GitHub Repos

bash
cd scripts
python predict.py

Evaluation Results

The model was evaluated on the test set with the following metrics:

MetricValue
Accuracy0.8378
Precision0.8405
Recall0.8286
F1-Score0.8345

Training History

EpochTrain LossVal LossAccuracyPrecisionF1-ScoreRecall
10.45590.35120.84090.90220.82610.7618
20.24910.39240.83390.78350.84590.9190
30.11980.59800.84290.81880.84710.8774
40.04390.94970.84440.82310.84790.8742
50.00970.99620.85220.84210.85290.8640