CoolFace
Modelpublic

poseidon1113/finbert-full-sft-financial-sentiment_v3

sourceHugging Faceapache-2.0updated 4mo agoView on Hugging Face
0likes16downloads
Model Card

FinBERT — Financial Sentiment (Fine-tuned on NOSIBLE)

Full fine-tuned ProsusAI/finbert for financial sentiment classification (positive / neutral / negative), trained on NOSIBLE Financial Sentiment (100K examples).

Model Details

Base modelProsusAI/finbert (110M)
Fine-tuningFull (all weights updated)
DatasetNOSIBLE/financial-sentiment — 100K examples
Epochs1
Batch size16
Learning rate2e-5
Warmup ratio0.1
Max length512

Usage

python
from transformers import pipeline

classifier = pipeline(
    "text-classification",
    model="poseidon1113/finbert-full-sft-financial-sentiment_v3"
)

classifier("Operating profit rose to EUR 13.1 mn from EUR 21.1 mn.")
# → [{'label': 'positive', 'score': 0.98}]

classifier("The company reported a loss for the third consecutive quarter.")
# → [{'label': 'negative', 'score': 0.95}]

Evaluation on FiQA 2018 (all splits combined)

Evaluated on pauri32/fiqa-2018 (train + validation + test combined) after removing URLs and non-ASCII characters.

ClassCorrectTotalAccuracy
Positive37270652.7%
Neutral9111579.1%
Negative25437368.1%
Overall717119460.1%

Comparison across models

ModelTypeOverall Accuracy on FiQA
GPT-2 baseCausal LM~15%
GPT-2 LoRA v1 (PhraseBank)Causal LM + LoRA~15%
GPT-2 LoRA v2 (+ NOSIBLE)Causal LM + LoRA~42%
FinBERT baseSequence classifier50.9%
FinBERT + NOSIBLE (this model)Sequence classifier60.1%

Why FinBERT outperforms GPT-2 LoRA

FinBERT's encoder-only BERT architecture reads the full sentence bidirectionally, making it inherently better at classification tasks. GPT-2 is a generative model adapted for classification via prompting — fundamentally less suited for this task. For production sentiment classification, encoder models like FinBERT are the right choice. GPT-2 LoRA is better suited for tasks requiring text generation.

Limitations

  • Trained on English financial news only
  • May underperform on social media slang or non-standard financial text
  • Labels reflect financial impact sentiment, not general opinion sentiment

Citation

bibtex
@article{araci2019finbert,
  title={FinBERT: Financial Sentiment Analysis with Pre-trained Language Models},
  author={Araci, Dogu},
  journal={arXiv preprint arXiv:1908.10063},
  year={2019}
}