Modelpublic

valuesimplex-ai-lab/FinBERT2-large

sourceHugging Faceapache-2.0updated 1y agoView on Hugging Face

5likes146downloads

Model Card

Model Details

Model Description: This is a finance-domain pretrained Chinese language model, which is based on the 355-million-parameter RoBERTa-Large and further pre-trained on 32B tokens of Chinese financial corpora (including a large number of research reports, news, and announcements).

—Developed by: See valuesimplex for model developers
—Model Type: Transformer-based language model
—Language(s): Chinese
—Parent Model: See the chinese-roberta for more information about the BERT base model.
—Resources for more information:
—Research Paper
—GitHub Repo

Direct Use

python

from transformers import AutoModel, AutoTokenizer

model = AutoModel.from_pretrained("valuesimplex-ai-lab/FinBERT2-large")
tokenizer = AutoTokenizer.from_pretrained("valuesimplex-ai-lab/FinBERT2-large")

Further Usage

continual pre-training or fine-tuning：https://github.com/valuesimplex/FinBERT