Modelpublic

google/realm-cc-news-pretrained-encoder

sourceHugging Faceapache-2.0updated 3y agoView on Hugging Face

1likes151downloads

Model Card

realm-cc-news-pretrained-encoder

Model description

The REALM checkpoint pretrained with CC-News as target corpus and Wikipedia as knowledge corpus, converted from the TF checkpoint provided by Google Language.

The original paper, code, and checkpoints can be found here.

Usage

python

from transformers import RealmKnowledgeAugEncoder

encoder = RealmKnowledgeAugEncoder.from_pretrained("qqaatw/realm-cc-news-pretrained-encoder")