MRNH/mbart-german-grammar-corrector

This is a fine-tuned version of Multilingual Bart (610M) trained on German in particular on the public dataset Falko-MERLIN for Grammatical Error Correction.

To initialize the model:

from transformers import MBartForConditionalGeneration, MBart50TokenizerFast model = MBartForConditionalGeneration.from_pretrained("MRNH/mbart-german-grammar-corrector")

Use the tokenizer:

tokenizer = MBart50TokenizerFast.frompretrained("MRNH/mbart-german-grammar-corrector", srclang="deDE", tgtlang="deDE") input = tokenizer("I was here yesterday to studying",texttarget="I was here yesterday to study", return_tensors='pt')

To generate text using the model:

output = model.generate(input["inputids"],attentionmask=input["attentionmask"],forcedbostokenid=tokenizerit.langcodetoid["de_DE"])

Training of the model is performed using the following loss computation based on the hidden state output h:

h.logits, h.loss = model(inputids=input["inputids"], attentionmask=input["attentionmask"], labels=input["labels"])