abertsch/bart-base-govreport

Baseline model for the preprint Unlimiformer: Long-Range Transformers with Unlimited Length Input

This is a BART-base model finetuned as a baseline. The model was finetuned on GovReport using the data processing pipeline from SLED; to load the validation or test set for use with these model, please use the datasets urialon/gov_report_validation and urialon/gov_report_test.