BEE-spoke-data/FLAN-compressed

FLAN: compressed An aggressively deduplicated (aka "compressed") version of FLAN: 378M rows -> 116M deduplicated on inputs only with minhash all rows mentioning translation tasks in _task_name have been dropped (see config all for these included) Top 40 tasks - Default Config - Click to Expand Top 40 tasks - Default Config: [('gigaword:1.2.0', 7225415), ('amazon_polarity_flattering_or_not', 6966639), ('amazon_polarity_Is_this_review_negative', 6912683)… See the full description on the dataset page: https://huggingface.co/datasets/BEE-spoke-data/FLAN-compressed.