Datasetpublic

BEE-spoke-data/FLAN-compressed

FLAN: compressed An aggressively deduplicated (aka "compressed") version of FLAN: 378M rows -> 116M deduplicated on inputs only with minhash all rows mentioning translation tasks in _task_name have been dropped (see config all for these included) Top 40 tasks - Default Config - Click to Expand Top 40 tasks - Default Config: [('gigaword:1.2.0', 7225415), ('amazon_polarity_flattering_or_not', 6966639), ('amazon_polarity_Is_this_review_negative', 6912683)… See the full description on the dataset page: https://huggingface.co/datasets/BEE-spoke-data/FLAN-compressed.

sourceHugging Facecc-by-4.0updated 9mo agoView on Hugging Face

2likes101downloads

Dataset Card

FLAN: compressed

An aggressively deduplicated (aka "compressed") version of FLAN: 378M rows -> 116M

—deduplicated on inputs only with minhash
—all rows mentioning translation tasks in _task_name have been dropped (see config all for these included)

<details> <summary>Top 40 tasks - Default Config - Click to Expand</summary>

Top 40 tasks - Default Config:

[('gigaword:1.2.0', 7225415),
 ('amazon_polarity_flattering_or_not', 6966639),
 ('amazon_polarity_Is_this_review_negative', 6912683),
 ('amazon_polarity_Is_this_review', 6902180),
 ('amazon_polarity_Is_this_product_review_positive', 6898275),
 ('amazon_polarity_convey_negative_or_positive_sentiment', 6857804),
 ('amazon_polarity_User_recommend_this_product', 6788054),
 ('amazon_polarity_negative_or_positive_tone', 6700500),
 ('amazon_polarity_would_you_buy', 6639327),
 ('amazon_polarity_user_satisfied', 6621607),
 ('math_dataset/algebra__linear_1d:1.0.0', 6065220),
 ('wiki_dialog', 5753721),
 ('sentiment140:1.0.0', 3882515),
 ('wiki_dialog_ii', 1810845),
 ('glue/mnli:2.0.0', 1732066),
 ('newsroom:1.0.0', 1551362),
 ('wiki_bio_who', 1366926),
 ('yelp_polarity_reviews:0.2.0', 1297748),
 ('wiki_bio_key_content', 1271294),
 ('wiki_bio_guess_person', 1190548),
 ('snli:1.1.0', 1169114),
 ('wiki_bio_what_content', 1163894),
 ('wiki_bio_comprehension', 1098344),
 ('glue/qqp:2.0.0', 1084866),
 ('dbpedia_14_pick_one_category_for_the_following_text', 997679),
 ('dbpedia_14_given_a_choice_of_categories_', 974289),
 ('dbpedia_14_given_list_what_category_does_the_paragraph_belong_to', 886494),
 ('cnn_dailymail:3.4.0', 529770),
 ('huggingface:xsum', 489659),
 ('ag_news_subset:1.0.0', 393966),
 ('glue/qnli:2.0.0', 308365),
 ('super_glue/record:1.0.2', 307155),
 ('trivia_qa/rc:1.1.0', 294200),
 ('natural_questions_open:1.0.0', 284111),
 ('squad/v2.0:3.0.0', 276551),
 ('gem/wiki_lingua_english_en:1.1.0', 258708),
 ('anli/r3:0.1.0', 222894),
 ('kilt_tasks_hotpotqa_straighforward_qa', 222040),
 ('kilt_tasks_hotpotqa_final_exam', 214800),
 ('kilt_tasks_hotpotqa_combining_facts', 214474)]

</details>