gpt2-tr
Datasets
All datasets matching “gpt2-tr”gpt2-training-ar-zh-ko-ja-4b
Balanced Arabic-Chinese-Korean-Japanese 4B-token training data
Sequential FineWeb-2 documents tokenized with CausalNLP/gpt2-tokenizer-ar-zh-ko-ja. Each language contains at least 1,000,000,000 tokens in complete documents. Total target: 4,000,000,000 tokens. Approximately 100,000,000 tokens per Parquet shard.
Splits: arb_Arab, cmn_Hani, kor_Hang, jpn_Jpan. Schema: text: string, input_ids: list<int32>.
mlsum-tr-gpt2-tokenizedaraproje_hellaswag_tr_conf_gpt2_bestscore_is
Dataset Card for "araproje_hellaswag_tr_conf_gpt2_bestscore_is"
More Information needed
pile-uncopyrighted-train-tokenized-gpt2araproje_hellaswag_tr_conf_gpt2_nearestscore_true_y
Dataset Card for "araproje_hellaswag_tr_conf_gpt2_nearestscore_true_y"
More Information needed
GPT2_TEST-train-dataset