duongttr/vi-dataset-for-pretrain
Dataset Card for "vi-dataset-for-pretrain" This is a combination of multiple Vietnamese dataset for pretraining CLMs such as GPT, GPT2, etc. The dataset consists of: vietgpt/covid_19_news_vi hieunguyen1053/binhvq-news-corpus oscar (unshuffled_deduplicated_vi) vietgpt/wikipedia_vi Dataset info Splits N.o examples Size Train 23,891,116 77.36 GB Validation 1,257,428 4.06 GB Total 25,148,544 81.43 GB
Update README.md
Update README.md
Upload README.md with huggingface_hub
Upload data/validation-00008-of-00009-bfae1c1214663f5b.parquet with huggingface_hub
Upload data/validation-00007-of-00009-e211e90892a1e58b.parquet with huggingface_hub
Upload data/validation-00006-of-00009-46c1567f6d202328.parquet with huggingface_hub
Upload data/validation-00005-of-00009-7b0377a66ae60cd7.parquet with huggingface_hub
Upload data/validation-00004-of-00009-5d84784f7223204f.parquet with huggingface_hub
Upload data/validation-00003-of-00009-0e7d816f3c86a40d.parquet with huggingface_hub
Upload data/validation-00002-of-00009-ef566a30324952f2.parquet with huggingface_hub
Upload data/validation-00001-of-00009-5f79edb1193fc635.parquet with huggingface_hub
Upload data/validation-00000-of-00009-fefda457c5c88d66.parquet with huggingface_hub
Upload data/train-00154-of-00155-151312eda6ce48fe.parquet with huggingface_hub
Upload data/train-00153-of-00155-06c790c285abd589.parquet with huggingface_hub
Upload data/train-00152-of-00155-79d790a8b1ea72a6.parquet with huggingface_hub
Upload data/train-00151-of-00155-fc3d7a207824a688.parquet with huggingface_hub
Upload data/train-00150-of-00155-19d831fde6f6ae48.parquet with huggingface_hub
Upload data/train-00149-of-00155-b928a5e499a345b4.parquet with huggingface_hub
Upload data/train-00148-of-00155-9b5f87e8897229f6.parquet with huggingface_hub
Upload data/train-00147-of-00155-d8dbd3ff61d8688c.parquet with huggingface_hub
Upload data/train-00146-of-00155-e55943ebac2baa54.parquet with huggingface_hub
Upload data/train-00145-of-00155-9910fdf8438a79b4.parquet with huggingface_hub
Upload data/train-00144-of-00155-3c3b507a901cae11.parquet with huggingface_hub
Upload data/train-00143-of-00155-06880263f0c261d2.parquet with huggingface_hub
Upload data/train-00142-of-00155-b65298880b7ef00b.parquet with huggingface_hub
Upload data/train-00141-of-00155-dc0dd9e46dc6d479.parquet with huggingface_hub
Upload data/train-00140-of-00155-68a20362b6f61476.parquet with huggingface_hub
Upload data/train-00139-of-00155-be0fee38280cad42.parquet with huggingface_hub
Upload data/train-00138-of-00155-e85101dbfa440049.parquet with huggingface_hub
Upload data/train-00137-of-00155-dc3fe07f6c3bc8ec.parquet with huggingface_hub
Upload data/train-00136-of-00155-653e67a9f627fda8.parquet with huggingface_hub
Upload data/train-00135-of-00155-12cf14ea334106d7.parquet with huggingface_hub
Upload data/train-00134-of-00155-5e7cb422e7a4ff68.parquet with huggingface_hub
Upload data/train-00133-of-00155-e0a607030c1901ae.parquet with huggingface_hub
Upload data/train-00132-of-00155-ea22d4380288272c.parquet with huggingface_hub
Upload data/train-00131-of-00155-700e744655658de8.parquet with huggingface_hub
Upload data/train-00130-of-00155-f8c5a701d2638583.parquet with huggingface_hub
Upload data/train-00129-of-00155-d26921329e2ad87c.parquet with huggingface_hub
Upload data/train-00128-of-00155-2f160322120cf4a6.parquet with huggingface_hub
Upload data/train-00127-of-00155-42273a7f2672148a.parquet with huggingface_hub
Upload data/train-00126-of-00155-63020030c19c8fbb.parquet with huggingface_hub
Upload data/train-00125-of-00155-089203ab886b96e0.parquet with huggingface_hub
Upload data/train-00124-of-00155-5c18d44c200fcf7c.parquet with huggingface_hub
Upload data/train-00123-of-00155-15dead511ea13e57.parquet with huggingface_hub
Upload data/train-00122-of-00155-00c7781d3fcace6e.parquet with huggingface_hub
Upload data/train-00121-of-00155-4f88131222e1a1c4.parquet with huggingface_hub
Upload data/train-00120-of-00155-a87b8134b4bd5a3e.parquet with huggingface_hub
Upload data/train-00119-of-00155-9d5611bdb159ad37.parquet with huggingface_hub
Upload data/train-00118-of-00155-7408ae7fb584ed16.parquet with huggingface_hub
Upload data/train-00117-of-00155-9d754e02cb4289dc.parquet with huggingface_hub