Datasetpublic

Lumia101/Raw-C4-ko-500MT

⚠️ Warning ⚠️ This dataset was created by the owner of this repository to validate the capabilities of Nari-C4-ko-500MT. It is not recommended to use this for LLM training. Lumia101/Raw-C4-ko-500MT This dataset is a dataset from which 500M tokens were extracted from the allenai/c4 without any additional filtering. This dataset was created to measure the effect of filtering applied to Lumia101/Nari-C4-ko-500MT, so if you intend to use this dataset for LLM training… See the full description on the dataset page: https://huggingface.co/datasets/Lumia101/Raw-C4-ko-500MT.

sourceHugging Facecc-by-4.0updated 6mo agoView on Hugging Face

0likes134downloads

Dataset Card

⚠️ Warning ⚠️

This dataset was created by the owner of this repository to validate the capabilities of Nari-C4-ko-500MT. It is not recommended to use this for LLM training.

Lumia101/Raw-C4-ko-500MT

This dataset is a dataset from which 500M tokens were extracted from the allenai/c4 without any additional filtering.

This dataset was created to measure the effect of filtering applied to Lumia101/Nari-C4-ko-500MT, so if you intend to use this dataset for LLM training, it is highly recommended to use Lumia101/Nari-C4-ko-500MT instead.