Lumia101/Raw-C4-ko-500MT

⚠️ Warning ⚠️ This dataset was created by the owner of this repository to validate the capabilities of Nari-C4-ko-500MT. It is not recommended to use this for LLM training. Lumia101/Raw-C4-ko-500MT This dataset is a dataset from which 500M tokens were extracted from the allenai/c4 without any additional filtering. This dataset was created to measure the effect of filtering applied to Lumia101/Nari-C4-ko-500MT, so if you intend to use this dataset for LLM training… See the full description on the dataset page: https://huggingface.co/datasets/Lumia101/Raw-C4-ko-500MT.