IFM/K2Datasets
K2 Dataset Card The following data mix was used to train K2 and achieve results in line with Llama 2 70B. Dataset Details K2 was trained on 1.4T tokens across two stages. The data sources and data mix for each stage are listed below. Dataset Description: Stage 1 Dataset Starting Tokens Multiplier Total Tokens % of Total dm-math 4.33B 3x 13B 1% pubmed-abstracts (from the Pile) 4.77B 3x 14.3B 1.1% uspto (from the Pile) 4.77B 3x… See the full description on the dataset page: https://huggingface.co/datasets/IFM/K2Datasets.
Update README.md
Update README.md
Update README.md
Update README.md
Update README.md
Update README.md
Update README.md
Upload chunk_379.jsonl with huggingface_hub
Upload chunk_378.jsonl with huggingface_hub
Upload chunk_377.jsonl with huggingface_hub
Upload chunk_376.jsonl with huggingface_hub
Upload chunk_375.jsonl with huggingface_hub
Upload chunk_374.jsonl with huggingface_hub
Upload chunk_373.jsonl with huggingface_hub
Upload chunk_372.jsonl with huggingface_hub
Upload chunk_371.jsonl with huggingface_hub
Upload chunk_370.jsonl with huggingface_hub
Upload chunk_369.jsonl with huggingface_hub
Upload chunk_368.jsonl with huggingface_hub
Upload chunk_367.jsonl with huggingface_hub
Upload chunk_366.jsonl with huggingface_hub
Upload chunk_365.jsonl with huggingface_hub
Upload chunk_364.jsonl with huggingface_hub
Upload chunk_363.jsonl with huggingface_hub
Upload chunk_362.jsonl with huggingface_hub
Upload chunk_361.jsonl with huggingface_hub
Upload chunk_360.jsonl with huggingface_hub
Update README.md
Update README.md
Update README.md
Update README.md
Update README.md
Update README.md
Update README.md
Upload chunk_247.jsonl with huggingface_hub
Upload chunk_254.jsonl with huggingface_hub
Upload chunk_175.jsonl with huggingface_hub
Upload chunk_24.jsonl with huggingface_hub
Upload chunk_137.jsonl with huggingface_hub
Upload chunk_315.jsonl with huggingface_hub
Upload chunk_248.jsonl with huggingface_hub
Upload chunk_150.jsonl with huggingface_hub
Upload chunk_58.jsonl with huggingface_hub
Upload chunk_149.jsonl with huggingface_hub
Upload chunk_262.jsonl with huggingface_hub
Upload chunk_337.jsonl with huggingface_hub
Upload chunk_16.jsonl with huggingface_hub
Upload chunk_180.jsonl with huggingface_hub
Upload chunk_298.jsonl with huggingface_hub
Upload chunk_128.jsonl with huggingface_hub