mlfoundations/MINT-1T-PDF-CC-2023-23
🍃 MINT-1T:Scaling Open-Source Multimodal Data by 10x: A Multimodal Dataset with One Trillion Tokens 🍃 MINT-1T is an open-source Multimodal INTerleaved dataset with 1 trillion text tokens and 3.4 billion images, a 10x scale-up from existing open-source datasets. Additionally, we include previously untapped sources such as PDFs and ArXiv papers. 🍃 MINT-1T is designed to facilitate research in multimodal pretraining. 🍃 MINT-1T is created by a team from the University of Washington in… See the full description on the dataset page: https://huggingface.co/datasets/mlfoundations/MINT-1T-PDF-CC-2023-23.
Update README.md
fix-tiff-mismatch (#2)
Update README.md
Upload interleaved-example-twitter.png
Upload interleaved-example-twitter.png
Update README.md
Update README.md
Upload interleaved-example-twitter.png
Update README.md
Create README.md
Upload tar files from S3 (Batch 1)
Upload tar files from S3 (Batch 141)
Upload tar files from S3 (Batch 140)
Upload tar files from S3 (Batch 139)
Upload tar files from S3 (Batch 138)
Upload tar files from S3 (Batch 137)
Upload tar files from S3 (Batch 136)
Upload tar files from S3 (Batch 135)
Upload tar files from S3 (Batch 134)
Upload tar files from S3 (Batch 133)
Upload tar files from S3 (Batch 132)
Upload tar files from S3 (Batch 131)
Upload tar files from S3 (Batch 130)
Upload tar files from S3 (Batch 129)
Upload tar files from S3 (Batch 128)
Upload tar files from S3 (Batch 127)
Upload tar files from S3 (Batch 126)
Upload tar files from S3 (Batch 125)
Upload tar files from S3 (Batch 124)
Upload tar files from S3 (Batch 123)
Upload tar files from S3 (Batch 122)
Upload tar files from S3 (Batch 121)
Upload tar files from S3 (Batch 120)
Upload tar files from S3 (Batch 119)
Upload tar files from S3 (Batch 118)
Upload tar files from S3 (Batch 117)
Upload tar files from S3 (Batch 116)
Upload tar files from S3 (Batch 115)
Upload tar files from S3 (Batch 114)
Upload tar files from S3 (Batch 113)
Upload tar files from S3 (Batch 112)
Upload tar files from S3 (Batch 111)
Upload tar files from S3 (Batch 110)
Upload tar files from S3 (Batch 109)
Upload tar files from S3 (Batch 108)
Upload tar files from S3 (Batch 107)
Upload tar files from S3 (Batch 106)
Upload tar files from S3 (Batch 105)
Upload tar files from S3 (Batch 104)
Upload tar files from S3 (Batch 103)