mlfoundations/MINT-1T-PDF-CC-2024-10
🍃 MINT-1T:Scaling Open-Source Multimodal Data by 10x: A Multimodal Dataset with One Trillion Tokens 🍃 MINT-1T is an open-source Multimodal INTerleaved dataset with 1 trillion text tokens and 3.4 billion images, a 10x scale-up from existing open-source datasets. Additionally, we include previously untapped sources such as PDFs and ArXiv papers. 🍃 MINT-1T is designed to facilitate research in multimodal pretraining. 🍃 MINT-1T is created by a team from the University of Washington in… See the full description on the dataset page: https://huggingface.co/datasets/mlfoundations/MINT-1T-PDF-CC-2024-10.
Update README.md
fix-tiff-mismatch (#1)
Update README.md
Upload interleaved-example-twitter.png
Upload interleaved-example-twitter.png
Update README.md
Update README.md
Upload interleaved-example-twitter.png
Update README.md
Create README.md
Upload tar files from S3 (Batch 1)
Upload tar files from S3 (Batch 730)
Upload tar files from S3 (Batch 729)
Upload tar files from S3 (Batch 728)
Upload tar files from S3 (Batch 727)
Upload tar files from S3 (Batch 726)
Upload tar files from S3 (Batch 725)
Upload tar files from S3 (Batch 724)
Upload tar files from S3 (Batch 723)
Upload tar files from S3 (Batch 722)
Upload tar files from S3 (Batch 721)
Upload tar files from S3 (Batch 720)
Upload tar files from S3 (Batch 719)
Upload tar files from S3 (Batch 718)
Upload tar files from S3 (Batch 717)
Upload tar files from S3 (Batch 716)
Upload tar files from S3 (Batch 715)
Upload tar files from S3 (Batch 714)
Upload tar files from S3 (Batch 713)
Upload tar files from S3 (Batch 712)
Upload tar files from S3 (Batch 711)
Upload tar files from S3 (Batch 710)
Upload tar files from S3 (Batch 709)
Upload tar files from S3 (Batch 708)
Upload tar files from S3 (Batch 707)
Upload tar files from S3 (Batch 706)
Upload tar files from S3 (Batch 705)
Upload tar files from S3 (Batch 704)
Upload tar files from S3 (Batch 703)
Upload tar files from S3 (Batch 702)
Upload tar files from S3 (Batch 701)
Upload tar files from S3 (Batch 700)
Upload tar files from S3 (Batch 699)
Upload tar files from S3 (Batch 698)
Upload tar files from S3 (Batch 697)
Upload tar files from S3 (Batch 696)
Upload tar files from S3 (Batch 695)
Upload tar files from S3 (Batch 694)
Upload tar files from S3 (Batch 693)
Upload tar files from S3 (Batch 692)