datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
Recap-Long-Laion
Dataset Card for Recap-Long-Laion
Dataset Description
This dataset consists of long captions of ~49M images from LAION-5B dataset. The long captions are generated by pre-trained Multi-modality Large Language Models (ShareGPT4V/InstructBLIP/LLava1.5) with the text prompt "Describe the image in detail".
Licensing Information
We distribute the image url with long captions under a standard Creative Common CC-BY-4.0 license. The individual images are under their own… See the full description on the dataset page: https://huggingface.co/datasets/weiwu-ww/Recap-Long-Laion.Recap-Long-Coyo
Dataset Card for Recap-Long-Coyo
Dataset Description
This dataset consists of long captions of ~24M images from Coyo-700M dataset. The long captions are generated by pre-trained Multi-modality Large Language Models (ShareGPT4V/InstructBLIP/LLava1.5) with the text prompt "Describe the image in detail".
Licensing Information
We distribute the image url with long captions under a standard Creative Common CC-BY-4.0 license. The individual images are under their own… See the full description on the dataset page: https://huggingface.co/datasets/weiwu-ww/Recap-Long-Coyo.commoncatalog-cc-by-recap
CommonCatalog CC-BY Recaptioning
このリポジトリはCommonCatalog CC-BYを拡張して、追加の情報を入れたものです。 以下の情報が追加されています。
Phi-3 VisionでDense Captioningした英語キャプション
主キーはphotoidですので、CommonCatalog CC-BYと結合するなりして使ってください。 streaming=Trueで読み込むと同じ順に読み込まれますのでそれを利用するのが一番楽です。
Sample Code
import pandas
from datasets import load_dataset
from tqdm import tqdm
import json
df=pandas.read_csv("commoncatalog-cc-by-phi3.csv")
dataset = load_dataset("common-canvas/commoncatalog-cc-by",split="train",streaming=True)… See the full description on the dataset page: https://huggingface.co/datasets/alfredplpl/commoncatalog-cc-by-recap.commoncanvas-cc-by-recap-2
CommonCatalog CC-BY Recaptioning 2
このリポジトリはCommonCatalog CC-BYを拡張して、追加の情報を入れたものです。 以下の情報が追加されています。
Florence-2-large-ftでDense Captioning (More detailed caption) した英語キャプション
streaming=Trueで読み込むと同じ順に読み込まれますのでそれを利用するのが一番楽です。
Sample Code
import pandas
from datasets import load_dataset
from tqdm import tqdm
import json
df=pandas.read_csv("commoncatalog-cc-by-phi3.csv")
dataset = load_dataset("common-canvas/commoncatalog-cc-by",split="train",streaming=True)
data_info=[]
for… See the full description on the dataset page: https://huggingface.co/datasets/alfredplpl/commoncanvas-cc-by-recap-2.