datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
LaTeX_Image_Pairs
LaTeX Image Pairs Dataset
This dataset comprises a unique collection of LaTeX expressions paired with their corresponding images. The LaTeX expressions were meticulously scraped from a variety of open-source textbooks, ensuring a diverse and comprehensive dataset. Sample references from these textbooks will be provided to illustrate the sources of these expressions.
In addition to the raw LaTeX expressions, this dataset includes images of the rendered expressions. Each LaTeX… See the full description on the dataset page: https://huggingface.co/datasets/henryholloway/LaTeX_Image_Pairs.ImageText-Question-answer-pairs-58K-Claude-3.5-Sonnnet
REILX/ImageText-Question-answer-pairs-58K-Claude-3.5-Sonnnet
从VisualGenome数据集V1.2中随机抽取21717张图片,利用Claude-3-opus-20240229和Claude-3-sonnet-20240620两个模型生成了总计58312个问答对,每张图片约3个问答,其中必有一个关于图像细节的问答。Claude-3-opus-20240229模型贡献了约3,028个问答对,而Claude-3-sonnet-20240620模型则生成了剩余的问答对。
Code
使用以下代码生成问答对:
# -*- coding: gbk -*-
import os
import random
import shutil
import re
import json
import requests
import base64
import time
from tqdm import tqdm
from json_repair import repair_json… See the full description on the dataset page: https://huggingface.co/datasets/REILX/ImageText-Question-answer-pairs-58K-Claude-3.5-Sonnnet.
