InstructionTuning
Instruction_TuningFiles Contents Details :
Post-Process Code Info :
data_process.py
iamai_seed_tasks_v1.csv :
IAMAI's seed tasks - Version 1 (879)
Total Dataset Size : 879
===============================================================================================
iamai_v1.csv :
Instruction Tuning Dataset collected using seeds from iamai_seed_tasks_v1.csv and ChatGPT API for both prompts and outputs (~248k)
Total Dataset Size : ~248k
iamai_summarization_v1.csv :
Article Summarization dataset (both… See the full description on the dataset page: https://huggingface.co/datasets/iamplus/Instruction_Tuning.Instruction-tuning_Datasetscartoonization
Instruction-prompted cartoonization dataset
This dataset was created from 5000 images randomly sampled from the Imagenette dataset. For more
details on how the dataset was created, check out this directory.
Following figure depicts the data preparation workflow:
Known limitations and biases
The dataset was derived from Imagenette, which, in turn, was derived from ImageNet. So, naturally, this
dataset inherits the limitations and biases of ImageNet.… See the full description on the dataset page: https://huggingface.co/datasets/instruction-tuning-sd/cartoonization.low-level-image-proc
Instruction-prompted low-level image processing dataset
To construct this dataset, we took different number of samples from the following datasets for each task and constructed
a single dataset with prompts added like so:
Task
Prompt
Dataset
Number of samples
Deblurring
“deblur the blurry image”
REDS (train_blur and train_sharp)
1200
Deraining
“derain the image”
Rain13k
686
Denoising
“denoise the noisy image”
SIDD
8
Low-light image enhancement
"enhance the… See the full description on the dataset page: https://huggingface.co/datasets/instruction-tuning-sd/low-level-image-proc.PubMedVision_InstructionTuning_VQA_splittedOneLLM_InstructionTuning
Data
Data Format
All finetuning data are converted into multi-turn conversation format. The .json file contains a list of training samples, where each sample contains the following keys: id, image and conversations. For example,
{'id': '000000033471', 'image': 'InstructionTuning/image/coco/train2017/000000033471.jpg', 'conversations': [{'from': 'human', 'value': 'What are the colors of the bus in the image?'}, {'from': 'gpt', 'value': 'The bus in the image is white and… See the full description on the dataset page: https://huggingface.co/datasets/csuhan/OneLLM_InstructionTuning.