chatqa-2
Datasets
All datasets matching “chatqa-2”ChatQA2-Long-SFT-data
Data Description
Here, we release the full long SFT training dataset of ChatQA2. It consists of two parts: long_sft and NarrativeQA_131072. The long_sft dataset is built and derived from existing datasets: LongAlpaca12k, GPT-4 samples from Open Orca, and Long Data Collections. The NarrativeQA_131072 dataset is synthetically generated from NarrativeQA by adding related paragraphs to the given ground truth summary. For the first two steps training of ChatQA-2, we follow ChatQA1.5.
For… See the full description on the dataset page: https://huggingface.co/datasets/nvidia/ChatQA2-Long-SFT-data.ChatQA2-Long-SFT-data-long_sft_train_filteredChatQA2Seg
Dataset Card for ChatQA2Seg
The segmented version of a filtered version of ChatQA2.
We use the segmenter with recursion depth 2 and threshold value 0.2 and 0.4 for each level of recursion respectively.
This dataset has been used as the training dataset in the paper Towards Generalization of Block Attention via Automatic Segmentation and Block Distillation.
Dataset Details
Dataset Description
The fields in the cut_item:
txt_marker: The text… See the full description on the dataset page: https://huggingface.co/datasets/Syon-Li/ChatQA2Seg.