multi-phase
Mary-Cassatt-Oil-Messier-Phase2-Log-SNR-Multiscale-CropMary-Cassatt-Oil-Messier-Phase1-Log-SNR-Multiscale-Croptink-reranker-phase6_minilm_multikindllama3-8b-with-conclusion-Alphabet_False_Multiple3_phase1tink-reranker-phase5_minilm_multikindtink-reranker-phase7_minilm_multikindMary-Cassatt-Oil-Messier-Phase1-Log-SNR-Multiscale-Crop-Sagellama3-8b-with-conclusion-Alphabet_False_Multiple1_phase1
MultiPhaseneo_sft_phase2_multi
1. The original dataset can be found at:
https://huggingface.co/datasets/m-a-p/neo_sft_phase2
2. Split multi-turn conversations into individual single-turn samples
Approach: Treat each round of dialogue as a separate question-and-answer pair, and construct the sample by leveraging the contextual information.
Specific Operations:
For each "conversation," iterate through all the dialogue rounds.
Concatenate the "value" of all "human" turns within each "conversation" to… See the full description on the dataset page: https://huggingface.co/datasets/REILX/neo_sft_phase2_multi.
