pkanithi/primate-proteins
Dataset Transformation Summary Original Dataset: monsoon-nlp/primate-proteinsTransformed Dataset: pkanithi/primate-proteins Changes Made Added messages Column Added a new messages column in ChatML format Each example now contains a conversation structure with system, user, and assistant messages Data Filtering Filtered out proteins with no annotation (annotation != None) Ensures all examples have valid ground truth annotations… See the full description on the dataset page: https://huggingface.co/datasets/pkanithi/primate-proteins.
Dataset Transformation Summary
Original Dataset: monsoon-nlp/primate-proteins Transformed Dataset: pkanithi/primate-proteins
Changes Made
Added messages Column
- Added a new
messagescolumn in ChatML format - Each example now contains a conversation structure with system, user, and assistant messages
Data Filtering
- Filtered out proteins with no annotation (
annotation != None) - Ensures all examples have valid ground truth annotations
Dataset Splitting
- Split the original 'train' split into train and test sets
- Test set: 4,000 examples
- Train set: Remaining examples
- Used seed=42 for reproducible splits
Chat Format Structure
Each example now has a messages array with:
- System message: Instructions for protein annotation assistance
- User message: Protein entry with name, species, and sequence
- Assistant message: Original annotation from the dataset
The user message format:
Here is the protein entry:
- protein_name: [protein_name]
- species: [species]
- sequence: [sequence]Result
The dataset is now in ChatML format suitable for supervised fine-tuning with train/test splits, while preserving all original protein annotation content.
