marin-dna/genomes-v5-validation-intervals-v5_255_255
bolinas-dna/genomes-v5-validation-intervals-v5_255_255 Conservation-encoded human validation probe for the v5 (CDS) region recipe, matched to the bolinas-dna/genomes-v5-genome_set-*-intervals-v5_255_128 training sets. Produced by the snakemake/training_dataset pipeline (commit 8db58254831f). Size 16,384 sequences in validation.parquet (a subsample of up to 16,384 human windows). Exact row count — HuggingFace's auto-generated count can be wrong. Region… See the full description on the dataset page: https://huggingface.co/datasets/marin-dna/genomes-v5-validation-intervals-v5_255_255.
bolinas-dna/genomes-v5-validation-intervals-v5_255_255
Conservation-encoded human validation probe for the v5 (CDS) region recipe, matched to the bolinas-dna/genomes-v5-genome_set-*-intervals-v5_255_128 training sets. Produced by the `snakemake/training_dataset` pipeline (commit `8db58254831f`).
Size
16,384 sequences in validation.parquet (a subsample of up to 16,384 human windows). Exact row count — HuggingFace's auto-generated count can be wrong.
Region recipe: v5
Coding sequence (CDS): every annotated CDS interval, kept if 20 bp–10 kb long, extended by 20 bp on each side (to capture splice-site signal at exon boundaries), then expanded to a minimum length of 256 bp and intersected with defined.
Built on the human genome (GRCh38 / GCF_000001405.40).
Schema
A single validation.parquet. Each row:
Sequence case = phyloP conservation
Each base's case is overwritten to encode conservation (the source soft-masking is discarded):
- Uppercase — phyloP-241way (Cactus 241-way alignment) score ≥ 2.27 at this position (conserved).
- Lowercase — score < 2.27, or there is no alignment / the score is missing (
NaN, which compares false). Non-conserved and unaligned bases are not distinguished.
⚠️ This is the opposite convention to the training sets, where lowercase means repeat-masked, not non-conserved.
Construction
- Build the
v5interval set on the human genome and tile into 255 bp / 255 bp (non-overlapping) windows. - Subsample up to 16384 windows (seed 42).
- Re-encode each base's case by phyloP-241way ≥ 2.27.
Provenance
- Pipeline: `snakemake/training_dataset` @ commit `8db58254831f`
- Matched training family:
bolinas-dna/genomes-v5-genome_set-*-intervals-v5_255_128
