msiudek/astroPT_euclid_Q1_desi_dr1_dataset

DESI DR1 × Euclid Q1 Dataset

Dataset Description

This dataset contains the cross-matched catalog between DESI Data Release 1 (DR1) and Quick Data Release 1 (Q1) data.

Dataset Summary

• —Total Sources: 39,850 galaxies
• —Cross-match Radius: 0.5 arcsec
• —Data Products:
• —Euclid VIS imaging
• —Euclid NISP imaging (Y, J, H bands)
• —DESI spectra

Source Data

1) DESI Sample Selection: Applied quality cuts to DESI DR1:

• —ZCAT_PRIMARY == True
• —ZWARN == 0 or ZWARN == 4
• —COADD_FIBERSTATUS == 0
• —SPECTYPE != 'STAR'
• —Z > 0

2) Euclid Sample Selection: Applied quality cuts to Euclid MER Q1:

• —VIS_DET == 1
• —gaia_id IS NULL
• —spurious_prob < 0.2
• —fluxdetectiontotal > 0.0

Data Splits

• —Train: 80% (31,880 galaxies)
• —Test: 20% (7,970 galaxies)

Split created using stratified random sampling with random_state=42.

Usage

from datasets import load_dataset

# Load the full dataset
dataset = load_dataset("msiudek/astroPT_euclid_Q1_desi_dr1_dataset")

# Access train/test splits
train_data = dataset['train']
test_data = dataset['test']

# Example: Access a single sample
sample = train_data[0]
vis_image = sample['vis_image']
spectrum = sample['spectrum']
redshift = sample['redshift']

Metadata catalog

A companion metadata catalog (FITS table) with per-object properties and cross-match details is published as a separate dataset on Hugging Face:

• —Metadata dataset: https://huggingface.co/datasets/msiudek/astroPTeuclidQ1desidr1_metadata

How to access the metadata FITS directly from the hub using Astropy:

from huggingface_hub import hf_hub_download
from astropy.table import Table
import warnings
from astropy.units.core import UnitsWarning

# Optional: silence non-standard FITS unit warnings (e.g., 'nanomaggy', 'NA')
warnings.filterwarnings("ignore", category=UnitsWarning)

fits_path = hf_hub_download(
  repo_id="msiudek/astroPT_euclid_Q1_desi_dr1_metadata",
  repo_type="dataset",
  filename="DESI_DR1_Euclid_Q1_dataset_catalog_EM.fits",
)
tab = Table.read(fits_path, format="fits")
print(tab)

Citation

If you use this dataset, please cite:

@dataset{euclid_desi_dr1_q1,
  author = {Siudek, M. and collaborators},
  title = {DESI DR1 × Euclid Q1 Cross-matched Dataset},
  year = {2025},
  url = {https://huggingface.co/datasets/msiudek/astroPT_euclid_Q1_desi_dr1_dataset}
}