earthroverprogram/lucas-mega
LUCAS-MEGA LUCAS-MEGA: A Large-Scale Multimodal Dataset for Representation Learning in Soil-Environment Systems Manuscript Introduction LUCAS-MEGA is a large-scale multimodal dataset for soil-environment systems, built by fusing heterogeneous European soil and environmental datasets with the LUCAS soil survey as the backbone. The released dataset contains: 72,000+ soil samples 1,000+ fused soil and environmental features 68 integrated ESDAC source datasets… See the full description on the dataset page: https://huggingface.co/datasets/earthroverprogram/lucas-mega.
0299
1from pathlib import Path2from src.process.io import prepare_dirs, unzip, upload3from src.process.processor import process_tif4 5# === Step 1: Set up local and drive directories ===6local_processed_dir, drive_download_dir, drive_processed_dir = (7 prepare_dirs("esdac", Path(__file__).parent.stem)8)9 10# === Step 2: Unzip all ZIP files from drive/download to local/processed ===11unzip(local_processed_dir, drive_download_dir, zip_files=None)12 13# === Step 3: Process all TIFF files under local/processed ===14move_list = []15for tif_path in sorted(local_processed_dir.rglob("*.tif")):16 move_list = process_tif(tif_path, move_list)17 18# === Step 4: Upload processed files to drive/processed and clean up local ===19upload(local_processed_dir, drive_processed_dir, move_list)20 