earthroverprogram/lucas-mega
LUCAS-MEGA LUCAS-MEGA: A Large-Scale Multimodal Dataset for Representation Learning in Soil-Environment Systems Manuscript Introduction LUCAS-MEGA is a large-scale multimodal dataset for soil-environment systems, built by fusing heterogeneous European soil and environmental datasets with the LUCAS soil survey as the backbone. The released dataset contains: 72,000+ soil samples 1,000+ fused soil and environmental features 68 integrated ESDAC source datasets… See the full description on the dataset page: https://huggingface.co/datasets/earthroverprogram/lucas-mega.
0303
1from pathlib import Path2from src.process.io import prepare_dirs, unzip, upload3from src.process.processor import process_excel4 5# === Step 1: Prepare directory paths for local and drive folders ===6local_processed_dir, drive_download_dir, drive_processed_dir = (7 prepare_dirs("esdac", Path(__file__).parent.stem)8)9 10# === Step 2: Unzip all ZIP files from drive/download into local/processed ===11unzip(local_processed_dir, drive_download_dir)12 13# === Step 3: Convert Excel file to CSV (auto-detect header row) ===14move_list = process_excel(15 local_processed_dir / "Biochar_Meta-analysis_ Database/Biochar_Meta-analysis_ Database.xls"16)17 18# === Step 4: Upload processed files to drive/processed and optionally clean up local ===19upload(local_processed_dir, drive_processed_dir, move_list)20