jattcoder00/ditec-wdn

--

Dataset Card for DiTEC-WDN

Table of Contents

• —Table of Contents
• —Dataset Description
• —Dataset Summary
• —Supported Tasks and Leaderboards
• —Languages
• —Dataset Structure
• —Data Instances
• —Data Fields
• —Data Splits
• —Dataset Creation
• —Curation Rationale
• —Source Data
• —Annotations
• —Personal and Sensitive Information
• —Considerations for Using the Data
• —Social Impact of Dataset
• —Discussion of Biases
• —Other Known Limitations
• —Additional Information
• —Dataset Curators
• —Licensing Information
• —Citation Information
• —Contributions

Dataset Description

• —Homepage: https://ditec-project.github.io/DiTEC_WDN_dataset/
• —Repository: https://github.com/DiTEC-project/DiTEC_WDN_dataset
• —Paper: https://www.arxiv.org/abs/2503.17167
• —Leaderboard: Update later!
• —Point of Contact: Huy Truong

Dataset Summary

DiTEC-WDN Dataset consists of 36 Water Distribution Networks (WDNs). Each network has unique 1,000 scenarios with distinct characteristics. Scenario represents a timeseries of directed shared-topology graphs, referred to as states or snapshots. In terms of graph-ml, it can be seen as a spatiotemporal graph where nodes and edges are multivariate time series.

A node can represent a reservoir, junction, or tank, while an edge refers to a pipe, pump, or valve. Notably, this dataset specifies concrete valve types, including PSV, PBV, FCV, TCV, and GPV. In addition, pump has two distinct types: head pump and power pump. Each component has its own parameters, as listed in the below table:

¹ SIFU stands for SI Flow Units including LPS, LPM, MLD, CMH, and CMD. ² DW refers to Darcy-Weisbach headloss equation.

Parameter-oriented dataset

For general usage, user may want to download a single parameter of a specific component in a concrete network. This can be done in this example code:

from datasets import load_dataset
raw_dataset = load_dataset(path="rugds/ditec-wdn", data_files="EXN_2GB_24H/junction_elevation*")

The downloaded subset is pressure values of all junctions in network EXN. User should check out the file structure to observe available parameters in each WDN folder.

Component-based dataset

For those who download all parameters w.r.t. a generic component type (node or link), we recommend the list of 72 configs in this README.md. The naming format is <network_name>_<storage_size>_<duration>_<general_component>. Please ensure sufficient storage before processing the dataset. Let's see this example:

from datasets import load_dataset
raw_dataset = load_dataset(path="rugds/ditec-wdn", name="EXN_2GB_24H_node")

This will download parquet files containing nodal features of the network EXN. Note that this action merges all parameters regardless of their type, so user should pay attention to the shape.

PyTorch(PyG) dataset

We also support a data interface to provide a parameter-mergable and ready-to-use dataset for PyTorch users. The interface and examples can be found in our official GitHub.

Miscellaneous information

All metadata, such as profiler info, simulation and optimization configurations, and network topology, is included in every Parquet file for a given WDN. To access it, user should retrieve a target WDN folder, pick a (light-weight) parquet file, and read its metadata using pyarrow libary. We provide a snippet supporting this as follows:

import tempfile
from huggingface_hub import hf_hub_download
import pyarrow.parquet as pq
def get_metadata(parquet_path: str, path: str = "rugds/ditec-wdn", key: str = "attrs") -> dict:
    with tempfile.TemporaryDirectory(dir="data", ignore_cleanup_errors=True) as dirpath:
        parquet_path = hf_hub_download(repo_id=path, repo_type="dataset", filename=parquet_path, local_dir=dirpath)
        metadata = pq.read_metadata(parquet_path)
        binary_meta_dict = metadata.metadata
        bkey = key.encode()
        if bkey in binary_meta_dict:
            attrs = binary_meta_dict[bkey].decode()
            return attrs
        else:
            print("Error! Key not found!")
            return {}

Supported Tasks and Leaderboards

• —graph-ml: The dataset can be used to train a model for graph-related tasks, including node-level, link-level, and graph-level regressions.
• —time-series-forecasting: The dataset can be used to train a model for time series forecasting tasks, including multivariate state estimation and next state forecasting.

Success on both tasks is typically measured by achieving:\ (1) low Mean Absolute Error (MAE)\ (2) low Mean Absolute Percentage Error (MAPE)\ (3) low (Root) Mean Squared Error (RMSE/MSE)\ (4) high coefficient of determination (R**2)\ (5) high Nash–Sutcliffe Efficiency (NSE)

Languages

en

Dataset Structure

Data Instances

[More Information Needed]

Data Fields

[More Information Needed]

Data Splits

[More Information Needed]

Dataset Creation

Curation Rationale

The dataset is designed to (1) encourage open scientific research in the fundamental field of water, (2) eliminate the risk of exposing sensitive data while addressing strict privacy concerns that hinder advancements in machine learning, and (3) fulfill the need for a large-scale water distribution network benchmark for study comparisons and scenario analysis.

Source Data

The source data consists of simulation metadata files (.INP) collected from public resources. However, we retain only topology and component names, discarding all hydraulic-related values (e.g., elevation, demand time series, diameter, etc). These discarded values are later re-synthesized by our generator. As a result, the dataset contains no real or sensitive information from the original metadata or real-world systems.

Initial Data Collection and Normalization

The list below briefly describes the original water distribution networks:

Their INPs are available here. Please note that the files were employed exclusively for optimization, not included in the dataset, as each scenario corresponds to a distinct INP file theoretically.

Who are the source language producers?

The dataset was machine-generated. The process detail could be found in the co-existence paper (see Citation Information).

Considerations for Using the Data

Social Impact of Dataset

[More Information Needed]

Discussion of Biases

[More Information Needed]

Other Known Limitations

The known limitations have been discussed in the binding paper. Please see Citation Information.

Additional Information

Dataset Curators

This work is funded by the project DiTEC: Digital Twin for Evolutionary Changes in Water Networks (NWO 19454).

Licensing Information

CC BY 4.0

Citation Information

For the dataset usage, please cite this:

@article{truong2025dwd,
  author    = {Huy Truong and Andr{\'e}s Tello and Alexander Lazovik and Victoria Degeler},
  title     = {DiTEC-WDN: A Large-Scale Dataset of Hydraulic Scenarios across Multiple Water Distribution Networks},
  journal   = {Scientific Data},
  year      = {2025},
  volume    = {12},
  number    = {1},
  pages     = {1733},
  doi       = {10.1038/s41597-025-06026-0},
  url       = {https://doi.org/10.1038/s41597-025-06026-0},
  issn      = {2052-4463}
}

Contributions

We thank the Center for Information Technology of the University of Groningen for their support and for providing access to the Hábrók high performance computing cluster.