OneScience-Group/mp20

<p align="center"> <strong> <span style="font-size: 30px;">MP-20</span> </strong> </p>

Dataset Description

MP-20 is derived from the Materials Project database (Jain et al., 2013) and contains approximately 45,000 common inorganic materials. It covers most experimentally known materials with no more than 20 atoms in the unit cell. The data includes elemental compositions, CIF structures, space groups, formation energies per atom, DFT band gaps, bulk moduli, and magnetic densities.

Source paper: A. Jain et al., Commentary: The Materials Project: A materials genome approach to accelerating materials innovation, APL Materials 1, 011002 (2013).<br> Paper: https://pubs.aip.org/aip/apm/article/1/1/011002/119685<br> DOI: https://doi.org/10.1063/1.4812323

This repository provides both raw CSV files and preprocessed caches. The data split contains 27,136 structures in the training set, 9,047 structures in the validation set, and 9,046 structures in the test set, for a total of 45,229 crystal structures.

The current data package contains 30 data files totaling approximately 83 MB.

Supported Tasks

This standardized data repository organizes the MP-20 training, validation, and test data for:

• —Data analysis and statistics for inorganic crystal structures
• —Training and evaluation of crystal structure generation tasks
• —Conditional modeling of material properties
• —Research on properties such as formation energy, band gap, bulk modulus, and magnetic density
• —Crystal data loading, preprocessing, and data pipeline validation

Dataset Format and Structure

The data files are located in the data/MP20/ directory:

data/MP20/
├── raw/mp_20/
│   ├── train.csv
│   ├── val.csv
│   └── test.csv
└── cache/mp_20/
    ├── train/
    ├── val/
    └── test/

CSV Data Format

Each row in a CSV file corresponds to one crystal structure. The cif field stores complete multiline CIF text, so the number of samples cannot be determined using a standard text line count.

Cache Data Format

Each train, val, and test cache directory contains the following files:

How to Use the Dataset

Download the dataset:

hf download OneScience-Group/mp20 --repo-type dataset

Validate the dataset directory, sample counts, array shapes, and SHA256 checksums:

python scripts/validate_mp20.py \
  --dataset-root data/MP20 \
  --checksum-manifest metadata/sha256_manifest.txt

Skip SHA256 verification and check only the data structure:

python scripts/validate_mp20.py \
  --dataset-root data/MP20 \
  --skip-checksum

Official OneScience Information

Limitations and License

This repository standardizes the directory structure of the MP-20 data and provides raw CSV files, preprocessed caches, a checksum manifest, and a validation script. It does not generate new samples or alter the original crystal structures or property data.

• —The structures and properties in the data come from the Materials Project and the original MP-20 data curation pipeline. When using the data, cite the 2013 Materials Project paper by Jain et al. and the specific data version used.
• —Some material properties contain missing values and must be filtered or masked as appropriate for the task.
• —The Materials Project states that its data is licensed under the Creative Commons Attribution 4.0 International (CC BY 4.0) license. This repository uses the same data license; appropriate attribution must be retained when using or redistributing the data.
• —If individual entries contain third-party contributed data or additional restrictions, refer to the source of the corresponding entry and the information on its Materials Project page.