ULM-DS-Lab/food-composition-matrix

Food Composition Nutrient Matrix — TKPI 2017 & USDA SR Legacy 2018

This repository contains two food composition datasets reformatted as wide-format nutrient matrices, suitable for a wide range of research tasks including nutrient prediction, food type classification, missing value imputation, dietary analysis, and other machine learning applications on food data. Both datasets share a harmonised set of 18 common nutrients, enabling cross-dataset generalization experiments.

Subsets

Load a specific subset:

from datasets import load_dataset

tkpi  = load_dataset("ULM-DS-Lab/food-composition-matrix", name="tkpi")
usda  = load_dataset("ULM-DS-Lab/food-composition-matrix", name="usda_sr_legacy")

Subset 1 — TKPI 2017 (tkpi)

Source

Kementerian Kesehatan Republik Indonesia. (2017). Tabel Komposisi Pangan Indonesia 2017. Jakarta: Kemenkes RI. https://repository.kemkes.go.id/book/777

TKPI 2017 (Tabel Komposisi Pangan Indonesia) is the official Indonesian Food Composition Table published by the Indonesian Ministry of Health. It extends TKPI 2009 through imputation of missing values (imputed values and borrowed values) and addition of new foods sourced from Badan Ketahanan Pangan, Kementerian Pertanian (Food Security Agency, Ministry of Agriculture).

The original publication is a PDF. This CSV was produced by OCR digitisation followed by manual verification to correct recognition errors.

Columns

Missingness Profile

Missing values (NaN) indicate nutrients not measured for that food. Zeros are genuine observed values.

Underlying Sources (TKPI 2009 and predecessors)

1. 1.Lie Goan Hong dan Oey Kam Nio, 1964. Daftar Analisis Bahan Pangan. Lembaga Makanan Rakyat. Jakarta.
2. 2.Mahmud Mien K et al., 1990. Komposisi Zat Gizi Pangan Indonesia. Departemen Kesehatan R.I.
3. 3.Mien Karmini et al., 2001. Komposisi Zat Gizi Pangan Indonesia. Departemen Kesehatan RI.
4. 4.Mahmud, Mien K, Hermana, dan Rossi Rozanna, 1993. Komposisi Zat Gizi Pangan Siap Santap. Puslitbang Gizi, Balitbangkes.
5. 5.Oei Kam Nio, 1992. Daftar Analisis Bahan Pangan. Universitas Indonesia. Jakarta.
6. 6.Woot-Tsuen Wu Leung et al., 1972. Food Composition Table for Use in East Asia. FAO / US DHEW.

License

TKPI 2017 is an official publication of the Indonesian Ministry of Health (Kemenkes RI), publicly accessible at https://repository.kemkes.go.id/book/777. Users should cite the original publication and verify redistribution rights with Kemenkes RI for commercial use.

Citation:

Kementerian Kesehatan Republik Indonesia. (2017). Tabel Komposisi Pangan Indonesia 2017.
Jakarta: Kemenkes RI. https://repository.kemkes.go.id/book/777

Subset 2 — USDA SR Legacy 2018 (usda_sr_legacy)

Source

U.S. Department of Agriculture, Agricultural Research Service. (2018). USDA Standard Reference Legacy Release. FoodData Central. https://fdc.nal.usda.gov/download-datasets.html

SR Legacy is the historical USDA Standard Reference database, now hosted on FoodData Central. It is a public domain US government work with no restrictions on use or redistribution.

Preprocessing Applied

The original release is a relational long-format database (food.csv + food_nutrient.csv). Preprocessing for this subset:

1. 1.Filtered to 18 target nutrients matched to the TKPI nutrient set (see table below).
2. 2.Pivoted from long to wide format (one row per food, one column per nutrient).
3. 3.Retained only rows with at least one non-NaN value.
4. 4.Column headers renamed to English standard names for cross-dataset compatibility.
5. 5.No imputation applied — NaN reflects genuine absence of measurement.

Columns

Total_Carotenoids is present in TKPI but has no direct equivalent in SR Legacy and is therefore excluded from this subset.

License

USDA SR Legacy is a US government work in the public domain. No restrictions apply. See: https://www.ars.usda.gov/about-ars/ars-is-public-domain/

Citation:

U.S. Department of Agriculture, Agricultural Research Service. (2018).
USDA Standard Reference Legacy Release. FoodData Central.
https://fdc.nal.usda.gov/

Dataset Comparison

Repository File Structure

food-composition-matrix/
├── README.md                     ← this file
├── tkpi_2017.csv                 ← TKPI subset (1,146 × 22 columns)
└── usda_sr_legacy_2018_wide.csv  ← USDA subset (7,793 × 20 columns)

Citation (this dataset)

F Indriani. (2026). Food Composition Nutrient Matrix — TKPI 2017 & USDA SR Legacy 2018 [Data set].
Hugging Face. https://huggingface.co/datasets/ULM-DS-Lab/food-composition-matrix