CoolFace
Datasetpublic

QasimHussain/Human_Gut_Microbiome_Atlas

Deep Metagenomics of the Human Gut Microbiome in IBD: A Multi-Omics Data Atlas A curated longitudinal dataset and computational framework for dissecting the temporal ecology of Inflammatory Bowel Disease (IBD). Abstract This project presents a comprehensive, high-resolution computational analysis of the human gut microbiome in Inflammatory Bowel Disease (IBD), leveraging deep metagenomic sequencing data from the HMP2 (Integrative Human Microbiome Project)… See the full description on the dataset page: https://huggingface.co/datasets/QasimHussain/Human_Gut_Microbiome_Atlas.

sourceHugging Faceupdated 2mo agoView on Hugging Face
0likes93downloads
Dataset Card

Deep Metagenomics of the Human Gut Microbiome in IBD: A Multi-Omics Data Atlas

![Open in Hugging Face](https://huggingface.co/datasets/QasimHussain/HumanGutMicrobiomeAtlas/blob/main/notebooks/HumanGutMicrobiomeAtlas.ipynb) ![License: MIT](https://opensource.org/licenses/MIT)

[image]

A curated longitudinal dataset and computational framework for dissecting the temporal ecology of Inflammatory Bowel Disease (IBD).

Abstract

This project presents a comprehensive, high-resolution computational analysis of the human gut microbiome in Inflammatory Bowel Disease (IBD), leveraging deep metagenomic sequencing data from the HMP2 (Integrative Human Microbiome Project) cohort. Through a rigorous multi-modal pipeline integrating compositional data analysis (CoDA), machine learning, longitudinal trajectory modeling, and ecological network reconstruction, we dissect the complex dysbiosis characteristic of Crohn's Disease and Ulcerative Colitis. Our findings reveal a convergent axis of ecological collapse, pathobiont expansion (Escherichia coli), and symbiont depletion (Faecalibacterium prausnitzii) that correlates significantly with clinical inflammation as measured by fecal calprotectin. This repository provides a reproducible, notebook-level framework for advanced metagenomic data science.


1. Introduction

Inflammatory Bowel Disease (IBD) is a chronic, relapsing-remitting disorder driven by aberrant immune responses to the gut microbiota. While broad taxonomic shifts are well-documented, the precise ecological dynamics, including species-level intra-cohort interactions and temporal stability, remain critical areas of computational investigation. This operational framework employs advanced biostatistical methods to move beyond rudimentary abundance comparisons, focusing instead on the structural integrity and dynamical resilience of the microbial ecosystem.

2. Methodology

2.1 Data Ingestion and Rigorous Quality Control

The foundational analysis utilizes the highly curated HMP2 IBDMDB dataset, providing longitudinal multi-omics profiles of IBD patients and healthy controls over one year.

  • Taxonomic Aggregation: Sequencing profiles were subjected to rigorous pre-processing and aggregation strictly at the terminal species level to ensure high-resolution mechanistic inferences.
  • Compositional Normalization: Recognizing the constant-sum constraint of metagenomic data sets, we incorporated Centered Log-Ratio (CLR) transformations mapping raw read proportions from the Aitchison simplex into real Euclidean space. This pivotal step mathematically sanctions the use of robust multivariate statistics.

2.2 Ecological Diversity and Structure

Ecological collapse is mathematically quantified through multifaceted alpha and beta diversity matrices.

  • Alpha Diversity: By computing Shannon entropy, Simpson's index, and Pielou's evenness, we quantified within-sample architectural richness.

[image]

  • Beta Diversity: Utilizing Aitchison distance formulations applied to CLR-transformed arrays, principal component analyses delineate the global dysbiosis shifts distinguishing the healthy core from aberrant pathological clusters.

[image]

2.3 Differential Abundance Analysis

Beyond summary statistics, stringent non-parametric statistical frameworks were deployed to identify statistically significant driver taxa discriminating disease states. Utilizing Mann-Whitney U testing with Benjamini-Hochberg False Discovery Rate (FDR) control methodologies ($q < 0.05$), distinct ecological signatures were unmasked.

[image]

The analysis clearly partitions the microbial agents into:

  • Symbiotic Keystones: Crucial short-chain fatty acid (SCFA) producers such as Faecalibacterium prausnitzii and Roseburia intestinalis demonstrate structural depletion in active IBD cascades.
  • Pathobiont Drivers: Opportunistic endotoxic drivers including Escherichia coli register pronounced expansion.

[image]

2.4 Machine Learning Classification and Explainability

To confirm predictive utility, a supervised RandomForestClassifier (n=500 estimators) was trained across class-stratified configurations to predict state conditions leveraging strictly the microbial taxonomic composition. The structural interpretability of the model is decoupled via SHapley Additive exPlanations (SHAP) attributing definitive importance to specific species variations.

[image] [image]

The computational SHAP arrays explicitly validate the E. coli to F. prausnitzii inverse relationship as the paramount feature dynamic informing class separations.

[image] [image] [image]

2.5 Longitudinal Temporal Dynamics

A salient differentiator of this infrastructure is its accommodation of temporal volatility mathematically. Leveraging moving-window variances across longitudinal sampling trajectories within Euclidean composition spaces, we established concrete metrics indexing baseline microbiological structural instability corresponding seamlessly with clinical flare events.

[image] [image] [image] [image]

2.6 Integrated Ecological Network Interactions

Extrapolating beyond individual microbial variance, macro-level species-species network co-occurrence graphs were derived to construct predictive association architectures. Using force-directed graph rendering algorithms, these interaction topologies map the progressive decoupling of metabolic symbiotic relationships prevalent within healthy baselines into sparse, fragmented networks distinct to protracted Crohn's disease and Ulcerative Colitis.

[image]

3. High-Order Clinical Correlates

Multi-modal integration culminated in evaluating the deterministic linkages traversing the microbiome vectors against cardinal serological/fecal inflammatory metrics directly recorded in the HMP2 metadata, including Fecal Calprotectin.

[image] [image]

Correlations explicitly indicate mathematical causality pathways moving from primary microbiome compositional shifts, directly influencing secondary immune responses and culminating in measurable systemic inflammatory markers.


4. Repository Architecture

The physical filesystem is organized to ensure transparent reproducibility.

Human_Gut_Microbiome_Atlas/
├── data/                  # Ignored data sets containing curated and raw components
│   ├── curated/           # Synthesized multi-omics longitudinal matrices
│   └── raw/               # Root downloads and intermediate tabular metadata
│
├── figures/               # Contains interactive HTML exports and static PNG figures 
│
├── scripts/               # Utility tooling and Python scripts
│   ├── batch_download.py  # Data acquisition script
│   └── curate_microbiome.py # Data preprocessing script
│
├── results/               # Compiled statistical derivatives and outputs
│
├── .gitignore             # Git inclusion/exclusion logical definitions
├── Deep_Metagenomics_IBD_Analysis.ipynb  # Primary Analytical Pipeline (Main logic)
├── README.md              # Project theoretical introduction (This document)
└── requirements.txt       # Essential Python dependencies specification

5. Deployment and Execution

To natively orchestrate this computational infrastructure:

  1. 1.Dependency Configuration Instantiate a high-performance Python virtual environment (Python > 3.8.0).
bash
    pip install -r requirements.txt
  1. 1.Jupyter Instantiation Deploy the core modeling notebook to generate raw data models, structural representations, and statistical computations synchronously.
bash
    jupyter notebook Deep_Metagenomics_IBD_Analysis.ipynb

6. Project Citations and Methodological Dependencies

Methodological inspiration and core numerical parameters derived via the integration of primary texts:

  1. 1.Lloyd-Price, J., Arze, C., Ananthakrishnan, A.N. et al. Multi-omics of the gut microbial ecosystem in inflammatory bowel diseases. Nature 569, 655–662 (2019).
  2. 2.Aitchison, J. The Statistical Analysis of Compositional Data. Chapman and Hall (1986).
  3. 3.Lundberg, S.M., Lee, S.I. A unified approach to interpreting model predictions. NeurIPS (2017).