QasimHussain/Human_Gut_Microbiome_Atlas
Deep Metagenomics of the Human Gut Microbiome in IBD: A Multi-Omics Data Atlas A curated longitudinal dataset and computational framework for dissecting the temporal ecology of Inflammatory Bowel Disease (IBD). Abstract This project presents a comprehensive, high-resolution computational analysis of the human gut microbiome in Inflammatory Bowel Disease (IBD), leveraging deep metagenomic sequencing data from the HMP2 (Integrative Human Microbiome Project)… See the full description on the dataset page: https://huggingface.co/datasets/QasimHussain/Human_Gut_Microbiome_Atlas.
Deep Metagenomics of the Human Gut Microbiome in IBD: A Multi-Omics Data Atlas
 
A curated longitudinal dataset and computational framework for dissecting the temporal ecology of Inflammatory Bowel Disease (IBD).
Abstract
This project presents a comprehensive, high-resolution computational analysis of the human gut microbiome in Inflammatory Bowel Disease (IBD), leveraging deep metagenomic sequencing data from the HMP2 (Integrative Human Microbiome Project) cohort. Through a rigorous multi-modal pipeline integrating compositional data analysis (CoDA), machine learning, longitudinal trajectory modeling, and ecological network reconstruction, we dissect the complex dysbiosis characteristic of Crohn's Disease and Ulcerative Colitis. Our findings reveal a convergent axis of ecological collapse, pathobiont expansion (Escherichia coli), and symbiont depletion (Faecalibacterium prausnitzii) that correlates significantly with clinical inflammation as measured by fecal calprotectin. This repository provides a reproducible, notebook-level framework for advanced metagenomic data science.
1. Introduction
Inflammatory Bowel Disease (IBD) is a chronic, relapsing-remitting disorder driven by aberrant immune responses to the gut microbiota. While broad taxonomic shifts are well-documented, the precise ecological dynamics, including species-level intra-cohort interactions and temporal stability, remain critical areas of computational investigation. This operational framework employs advanced biostatistical methods to move beyond rudimentary abundance comparisons, focusing instead on the structural integrity and dynamical resilience of the microbial ecosystem.
2. Methodology
2.1 Data Ingestion and Rigorous Quality Control
The foundational analysis utilizes the highly curated HMP2 IBDMDB dataset, providing longitudinal multi-omics profiles of IBD patients and healthy controls over one year.
- Taxonomic Aggregation: Sequencing profiles were subjected to rigorous pre-processing and aggregation strictly at the terminal species level to ensure high-resolution mechanistic inferences.
- Compositional Normalization: Recognizing the constant-sum constraint of metagenomic data sets, we incorporated Centered Log-Ratio (CLR) transformations mapping raw read proportions from the Aitchison simplex into real Euclidean space. This pivotal step mathematically sanctions the use of robust multivariate statistics.
2.2 Ecological Diversity and Structure
Ecological collapse is mathematically quantified through multifaceted alpha and beta diversity matrices.
- Alpha Diversity: By computing Shannon entropy, Simpson's index, and Pielou's evenness, we quantified within-sample architectural richness.
- Beta Diversity: Utilizing Aitchison distance formulations applied to CLR-transformed arrays, principal component analyses delineate the global dysbiosis shifts distinguishing the healthy core from aberrant pathological clusters.
2.3 Differential Abundance Analysis
Beyond summary statistics, stringent non-parametric statistical frameworks were deployed to identify statistically significant driver taxa discriminating disease states. Utilizing Mann-Whitney U testing with Benjamini-Hochberg False Discovery Rate (FDR) control methodologies ($q < 0.05$), distinct ecological signatures were unmasked.
The analysis clearly partitions the microbial agents into:
- Symbiotic Keystones: Crucial short-chain fatty acid (SCFA) producers such as Faecalibacterium prausnitzii and Roseburia intestinalis demonstrate structural depletion in active IBD cascades.
- Pathobiont Drivers: Opportunistic endotoxic drivers including Escherichia coli register pronounced expansion.
2.4 Machine Learning Classification and Explainability
To confirm predictive utility, a supervised RandomForestClassifier (n=500 estimators) was trained across class-stratified configurations to predict state conditions leveraging strictly the microbial taxonomic composition. The structural interpretability of the model is decoupled via SHapley Additive exPlanations (SHAP) attributing definitive importance to specific species variations.
The computational SHAP arrays explicitly validate the E. coli to F. prausnitzii inverse relationship as the paramount feature dynamic informing class separations.
2.5 Longitudinal Temporal Dynamics
A salient differentiator of this infrastructure is its accommodation of temporal volatility mathematically. Leveraging moving-window variances across longitudinal sampling trajectories within Euclidean composition spaces, we established concrete metrics indexing baseline microbiological structural instability corresponding seamlessly with clinical flare events.
2.6 Integrated Ecological Network Interactions
Extrapolating beyond individual microbial variance, macro-level species-species network co-occurrence graphs were derived to construct predictive association architectures. Using force-directed graph rendering algorithms, these interaction topologies map the progressive decoupling of metabolic symbiotic relationships prevalent within healthy baselines into sparse, fragmented networks distinct to protracted Crohn's disease and Ulcerative Colitis.
3. High-Order Clinical Correlates
Multi-modal integration culminated in evaluating the deterministic linkages traversing the microbiome vectors against cardinal serological/fecal inflammatory metrics directly recorded in the HMP2 metadata, including Fecal Calprotectin.
Correlations explicitly indicate mathematical causality pathways moving from primary microbiome compositional shifts, directly influencing secondary immune responses and culminating in measurable systemic inflammatory markers.
4. Repository Architecture
The physical filesystem is organized to ensure transparent reproducibility.
Human_Gut_Microbiome_Atlas/
├── data/ # Ignored data sets containing curated and raw components
│ ├── curated/ # Synthesized multi-omics longitudinal matrices
│ └── raw/ # Root downloads and intermediate tabular metadata
│
├── figures/ # Contains interactive HTML exports and static PNG figures
│
├── scripts/ # Utility tooling and Python scripts
│ ├── batch_download.py # Data acquisition script
│ └── curate_microbiome.py # Data preprocessing script
│
├── results/ # Compiled statistical derivatives and outputs
│
├── .gitignore # Git inclusion/exclusion logical definitions
├── Deep_Metagenomics_IBD_Analysis.ipynb # Primary Analytical Pipeline (Main logic)
├── README.md # Project theoretical introduction (This document)
└── requirements.txt # Essential Python dependencies specification5. Deployment and Execution
To natively orchestrate this computational infrastructure:
- Dependency Configuration Instantiate a high-performance Python virtual environment (Python > 3.8.0).
pip install -r requirements.txt- Jupyter Instantiation Deploy the core modeling notebook to generate raw data models, structural representations, and statistical computations synchronously.
jupyter notebook Deep_Metagenomics_IBD_Analysis.ipynb6. Project Citations and Methodological Dependencies
Methodological inspiration and core numerical parameters derived via the integration of primary texts:
- Lloyd-Price, J., Arze, C., Ananthakrishnan, A.N. et al. Multi-omics of the gut microbial ecosystem in inflammatory bowel diseases. Nature 569, 655–662 (2019).
- Aitchison, J. The Statistical Analysis of Compositional Data. Chapman and Hall (1986).
- Lundberg, S.M., Lee, S.I. A unified approach to interpreting model predictions. NeurIPS (2017).
