CoolFace
Datasetpublic

Pranesh535/NIH-Chest-X-ray-dataset

The NIH Chest X-ray dataset consists of 100,000 de-identified images of chest x-rays. The images are in PNG format. The data is provided by the NIH Clinical Center and is available through the NIH download site: https://nihcc.app.box.com/v/ChestXray-NIHCC

sourceHugging Faceunknownupdated 10mo agoView on Hugging Face
0likes60downloads
Dataset Card

Dataset Card for NIH Chest X-ray dataset

Table of Contents

Dataset Description

Dataset Summary

ChestX-ray dataset comprises 112,120 frontal-view X-ray images of 30,805 unique patients with the text-mined fourteen disease image labels (where each image can have multi-labels), mined from the associated radiological reports using natural language processing. Fourteen common thoracic pathologies include Atelectasis, Consolidation, Infiltration, Pneumothorax, Edema, Emphysema, Fibrosis, Effusion, Pneumonia, Pleuralthickening, Cardiomegaly, Nodule, Mass and Hernia, which is an extension of the 8 common disease patterns listed in our CVPR2017 paper. Note that original radiology reports (associated with these chest x-ray studies) are not meant to be publicly shared for many reasons. The text-mined disease labels are expected to have accuracy >90%.Please find more details and benchmark performance of trained models based on 14 disease labels in our arxiv paper: 1705.02315_

Dataset Structure

Data Instances

A sample from the training set is provided below:

{'image_file_path': '/root/.cache/huggingface/datasets/downloads/extracted/95db46f21d556880cf0ecb11d45d5ba0b58fcb113c9a0fff2234eba8f74fe22a/images/00000798_022.png',
 'image': <PIL.PngImagePlugin.PngImageFile image mode=L size=1024x1024 at 0x7F2151B144D0>,
 'labels': [9, 3]}

Data Fields

The data instances have the following fields:

  • image_file_path a str with the image path
  • image: A PIL.Image.Image object containing the image. Note that when accessing the image column: dataset[0]["image"] the image file is automatically decoded. Decoding of a large number of image files might take a significant amount of time. Thus it is important to first query the sample index before the "image" column, i.e. dataset[0]["image"] should always be preferred over dataset["image"][0].
  • labels: an int classification label. <details> <summary>Class Label Mappings</summary>
json
  {
    "No Finding": 0,
    "Atelectasis": 1,
    "Cardiomegaly": 2,
    "Effusion": 3,
    "Infiltration": 4,
    "Mass": 5,
    "Nodule": 6,
    "Pneumonia": 7,
    "Pneumothorax": 8,
    "Consolidation": 9,
    "Edema": 10,
    "Emphysema": 11,
    "Fibrosis": 12,
    "Pleural_Thickening": 13,
    "Hernia": 14
 }

</details>

Label distribution on the dataset:

labelsobsfreq
No Finding603610.426468
Infiltration198940.140557
Effusion133170.0940885
Atelectasis115590.0816677
Nodule63310.0447304
Mass57820.0408515
Pneumothorax53020.0374602
Consolidation46670.0329737
Pleural_Thickening33850.023916
Cardiomegaly27760.0196132
Emphysema25160.0177763
Edema23030.0162714
Fibrosis16860.0119121
Pneumonia14310.0101104
Hernia2270.00160382

Data Splits

traintest
# of examples8652425596

Label distribution by dataset split:

labels('Train', 'obs')('Train', 'freq')('Test', 'obs')('Test', 'freq')
No Finding505000.48339298610.266032
Infiltration137820.13192361120.164891
Effusion86590.08288546580.125664
Atelectasis82800.079257232790.0884614
Nodule47080.045065616230.0437856
Mass40340.03861417480.0471578
Consolidation28520.027299718150.0489654
Pneumothorax26370.025241726650.0718968
Pleural_Thickening22420.021460711430.0308361
Cardiomegaly17070.016339610690.0288397
Emphysema14230.013621110930.0294871
Edema13780.01319049250.0249548
Fibrosis12510.01197474350.0117355
Pneumonia8760.008385185550.0149729
Hernia1410.00134967860.00232012

Dataset Creation

Curation Rationale

[More Information Needed]

Source Data

Initial Data Collection and Normalization

[More Information Needed]

Who are the source language producers?

[More Information Needed]

Annotations

Annotation process

[More Information Needed]

Who are the annotators?

[More Information Needed]

Personal and Sensitive Information

[More Information Needed]

Considerations for Using the Data

Social Impact of Dataset

[More Information Needed]

Discussion of Biases

[More Information Needed]

Other Known Limitations

[More Information Needed]

Additional Information

Dataset Curators

[More Information Needed]

License and attribution

There are no restrictions on the use of the NIH chest x-ray images. However, the dataset has the following attribution requirements:

  • Provide a link to the NIH download site: https://nihcc.app.box.com/v/ChestXray-NIHCC
  • Include a citation to the CVPR 2017 paper (see Citation information section)
  • Acknowledge that the NIH Clinical Center is the data provider

Citation Information

@inproceedings{Wang_2017,
	doi = {10.1109/cvpr.2017.369},
	url = {https://doi.org/10.1109%2Fcvpr.2017.369},
	year = 2017,
	month = {jul},
	publisher = {{IEEE}
},
	author = {Xiaosong Wang and Yifan Peng and Le Lu and Zhiyong Lu and Mohammadhadi Bagheri and Ronald M. Summers},
	title = {{ChestX}-Ray8: Hospital-Scale Chest X-Ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseases},
	booktitle = {2017 {IEEE} Conference on Computer Vision and Pattern Recognition ({CVPR})}
}

Contributions

Thanks to @alcazar90 for adding this dataset.