PlanTL-GOB-ES/cantemist-ner

CANTEMIST

Dataset Description

Manually classified collection of Spanish oncological clinical case reports.

• —Homepage: zenodo
• —Paper: Named Entity Recognition, Concept Normalization and Clinical Coding: Overview of the Cantemist Track for Cancer Text Mining in Spanish, Corpus, Guidelines, Methods and Results
• —Point of Contact: encargo-pln-life@bsc.es

Dataset Summary

Collection of 1301 oncological clinical case reports written in Spanish, with tumor morphology mentions manually annotated and mapped by clinical experts to a controlled terminology. Every tumor morphology mention is linked to an eCIE-O code (the Spanish equivalent of ICD-O).

The training subset contains 501 documents, the development subsets 500, and the test subset 300. The original dataset is distributed in Brat format.

This dataset was designed for the CANcer TExt Mining Shared Task, sponsored by Plan-TL.

For further information, please visit the official website.

Supported Tasks

Named Entity Recognition (NER)

Languages

• —Spanish (es)

Directory Structure

• —README.md
• —cantemist.py
• —train.conll
• —dev.conll
• —test.conll

Dataset Structure

Data Instances

Three four-column files, one for each split.

Data Fields

Every file has 4 columns:

• —1st column: Word form or punctuation symbol
• —2nd column: Original BRAT file name
• —3rd column: Spans
• —4th column: IOB tag

Example

<pre> El cconco101 662664 O informe cconco101 665672 O HP cconco101 673675 O es cconco101 676678 O compatible cconco101 679689 O con cconco101 690693 O adenocarcinoma cconco101 694708 B-MORFOLOGIANEOPLASIA moderadamente cconco101 709722 I-MORFOLOGIANEOPLASIA diferenciado cconco101 723735 I-MORFOLOGIANEOPLASIA que cconco101 736739 O afecta cconco101 740746 O a cconco101 747748 O grasa cconco101 749754 O peripancreática cconco101 755770 O sobrepasando cconco101 771783 O la cconco101 784786 O serosa cconco101 787793 O , cconco101 793794 O infiltración cconco101 795807 O perineural cconco101 808818 O . cconco101 818_819 O </pre>

Data Splits

Dataset Creation

Curation Rationale

For compatibility with similar datasets in other languages, we followed as close as possible existing curation guidelines.

Source Data

Initial Data Collection and Normalization

The selected clinical case reports are fairly similar to hospital health records. To increase the usefulness and practical relevance of the CANTEMIST corpus, we selected clinical cases affecting all genders and that comprised most ages (from children to the elderly) and of various complexity levels (solid tumors, hemato-oncological malignancies, neuroendocrine cancer...).

The CANTEMIST cases include clinical signs and symptoms, personal and family history, current illness, physical examination, complementary tests (blood tests, imaging, pathology), diagnosis, treatment (including adverse effects of chemotherapy), evolution and outcome.

Who are the source language producers?

Humans, there is no machine generated data.

Annotations

Annotation process

The manual annotation of the Cantemist corpus was performed by clinical experts following the Cantemist guidelines (for more detail refer to this paper). These guidelines contain rules for annotating morphology neoplasms in Spanish oncology clinical cases, as well as for mapping these annotations to eCIE-O.

A medical doctor was regularly consulted by annotators (scientists with PhDs on cancer-related subjects) for the most difficult pathology expressions. This same doctor periodically checked a random selection of annotated clinical records and these annotations were compared and discussed with the annotators. To normalize a selection of very complex cases, MD specialists in pathology from one of the largest university hospitals in Spain were consulted.

Who are the annotators?

Clinical experts.

Personal and Sensitive Information

No personal or sensitive information included.

Considerations for Using the Data

Social Impact of Dataset

This corpus contributes to the development of medical language models in Spanish.

Discussion of Biases

Not applicable.

Additional Information

Dataset Curators

Text Mining Unit (TeMU) at the Barcelona Supercomputing Center (bsc-temu@bsc.es).

For further information, send an email to (plantl-gob-es@bsc.es).

This work was funded by the Spanish State Secretariat for Digitalization and Artificial Intelligence (SEDIA) within the framework of the Plan-TL.

Licensing information

This work is licensed under CC Attribution 4.0 International License.

Copyright by the Spanish State Secretariat for Digitalization and Artificial Intelligence (SEDIA) (2022)

Citation Information

@article{cantemist,
  title={Named Entity Recognition, Concept Normalization and Clinical Coding: Overview of the Cantemist Track for Cancer Text Mining in Spanish, Corpus, Guidelines, Methods and Results.},
  author={Miranda-Escalada, Antonio and Farr{\'e}, Eul{\`a}lia and Krallinger, Martin},
  journal={IberLEF@ SEPLN},
  pages={303--323},
  year={2020}
}

Contributions

[N/A]