manoj8890/big_patent
Dataset Card for Big Patent Dataset Summary BIGPATENT, consisting of 1.3 million records of U.S. patent documents along with human written abstractive summaries. Each US patent application is filed under a Cooperative Patent Classification (CPC) code. There are nine such classification categories: a: Human Necessities b: Performing Operations; Transporting c: Chemistry; Metallurgy d: Textiles; Paper e: Fixed Constructions f: Mechanical Engineering; Lightning;… See the full description on the dataset page: https://huggingface.co/datasets/manoj8890/big_patent.
Dataset Card for Big Patent
Table of Contents
- Dataset Description
- Dataset Summary
- Supported Tasks and Leaderboards
- Languages
- Dataset Structure
- Data Instances
- Data Fields
- Data Splits
- Dataset Creation
- Curation Rationale
- Source Data
- Annotations
- Personal and Sensitive Information
- Considerations for Using the Data
- Social Impact of Dataset
- Discussion of Biases
- Other Known Limitations
- Additional Information
- Dataset Curators
- Licensing Information
- Citation Information
- Contributions
Dataset Description
- Homepage: Big Patent
- Repository:
- Paper: BIGPATENT: A Large-Scale Dataset for Abstractive and Coherent Summarization
- Leaderboard:
- Point of Contact: Lu Wang
Dataset Summary
BIGPATENT, consisting of 1.3 million records of U.S. patent documents along with human written abstractive summaries. Each US patent application is filed under a Cooperative Patent Classification (CPC) code. There are nine such classification categories:
- a: Human Necessities
- b: Performing Operations; Transporting
- c: Chemistry; Metallurgy
- d: Textiles; Paper
- e: Fixed Constructions
- f: Mechanical Engineering; Lightning; Heating; Weapons; Blasting
- g: Physics
- h: Electricity
- y: General tagging of new or cross-sectional technology
Current defaults are 2.1.2 version (fix update to cased raw strings) and 'all' CPC codes:
from datasets import load_dataset
ds = load_dataset("big_patent") # default is 'all' CPC codes
ds = load_dataset("big_patent", "all") # the same as above
ds = load_dataset("big_patent", "a") # only 'a' CPC codes
from datasets import concatenate_datasets
# Concatenate multiple codes
ds = concatenate_datasets([
load_dataset("big_patent", "a", split="train"),
load_dataset("big_patent", "b", split="train"),
])To use 1.0.0 version (lower cased tokenized words), use an older revision of this dataset and pass both parameters codes and version:
revision = "e807b1d5492aa5f4fac08f3f6c7c85c72887ca12"
ds = load_dataset("big_patent", codes="all", version="1.0.0", revision=revision)
ds = load_dataset("big_patent", codes="a", version="1.0.0", revision=revision)Supported Tasks and Leaderboards
[More Information Needed]
Languages
English
Dataset Structure
Data Instances
Each instance contains a pair of description and abstract. description is extracted from the Description section of the Patent while abstract is extracted from the Abstract section.
{
'description': 'FIELD OF THE INVENTION \n [0001] This invention relates to novel calcium phosphate-coated implantable medical devices and processes of making same. The unique calcium-phosphate coated implantable medical devices minimize...',
'abstract': 'This invention relates to novel calcium phosphate-coated implantable medical devices...'
}Data Fields
description: detailed description of patent.abstract: Patent abastract.
Data Splits
Dataset Creation
Curation Rationale
[More Information Needed]
Source Data
Initial Data Collection and Normalization
[More Information Needed]
Who are the source language producers?
[More Information Needed]
Annotations
Annotation process
[More Information Needed]
Who are the annotators?
[More Information Needed]
Personal and Sensitive Information
[More Information Needed]
Considerations for Using the Data
Social Impact of Dataset
[More Information Needed]
Discussion of Biases
[More Information Needed]
Other Known Limitations
[More Information Needed]
Additional Information
Dataset Curators
[More Information Needed]
Licensing Information
[More Information Needed]
Citation Information
@article{DBLP:journals/corr/abs-1906-03741,
author = {Eva Sharma and
Chen Li and
Lu Wang},
title = {{BIGPATENT:} {A} Large-Scale Dataset for Abstractive and Coherent
Summarization},
journal = {CoRR},
volume = {abs/1906.03741},
year = {2019},
url = {http://arxiv.org/abs/1906.03741},
eprinttype = {arXiv},
eprint = {1906.03741},
timestamp = {Wed, 26 Jun 2019 07:14:58 +0200},
biburl = {https://dblp.org/rec/journals/corr/abs-1906-03741.bib},
bibsource = {dblp computer science bibliography, https://dblp.org}
}Contributions
Thanks to @mattbui for adding this dataset.
