CoolFace
Modelpublic

p208p2002/gpt2-squad-nqg-hl

sourceHugging Faceupdated 3y agoView on Hugging Face
0likes24downloads
Model Card

Transformer QG on SQuAD

HLQG is Proposed by Ying-Hong Chan & Yao-Chung Fan. (2019). A Re-current BERT-based Model for Question Generation.

This is a Reproduce Version

More detail: p208p2002/Transformer-QG-on-SQuAD

Usage

Input Format

C' = [c1, c2, ..., [HL], a1, ..., a|A|, [HL], ..., c|C|]

Input Example

Harry Potter is a series of seven fantasy novels written by British author, [HL]J. K. Rowling[HL].
# Who wrote Harry Potter?

Data setting

We report two dataset setting as Follow

SQuAD

  • —train: 87599\\\\t
  • —validation: 10570
SQuAD: 100,000+ Questions for Machine Comprehension of Text

SQuAD NQG

  • —train: 75722
  • —dev: 10570
  • —test: 11877
Learning to Ask: Neural Question Generation for Reading Comprehension

Available models

  • —BART
  • —GPT2
  • —T5

Expriments

We report score with NQG Scorer which is using in SQuAD NQG.

If not special explanation, the size of the model defaults to "base".

SQuAD

ModelBleu 1Bleu 2Bleu 3Bleu 4METEORROUGE-L
BART-HLSQG54.6739.2630.3424.1525.4352.64
GPT2-HLSQG49.3133.9525.4119.6922.2948.82
T5-HLSQG54.2939.2230.4324.2625.5653.11

SQuAD NQG

ModelBleu 1Bleu 2Bleu 3Bleu 4METEORROUGE-L
BERT-HLSQG (Chan et al.)49.7334.6026.1320.3323.8848.23
BART-HLSQG54.1238.1928.8422.3524.5551.03
GPT2-HLSQG49.8233.6924.7118.6321.9047.60
T5-HLSQG53.1337.6028.6222.3824.4851.20