Modelpublic
Thang203/general_nlp_research_paper
0likes5downloads
Model Card
tags:
- —bertopic libraryname: bertopic pipelinetag: text-classification ---
generalnlpresearch_paper
This is a BERTopic model. BERTopic is a flexible and modular topic modeling framework that allows for the generation of easily interpretable topics from large datasets.
Usage
To use this model, please install BERTopic:
pip install -U bertopicYou can use the model as follows:
python
from bertopic import BERTopic
topic_model = BERTopic.load("Thang203/general_nlp_research_paper")
topic_model.get_topic_info()Topic overview
- —Number of topics: 165
- —Number of training documents: 11000
<details> <summary>Click here for an overview of all topics.</summary>
| Topic ID | Topic Keywords | Topic Frequency | Label |
|---|---|---|---|
| -1 | language - models - model - data - translation | 10 | -1languagemodelsmodeldata |
| 0 | question - answer - questions - answering - question answering | 3488 | 0questionanswerquestionsanswering |
| 1 | speech - speech recognition - acoustic - recognition - asr | 513 | 1speechspeech recognitionacousticrecognition |
| 2 | summarization - summaries - abstractive - summary - extractive | 345 | 2summarizationsummariesabstractivesummary |
| 3 | clinical - medical - biomedical - extraction - notes | 337 | 3clinicalmedicalbiomedicalextraction |
| 4 | translation - machine translation - parallel - machine - nmt | 258 | 4translationmachine translationparallelmachine |
| 5 | emotion - emotions - emotional - emotion recognition - affective | 211 | 5emotionemotionsemotionalemotion recognition |
| 6 | word - embeddings - word embeddings - similarity - vector | 164 | 6wordembeddingsword embeddingssimilarity |
| 7 | bert - probing - tasks - pretraining - pretrained | 145 | 7bertprobingtaskspretraining |
| 8 | relation - relation extraction - extraction - relations - distant | 138 | 8relationrelation extractionextractionrelations |
| 9 | hate - hate speech - offensive - detection - speech | 134 | 9hatehate speechoffensivedetection |
| 10 | arabic - sanskrit - kurdish - transliteration - rules | 118 | 10arabicsanskritkurdishtransliteration |
| 11 | aspect - sentiment - sentiment analysis - aspectbased sentiment - aspectbased | 118 | 11aspectsentimentsentiment analysisaspectbased sentiment |
| 12 | morphological - inflection - languages - morphology - morphological analysis | 112 | 12morphologicalinflectionlanguagesmorphology |
| 13 | ner - named entity - named - entity recognition - named entity recognition | 107 | 13nernamed entitynamedentity recognition |
| 14 | multimodal - image - visual - captions - images | 101 | 14multimodalimagevisualcaptions |
| 15 | discourse - discourse relation - discourse parsing - implicit discourse - discourse relations | 98 | 15discoursediscourse relationdiscourse parsingimplicit discourse |
| 16 | chinese - segmentation - word segmentation - chinese word - chinese word segmentation | 89 | 16chinesesegmentationword segmentationchinese word |
| 17 | crosslingual - bilingual - embeddings - crosslingual word - word embeddings | 84 | 17crosslingualbilingualembeddingscrosslingual word |
| 18 | entropy - law - languages - script - frequency | 79 | 18entropylawlanguagesscript |
| 19 | argument - argumentation - arguments - argumentative - mining | 77 | 19argumentargumentationargumentsargumentative |
| 20 | nmt - neural machine - neural machine translation - translation - machine translation | 77 | 20nmtneural machineneural machine translationtranslation |
| 21 | parsing - dependency - dependency parsing - parser - transitionbased | 76 | 21parsingdependencydependency parsingparser |
| 22 | syntactic - rnns - grammatical - language models - agreement | 71 | 22syntacticrnnsgrammaticallanguage models |
| 23 | generation - datatotext - text generation - datatotext generation - text | 71 | 23generationdatatotexttext generationdatatotext generation |
| 24 | topic - topics - topic models - topic modeling - lda | 71 | 24topictopicstopic modelstopic modeling |
| 25 | knowledge - knowledge graph - entities - relation - graph | 68 | 25knowledgeknowledge graphentitiesrelation |
| 26 | gender - bias - gender bias - biases - embeddings | 66 | 26genderbiasgender biasbiases |
| 27 | story - stories - story generation - narrative - plot | 65 | 27storystoriesstory generationnarrative |
| 28 | dialogue - dialog - user - taskoriented - agent | 65 | 28dialoguedialogusertaskoriented |
| 29 | transformer - attention - selfattention - heads - layers | 65 | 29transformerattentionselfattentionheads |
| 30 | srl - semantic role - role labeling - semantic role labeling - role | 64 | 30srlsemantic rolerole labelingsemantic role labeling |
| 31 | change - semantic change - diachronic - lexical semantic - semantic | 64 | 31changesemantic changediachroniclexical semantic |
| 32 | sense - wsd - disambiguation - word sense - sense disambiguation | 64 | 32sensewsddisambiguationword sense |
| 33 | paraphrase - paraphrases - paraphrase generation - paraphrasing - paraphrase identification | 63 | 33paraphraseparaphrasesparaphrase generationparaphrasing |
| 34 | linking - entity linking - entity - el - entities | 62 | 34linkingentity linkingentityel |
| 35 | authorship - attribution - authorship attribution - authors - stylistic | 60 | 35authorshipattributionauthorship attributionauthors |
| 36 | tracking - state tracking - dialogue state - state - dialogue | 54 | 36trackingstate trackingdialogue statestate |
| 37 | nli - natural language inference - language inference - inference - natural language | 54 | 37nlinatural language inferencelanguage inferenceinference |
| 38 | act - dialogue act - dialogue - dialog act - dialog | 51 | 38actdialogue actdialoguedialog act |
| 39 | commonsense - reasoning - commonsense reasoning - knowledge - commonsense knowledge | 49 | 39commonsensereasoningcommonsense reasoningknowledge |
| 40 | crosslingual - multilingual - transfer - crosslingual transfer - mbert | 49 | 40crosslingualmultilingualtransfercrosslingual transfer |
| 41 | coreference - resolution - coreference resolution - mention - pronoun | 49 | 41coreferenceresolutioncoreference resolutionmention |
| 42 | legal - patent - court - case - legal domain | 48 | 42legalpatentcourtcase |
| 43 | dialect - identification - language identification - dialect identification - arabic | 47 | 43dialectidentificationlanguage identificationdialect identification |
| 44 | amr - amr parsing - parsing - meaning representation - meaning | 46 | 44amramr parsingparsingmeaning representation |
| 45 | adversarial - adversarial examples - attacks - attack - examples | 46 | 45adversarialadversarial examplesattacksattack |
| 46 | health - mental - mental health - social media - media | 45 | 46healthmentalmental healthsocial media |
| 47 | offensive - offensive language - subtask - offensive language identification - hostile | 45 | 47offensiveoffensive languagesubtaskoffensive language identification |
| 48 | semantic parsing - parsing - semantic - compositional generalization - logical | 44 | 48semantic parsingparsingsemanticcompositional generalization |
| 49 | recurrent - language modeling - rnn - lstm - modeling | 44 | 49recurrentlanguage modelingrnnlstm |
| 50 | sql - texttosql - database - queries - query | 44 | 50sqltexttosqldatabasequeries |
| 51 | indian - smt - translation - machine translation - machine | 43 | 51indiansmttranslationmachine translation |
| 52 | style - style transfer - transfer - text style - text style transfer | 43 | 52stylestyle transfertransfertext style |
| 53 | poetry - poems - lyrics - music - verse | 43 | 53poetrypoemslyricsmusic |
| 54 | codeswitching - cs - codeswitched - codemixed - monolingual | 43 | 54codeswitchingcscodeswitchedcodemixed |
| 55 | sentiment - polarity - sentiment analysis - analysis - prior polarity | 41 | 55sentimentpolaritysentiment analysisanalysis |
| 56 | sarcasm - sarcasm detection - sarcastic - detection - irony | 41 | 56sarcasmsarcasm detectionsarcasticdetection |
| 57 | gec - grammatical error - grammatical error correction - error correction - correction | 40 | 57gecgrammatical errorgrammatical error correctionerror correction |
| 58 | intent - intent detection - slot - slot filling - filling | 40 | 58intentintent detectionslotslot filling |
| 59 | temporal - events - temporal relations - expressions - temporal relation | 39 | 59temporaleventstemporal relationsexpressions |
| 60 | adaptation - domain - domain adaptation - indomain - translation | 37 | 60adaptationdomaindomain adaptationindomain |
| 61 | stance - stance detection - detection - tweets - veracity | 37 | 61stancestance detectiondetectiontweets |
| 62 | codemixed - sentiment - sentiment analysis - analysis - semeval2020 | 36 | 62codemixedsentimentsentiment analysisanalysis |
| 63 | keyphrase - keyphrases - keyphrase extraction - keyphrase generation - extraction | 35 | 63keyphrasekeyphraseskeyphrase extractionkeyphrase generation |
| 64 | nmt - subword - translation - vocabulary - neural machine translation | 35 | 64nmtsubwordtranslationvocabulary |
| 65 | calculus - logic - semantics - proof - typelogical | 35 | 65calculuslogicsemanticsproof |
| 66 | simplification - text simplification - sentence simplification - sentence - ts | 35 | 66simplificationtext simplificationsentence simplificationsentence |
| 67 | annotation - xml - formats - tei - standards | 35 | 67annotationxmlformatstei |
| 68 | correction - spelling - ocr - spelling correction - errors | 33 | 68correctionspellingocrspelling correction |
| 69 | sentiment - sentiment classification - sentiment analysis - classification - analysis | 33 | 69sentimentsentiment classificationsentiment analysisclassification |
| 70 | complexity - readability - lexical complexity - assessment - readability assessment | 31 | 70complexityreadabilitylexical complexityassessment |
| 71 | postediting - ape - automatic postediting - mt - translation | 30 | 71posteditingapeautomatic posteditingmt |
| 72 | gender - gender bias - bias - translation - pronouns | 30 | 72gendergender biasbiastranslation |
| 73 | tagger - tagging - taggers - pos - partofspeech | 30 | 73taggertaggingtaggerspos |
| 74 | meeting - summarization - podcast - abstractive - summaries | 30 | 74meetingsummarizationpodcastabstractive |
| 75 | domain - domain adaptation - adaptation - domains - target domain | 30 | 75domaindomain adaptationadaptationdomains |
| 76 | documentlevel - context - translation - nmt - neural machine | 29 | 76documentlevelcontexttranslationnmt |
| 77 | text classification - classification - convolutional - networks - convolutional neural | 29 | 77text classificationclassificationconvolutionalnetworks |
| 78 | news - fake - fake news - clickbait - satirical | 29 | 78newsfakefake newsclickbait |
| 79 | grammars - grammar - stochastic - contextfree - contextfree grammars | 29 | 79grammarsgrammarstochasticcontextfree |
| 80 | ontology - rogets - thesaurus - wordnet - concepts | 29 | 80ontologyrogetsthesauruswordnet |
| 81 | vietnamese - ner - named entity recognition - entity recognition - named entity | 28 | 81vietnamesenernamed entity recognitionentity recognition |
| 82 | claim - verification - evidence - claims - fever | 27 | 82claimverificationevidenceclaims |
| 83 | metrics - nlg - language generation - evaluation - natural language generation | 27 | 83metricsnlglanguage generationevaluation |
| 84 | responses - response - response generation - adversarial - generation | 27 | 84responsesresponseresponse generationadversarial |
| 85 | robustness - nmt - translation - neural machine - neural machine translation | 27 | 85robustnessnmttranslationneural machine |
| 86 | revision - editing - seq2seq - revisions - rewriting | 27 | 86revisioneditingseq2seqrevisions |
| 87 | phonological - phonology - finitestate - reduplication - prosody | 26 | 87phonologicalphonologyfinitestatereduplication |
| 88 | geolocation - location - geographic - twitter - names | 26 | 88geolocationlocationgeographictwitter |
| 89 | event - event extraction - extraction - event types - argument | 26 | 89eventevent extractionextractionevent types |
| 90 | mt - human - translation - evaluation - parity | 25 | 90mthumantranslationevaluation |
| 91 | arabic - sentiment - sentiment analysis - arabic sentiment - arabic sentiment analysis | 25 | 91arabicsentimentsentiment analysisarabic sentiment |
| 92 | emoji - emojis - emoji prediction - emoticons - sentiment | 25 | 92emojiemojisemoji predictionemoticons |
| 93 | constituency - latent tree - parsing - constituency parsing - tree learning | 25 | 93constituencylatent treeparsingconstituency parsing |
| 94 | spatial - instructions - 3d - environment - robot | 24 | 94spatialinstructions3denvironment |
| 95 | persona - responses - personality - traits - consistency | 23 | 95personaresponsespersonalitytraits |
| 96 | matching - response - retrievalbased - chatbots - multiturn | 23 | 96matchingresponseretrievalbasedchatbots |
| 97 | entity - entity typing - typing - finegrained entity - type | 22 | 97entityentity typingtypingfinegrained entity |
| 98 | math - word problems - math word - word problem - problems | 21 | 98mathword problemsmath wordword problem |
| 99 | bert - multilingual - multilingual bert - bert model - multilingual models | 21 | 99bertmultilingualmultilingual bertbert model |
| 100 | financial - stock - market - news - price | 21 | 100financialstockmarketnews |
| 101 | video - multimodal - sceneaware - dialog - visual | 21 | 101videomultimodalsceneawaredialog |
| 102 | sense - multisense - senses - word sense - word | 21 | 102sensemultisensesensesword sense |
| 103 | game - games - agents - communication - pragmatic | 21 | 103gamegamesagentscommunication |
| 104 | graph - amrtotext - amrtotext generation - amr - graphs | 20 | 104graphamrtotextamrtotext generationamr |
| 105 | nmt - translation - neural machine translation - neural machine - machine translation | 20 | 105nmttranslationneural machine translationneural machine |
| 106 | normalization - text normalization - normalizing - text - historical | 20 | 106normalizationtext normalizationnormalizingtext |
| 107 | privacy - policies - anonymization - deidentification - vague | 20 | 107privacypoliciesanonymizationdeidentification |
| 108 | beam - beam search - search - decoding - constraints | 20 | 108beambeam searchsearchdecoding |
| 109 | hypernymy - distributional - pathbased - hypernymy detection - hypernyms | 19 | 109hypernymydistributionalpathbasedhypernymy detection |
| 110 | political - bias - articles - news - ideology | 19 | 110politicalbiasarticlesnews |
| 111 | generative adversarial - gans - gan - generative - generative adversarial networks | 18 | 111generative adversarialgansgangenerative |
| 112 | pos - tagger - tagging - pos tagging - codemixed | 17 | 112postaggertaggingpos tagging |
| 113 | humor - humorous - headlines - funny - puns | 17 | 113humorhumorousheadlinesfunny |
| 114 | metaphor - metaphors - metaphoric - metaphorical - literal | 17 | 114metaphormetaphorsmetaphoricmetaphorical |
| 115 | codeswitching - cs - asr - speech - speech recognition | 17 | 115codeswitchingcsasrspeech |
| 116 | event coreference - event - coreference - coreference resolution - resolution | 17 | 116event coreferenceeventcoreferencecoreference resolution |
| 117 | reviews - review - helpfulness - opinion - online reviews | 17 | 117reviewsreviewhelpfulnessopinion |
| 118 | covid19 - tweets - wnut2020 - twitter - informative | 17 | 118covid19tweetswnut2020twitter |
| 119 | anaphora - resolution - pronouns - pronoun - anaphora resolution | 17 | 119anaphoraresolutionpronounspronoun |
| 120 | bilingual - dictionary - comparability - termhood - comparable corpora | 17 | 120bilingualdictionarycomparabilitytermhood |
| 121 | discourse - translation - pronouns - dp - discourse phenomena | 17 | 121discoursetranslationpronounsdp |
| 122 | color - colour - naming - colors - character embeddings | 16 | 122colorcolournamingcolors |
| 123 | nonautoregressive - autoregressive - nat - nonautoregressive neural - decoding | 16 | 123nonautoregressiveautoregressivenatnonautoregressive neural |
| 124 | nlg - natural language generation - language generation - spoken dialogue - generation | 16 | 124nlgnatural language generationlanguage generationspoken dialogue |
| 125 | crowdsourcing - workers - examples - protocols - data collection | 16 | 125crowdsourcingworkersexamplesprotocols |
| 126 | african - revolution - african languages - technology - african language | 16 | 126africanrevolutionafrican languagestechnology |
| 127 | grading - scoring - essay - short answer - essay scoring | 16 | 127gradingscoringessayshort answer |
| 128 | treebanks - treebank - parsing - crosslingual - dependency | 16 | 128treebankstreebankparsingcrosslingual |
| 129 | reviews - summarization - review - product - summaries | 16 | 129reviewssummarizationreviewproduct |
| 130 | gaze - reading - eyetracking - eye - behaviour | 16 | 130gazereadingeyetrackingeye |
| 131 | nlp - natural - natural language - nlg - language | 15 | 131nlpnaturalnatural languagenlg |
| 132 | news translation - news translation task - translation task - news - submission | 14 | 132news translationnews translation tasktranslation tasknews |
| 133 | eat - meaning - semantics - formal - theory | 14 | 133eatmeaningsemanticsformal |
| 134 | sign - sign language - sl - asl - deaf | 14 | 134signsign languageslasl |
| 135 | multitask - labels - mtl - sequence - multitask learning | 14 | 135multitasklabelsmtlsequence |
| 136 | phylogenetic - cognate - indoeuropean - historical linguistics - indoeuropean language | 14 | 136phylogeneticcognateindoeuropeanhistorical linguistics |
| 137 | syntax - translation - neural machine translation - neural machine - nmt | 14 | 137syntaxtranslationneural machine translationneural machine |
| 138 | explanations - explanation - explainers - nl explanations - faithful | 14 | 138explanationsexplanationexplainersnl explanations |
| 139 | slot - slot filling - filling - slots - nlu | 13 | 139slotslot fillingfillingslots |
| 140 | personality - traits - profiling - author profiling - author | 13 | 140personalitytraitsprofilingauthor profiling |
| 141 | preposition - prepositions - supersenses - prepositional - supersense | 13 | 141prepositionprepositionssupersensesprepositional |
| 142 | scientific - application areas - application - areas - literature | 13 | 142scientificapplication areasapplicationareas |
| 143 | russian - similarity - semantic similarity - similarity task - semantic similarity task | 13 | 143russiansimilaritysemantic similaritysimilarity task |
| 144 | code - source code - documentation - code generation - programming | 13 | 144codesource codedocumentationcode generation |
| 145 | semantic web - translation - machinetranslation - machine translation - technologies | 12 | 145semantic webtranslationmachinetranslationmachine translation |
| 146 | knowledge - knowledgegrounded - response - dialogue generation - dialogue | 12 | 146knowledgeknowledgegroundedresponsedialogue generation |
| 147 | sentence - sentence representations - sentence embeddings - transfer - tasks | 12 | 147sentencesentence representationssentence embeddingstransfer |
| 148 | distributional - distributional semantics - semantics - functional distributional - functional distributional semantics | 12 | 148distributionaldistributional semanticssemanticsfunctional distributional |
| 149 | compositionality - sc - distributional - sememe knowledge - phrase | 12 | 149compositionalityscdistributionalsememe knowledge |
| 150 | ud - annotation - treebank - treebanks - universal dependencies | 12 | 150udannotationtreebanktreebanks |
| 151 | acronym - abbreviation - acronyms - abbreviations - disambiguation | 12 | 151acronymabbreviationacronymsabbreviations |
| 152 | propaganda - task 11 - 11 - propaganda detection - semeval2020 task | 12 | 152propagandatask 1111propaganda detection |
| 153 | open - open information extraction - open information - information extraction - tuples | 12 | 153openopen information extractionopen informationinformation extraction |
| 154 | hebrew - bible - intertextuality - restoration - homographs | 11 | 154hebrewbibleintertextualityrestoration |
| 155 | typological - typology - typological features - languages - linguistic typology | 11 | 155typologicaltypologytypological featureslanguages |
| 156 | label - text classification - multilabel - labels - classification | 11 | 156labeltext classificationmultilabellabels |
| 157 | variational - latent - variational autoencoders - variational autoencoder - autoencoders | 11 | 157variationallatentvariational autoencodersvariational autoencoder |
| 158 | crisis - messages - disasters - disaster - emergency | 11 | 158crisismessagesdisastersdisaster |
| 159 | adversarial - rc - rc models - robustness - comprehension | 11 | 159adversarialrcrc modelsrobustness |
| 160 | tree - treelstm - trees - tree structures - syntactic | 11 | 160treetreelstmtreestree structures |
| 161 | headline - headlines - news - headline generation - synthetic news | 11 | 161headlineheadlinesnewsheadline generation |
| 162 | reasoning - kg - paths - kgs - multihop | 11 | 162reasoningkgpathskgs |
| 163 | text classification - classification - runtime - fasttext - text | 10 | 163text classificationclassificationruntimefasttext |
</details>
Training hyperparameters
- —calculate_probabilities: False
- —language: english
- —low_memory: False
- —mintopicsize: 10
- —ngramrange: (1, 1)
- —nr_topics: None
- —seedtopiclist: None
- —topnwords: 10
- —verbose: True
- —zeroshotminsimilarity: 0.7
- —zeroshottopiclist: None
Framework versions
- —Numpy: 1.25.2
- —HDBSCAN: 0.8.33
- —UMAP: 0.5.6
- —Pandas: 2.0.3
- —Scikit-Learn: 1.2.2
- —Sentence-transformers: 2.6.1
- —Transformers: 4.38.2
- —Numba: 0.58.1
- —Plotly: 5.15.0
- —Python: 3.10.12
