CoolFace
Modelpublic

Thang203/general_nlp_research_paper

sourceHugging Faceupdated 2y agoView on Hugging Face
0likes5downloads
Model Card

tags:

  • —bertopic libraryname: bertopic pipelinetag: text-classification ---

generalnlpresearch_paper

This is a BERTopic model. BERTopic is a flexible and modular topic modeling framework that allows for the generation of easily interpretable topics from large datasets.

Usage

To use this model, please install BERTopic:

pip install -U bertopic

You can use the model as follows:

python
from bertopic import BERTopic
topic_model = BERTopic.load("Thang203/general_nlp_research_paper")

topic_model.get_topic_info()

Topic overview

  • —Number of topics: 165
  • —Number of training documents: 11000

<details> <summary>Click here for an overview of all topics.</summary>

Topic IDTopic KeywordsTopic FrequencyLabel
-1language - models - model - data - translation10-1languagemodelsmodeldata
0question - answer - questions - answering - question answering34880questionanswerquestionsanswering
1speech - speech recognition - acoustic - recognition - asr5131speechspeech recognitionacousticrecognition
2summarization - summaries - abstractive - summary - extractive3452summarizationsummariesabstractivesummary
3clinical - medical - biomedical - extraction - notes3373clinicalmedicalbiomedicalextraction
4translation - machine translation - parallel - machine - nmt2584translationmachine translationparallelmachine
5emotion - emotions - emotional - emotion recognition - affective2115emotionemotionsemotionalemotion recognition
6word - embeddings - word embeddings - similarity - vector1646wordembeddingsword embeddingssimilarity
7bert - probing - tasks - pretraining - pretrained1457bertprobingtaskspretraining
8relation - relation extraction - extraction - relations - distant1388relationrelation extractionextractionrelations
9hate - hate speech - offensive - detection - speech1349hatehate speechoffensivedetection
10arabic - sanskrit - kurdish - transliteration - rules11810arabicsanskritkurdishtransliteration
11aspect - sentiment - sentiment analysis - aspectbased sentiment - aspectbased11811aspectsentimentsentiment analysisaspectbased sentiment
12morphological - inflection - languages - morphology - morphological analysis11212morphologicalinflectionlanguagesmorphology
13ner - named entity - named - entity recognition - named entity recognition10713nernamed entitynamedentity recognition
14multimodal - image - visual - captions - images10114multimodalimagevisualcaptions
15discourse - discourse relation - discourse parsing - implicit discourse - discourse relations9815discoursediscourse relationdiscourse parsingimplicit discourse
16chinese - segmentation - word segmentation - chinese word - chinese word segmentation8916chinesesegmentationword segmentationchinese word
17crosslingual - bilingual - embeddings - crosslingual word - word embeddings8417crosslingualbilingualembeddingscrosslingual word
18entropy - law - languages - script - frequency7918entropylawlanguagesscript
19argument - argumentation - arguments - argumentative - mining7719argumentargumentationargumentsargumentative
20nmt - neural machine - neural machine translation - translation - machine translation7720nmtneural machineneural machine translationtranslation
21parsing - dependency - dependency parsing - parser - transitionbased7621parsingdependencydependency parsingparser
22syntactic - rnns - grammatical - language models - agreement7122syntacticrnnsgrammaticallanguage models
23generation - datatotext - text generation - datatotext generation - text7123generationdatatotexttext generationdatatotext generation
24topic - topics - topic models - topic modeling - lda7124topictopicstopic modelstopic modeling
25knowledge - knowledge graph - entities - relation - graph6825knowledgeknowledge graphentitiesrelation
26gender - bias - gender bias - biases - embeddings6626genderbiasgender biasbiases
27story - stories - story generation - narrative - plot6527storystoriesstory generationnarrative
28dialogue - dialog - user - taskoriented - agent6528dialoguedialogusertaskoriented
29transformer - attention - selfattention - heads - layers6529transformerattentionselfattentionheads
30srl - semantic role - role labeling - semantic role labeling - role6430srlsemantic rolerole labelingsemantic role labeling
31change - semantic change - diachronic - lexical semantic - semantic6431changesemantic changediachroniclexical semantic
32sense - wsd - disambiguation - word sense - sense disambiguation6432sensewsddisambiguationword sense
33paraphrase - paraphrases - paraphrase generation - paraphrasing - paraphrase identification6333paraphraseparaphrasesparaphrase generationparaphrasing
34linking - entity linking - entity - el - entities6234linkingentity linkingentityel
35authorship - attribution - authorship attribution - authors - stylistic6035authorshipattributionauthorship attributionauthors
36tracking - state tracking - dialogue state - state - dialogue5436trackingstate trackingdialogue statestate
37nli - natural language inference - language inference - inference - natural language5437nlinatural language inferencelanguage inferenceinference
38act - dialogue act - dialogue - dialog act - dialog5138actdialogue actdialoguedialog act
39commonsense - reasoning - commonsense reasoning - knowledge - commonsense knowledge4939commonsensereasoningcommonsense reasoningknowledge
40crosslingual - multilingual - transfer - crosslingual transfer - mbert4940crosslingualmultilingualtransfercrosslingual transfer
41coreference - resolution - coreference resolution - mention - pronoun4941coreferenceresolutioncoreference resolutionmention
42legal - patent - court - case - legal domain4842legalpatentcourtcase
43dialect - identification - language identification - dialect identification - arabic4743dialectidentificationlanguage identificationdialect identification
44amr - amr parsing - parsing - meaning representation - meaning4644amramr parsingparsingmeaning representation
45adversarial - adversarial examples - attacks - attack - examples4645adversarialadversarial examplesattacksattack
46health - mental - mental health - social media - media4546healthmentalmental healthsocial media
47offensive - offensive language - subtask - offensive language identification - hostile4547offensiveoffensive languagesubtaskoffensive language identification
48semantic parsing - parsing - semantic - compositional generalization - logical4448semantic parsingparsingsemanticcompositional generalization
49recurrent - language modeling - rnn - lstm - modeling4449recurrentlanguage modelingrnnlstm
50sql - texttosql - database - queries - query4450sqltexttosqldatabasequeries
51indian - smt - translation - machine translation - machine4351indiansmttranslationmachine translation
52style - style transfer - transfer - text style - text style transfer4352stylestyle transfertransfertext style
53poetry - poems - lyrics - music - verse4353poetrypoemslyricsmusic
54codeswitching - cs - codeswitched - codemixed - monolingual4354codeswitchingcscodeswitchedcodemixed
55sentiment - polarity - sentiment analysis - analysis - prior polarity4155sentimentpolaritysentiment analysisanalysis
56sarcasm - sarcasm detection - sarcastic - detection - irony4156sarcasmsarcasm detectionsarcasticdetection
57gec - grammatical error - grammatical error correction - error correction - correction4057gecgrammatical errorgrammatical error correctionerror correction
58intent - intent detection - slot - slot filling - filling4058intentintent detectionslotslot filling
59temporal - events - temporal relations - expressions - temporal relation3959temporaleventstemporal relationsexpressions
60adaptation - domain - domain adaptation - indomain - translation3760adaptationdomaindomain adaptationindomain
61stance - stance detection - detection - tweets - veracity3761stancestance detectiondetectiontweets
62codemixed - sentiment - sentiment analysis - analysis - semeval20203662codemixedsentimentsentiment analysisanalysis
63keyphrase - keyphrases - keyphrase extraction - keyphrase generation - extraction3563keyphrasekeyphraseskeyphrase extractionkeyphrase generation
64nmt - subword - translation - vocabulary - neural machine translation3564nmtsubwordtranslationvocabulary
65calculus - logic - semantics - proof - typelogical3565calculuslogicsemanticsproof
66simplification - text simplification - sentence simplification - sentence - ts3566simplificationtext simplificationsentence simplificationsentence
67annotation - xml - formats - tei - standards3567annotationxmlformatstei
68correction - spelling - ocr - spelling correction - errors3368correctionspellingocrspelling correction
69sentiment - sentiment classification - sentiment analysis - classification - analysis3369sentimentsentiment classificationsentiment analysisclassification
70complexity - readability - lexical complexity - assessment - readability assessment3170complexityreadabilitylexical complexityassessment
71postediting - ape - automatic postediting - mt - translation3071posteditingapeautomatic posteditingmt
72gender - gender bias - bias - translation - pronouns3072gendergender biasbiastranslation
73tagger - tagging - taggers - pos - partofspeech3073taggertaggingtaggerspos
74meeting - summarization - podcast - abstractive - summaries3074meetingsummarizationpodcastabstractive
75domain - domain adaptation - adaptation - domains - target domain3075domaindomain adaptationadaptationdomains
76documentlevel - context - translation - nmt - neural machine2976documentlevelcontexttranslationnmt
77text classification - classification - convolutional - networks - convolutional neural2977text classificationclassificationconvolutionalnetworks
78news - fake - fake news - clickbait - satirical2978newsfakefake newsclickbait
79grammars - grammar - stochastic - contextfree - contextfree grammars2979grammarsgrammarstochasticcontextfree
80ontology - rogets - thesaurus - wordnet - concepts2980ontologyrogetsthesauruswordnet
81vietnamese - ner - named entity recognition - entity recognition - named entity2881vietnamesenernamed entity recognitionentity recognition
82claim - verification - evidence - claims - fever2782claimverificationevidenceclaims
83metrics - nlg - language generation - evaluation - natural language generation2783metricsnlglanguage generationevaluation
84responses - response - response generation - adversarial - generation2784responsesresponseresponse generationadversarial
85robustness - nmt - translation - neural machine - neural machine translation2785robustnessnmttranslationneural machine
86revision - editing - seq2seq - revisions - rewriting2786revisioneditingseq2seqrevisions
87phonological - phonology - finitestate - reduplication - prosody2687phonologicalphonologyfinitestatereduplication
88geolocation - location - geographic - twitter - names2688geolocationlocationgeographictwitter
89event - event extraction - extraction - event types - argument2689eventevent extractionextractionevent types
90mt - human - translation - evaluation - parity2590mthumantranslationevaluation
91arabic - sentiment - sentiment analysis - arabic sentiment - arabic sentiment analysis2591arabicsentimentsentiment analysisarabic sentiment
92emoji - emojis - emoji prediction - emoticons - sentiment2592emojiemojisemoji predictionemoticons
93constituency - latent tree - parsing - constituency parsing - tree learning2593constituencylatent treeparsingconstituency parsing
94spatial - instructions - 3d - environment - robot2494spatialinstructions3denvironment
95persona - responses - personality - traits - consistency2395personaresponsespersonalitytraits
96matching - response - retrievalbased - chatbots - multiturn2396matchingresponseretrievalbasedchatbots
97entity - entity typing - typing - finegrained entity - type2297entityentity typingtypingfinegrained entity
98math - word problems - math word - word problem - problems2198mathword problemsmath wordword problem
99bert - multilingual - multilingual bert - bert model - multilingual models2199bertmultilingualmultilingual bertbert model
100financial - stock - market - news - price21100financialstockmarketnews
101video - multimodal - sceneaware - dialog - visual21101videomultimodalsceneawaredialog
102sense - multisense - senses - word sense - word21102sensemultisensesensesword sense
103game - games - agents - communication - pragmatic21103gamegamesagentscommunication
104graph - amrtotext - amrtotext generation - amr - graphs20104graphamrtotextamrtotext generationamr
105nmt - translation - neural machine translation - neural machine - machine translation20105nmttranslationneural machine translationneural machine
106normalization - text normalization - normalizing - text - historical20106normalizationtext normalizationnormalizingtext
107privacy - policies - anonymization - deidentification - vague20107privacypoliciesanonymizationdeidentification
108beam - beam search - search - decoding - constraints20108beambeam searchsearchdecoding
109hypernymy - distributional - pathbased - hypernymy detection - hypernyms19109hypernymydistributionalpathbasedhypernymy detection
110political - bias - articles - news - ideology19110politicalbiasarticlesnews
111generative adversarial - gans - gan - generative - generative adversarial networks18111generative adversarialgansgangenerative
112pos - tagger - tagging - pos tagging - codemixed17112postaggertaggingpos tagging
113humor - humorous - headlines - funny - puns17113humorhumorousheadlinesfunny
114metaphor - metaphors - metaphoric - metaphorical - literal17114metaphormetaphorsmetaphoricmetaphorical
115codeswitching - cs - asr - speech - speech recognition17115codeswitchingcsasrspeech
116event coreference - event - coreference - coreference resolution - resolution17116event coreferenceeventcoreferencecoreference resolution
117reviews - review - helpfulness - opinion - online reviews17117reviewsreviewhelpfulnessopinion
118covid19 - tweets - wnut2020 - twitter - informative17118covid19tweetswnut2020twitter
119anaphora - resolution - pronouns - pronoun - anaphora resolution17119anaphoraresolutionpronounspronoun
120bilingual - dictionary - comparability - termhood - comparable corpora17120bilingualdictionarycomparabilitytermhood
121discourse - translation - pronouns - dp - discourse phenomena17121discoursetranslationpronounsdp
122color - colour - naming - colors - character embeddings16122colorcolournamingcolors
123nonautoregressive - autoregressive - nat - nonautoregressive neural - decoding16123nonautoregressiveautoregressivenatnonautoregressive neural
124nlg - natural language generation - language generation - spoken dialogue - generation16124nlgnatural language generationlanguage generationspoken dialogue
125crowdsourcing - workers - examples - protocols - data collection16125crowdsourcingworkersexamplesprotocols
126african - revolution - african languages - technology - african language16126africanrevolutionafrican languagestechnology
127grading - scoring - essay - short answer - essay scoring16127gradingscoringessayshort answer
128treebanks - treebank - parsing - crosslingual - dependency16128treebankstreebankparsingcrosslingual
129reviews - summarization - review - product - summaries16129reviewssummarizationreviewproduct
130gaze - reading - eyetracking - eye - behaviour16130gazereadingeyetrackingeye
131nlp - natural - natural language - nlg - language15131nlpnaturalnatural languagenlg
132news translation - news translation task - translation task - news - submission14132news translationnews translation tasktranslation tasknews
133eat - meaning - semantics - formal - theory14133eatmeaningsemanticsformal
134sign - sign language - sl - asl - deaf14134signsign languageslasl
135multitask - labels - mtl - sequence - multitask learning14135multitasklabelsmtlsequence
136phylogenetic - cognate - indoeuropean - historical linguistics - indoeuropean language14136phylogeneticcognateindoeuropeanhistorical linguistics
137syntax - translation - neural machine translation - neural machine - nmt14137syntaxtranslationneural machine translationneural machine
138explanations - explanation - explainers - nl explanations - faithful14138explanationsexplanationexplainersnl explanations
139slot - slot filling - filling - slots - nlu13139slotslot fillingfillingslots
140personality - traits - profiling - author profiling - author13140personalitytraitsprofilingauthor profiling
141preposition - prepositions - supersenses - prepositional - supersense13141prepositionprepositionssupersensesprepositional
142scientific - application areas - application - areas - literature13142scientificapplication areasapplicationareas
143russian - similarity - semantic similarity - similarity task - semantic similarity task13143russiansimilaritysemantic similaritysimilarity task
144code - source code - documentation - code generation - programming13144codesource codedocumentationcode generation
145semantic web - translation - machinetranslation - machine translation - technologies12145semantic webtranslationmachinetranslationmachine translation
146knowledge - knowledgegrounded - response - dialogue generation - dialogue12146knowledgeknowledgegroundedresponsedialogue generation
147sentence - sentence representations - sentence embeddings - transfer - tasks12147sentencesentence representationssentence embeddingstransfer
148distributional - distributional semantics - semantics - functional distributional - functional distributional semantics12148distributionaldistributional semanticssemanticsfunctional distributional
149compositionality - sc - distributional - sememe knowledge - phrase12149compositionalityscdistributionalsememe knowledge
150ud - annotation - treebank - treebanks - universal dependencies12150udannotationtreebanktreebanks
151acronym - abbreviation - acronyms - abbreviations - disambiguation12151acronymabbreviationacronymsabbreviations
152propaganda - task 11 - 11 - propaganda detection - semeval2020 task12152propagandatask 1111propaganda detection
153open - open information extraction - open information - information extraction - tuples12153openopen information extractionopen informationinformation extraction
154hebrew - bible - intertextuality - restoration - homographs11154hebrewbibleintertextualityrestoration
155typological - typology - typological features - languages - linguistic typology11155typologicaltypologytypological featureslanguages
156label - text classification - multilabel - labels - classification11156labeltext classificationmultilabellabels
157variational - latent - variational autoencoders - variational autoencoder - autoencoders11157variationallatentvariational autoencodersvariational autoencoder
158crisis - messages - disasters - disaster - emergency11158crisismessagesdisastersdisaster
159adversarial - rc - rc models - robustness - comprehension11159adversarialrcrc modelsrobustness
160tree - treelstm - trees - tree structures - syntactic11160treetreelstmtreestree structures
161headline - headlines - news - headline generation - synthetic news11161headlineheadlinesnewsheadline generation
162reasoning - kg - paths - kgs - multihop11162reasoningkgpathskgs
163text classification - classification - runtime - fasttext - text10163text classificationclassificationruntimefasttext

</details>

Training hyperparameters

  • —calculate_probabilities: False
  • —language: english
  • —low_memory: False
  • —mintopicsize: 10
  • —ngramrange: (1, 1)
  • —nr_topics: None
  • —seedtopiclist: None
  • —topnwords: 10
  • —verbose: True
  • —zeroshotminsimilarity: 0.7
  • —zeroshottopiclist: None

Framework versions

  • —Numpy: 1.25.2
  • —HDBSCAN: 0.8.33
  • —UMAP: 0.5.6
  • —Pandas: 2.0.3
  • —Scikit-Learn: 1.2.2
  • —Sentence-transformers: 2.6.1
  • —Transformers: 4.38.2
  • —Numba: 0.58.1
  • —Plotly: 5.15.0
  • —Python: 3.10.12