CoolFace
Modelpublic

KingKazma/xsum_6789_5000000_2500000_v1_150topics_train

sourceHugging Faceupdated 3y agoView on Hugging Face
0likes7downloads
Model Card

tags:

  • —bertopic libraryname: bertopic pipelinetag: text-classification ---

xsum678950000002500000v1150topicstrain

This is a BERTopic model. BERTopic is a flexible and modular topic modeling framework that allows for the generation of easily interpretable topics from large datasets.

Usage

To use this model, please install BERTopic:

pip install -U bertopic

You can use the model as follows:

python
from bertopic import BERTopic
topic_model = BERTopic.load("KingKazma/xsum_6789_5000000_2500000_v1_150topics_train")

topic_model.get_topic_info()

Topic overview

  • —Number of topics: 150
  • —Number of training documents: 204045

<details> <summary>Click here for an overview of all topics.</summary>

Topic IDTopic KeywordsTopic FrequencyLabel
-1said - year - one - mr - also5-1saidyearonemr
0half - win - kick - foul - game1209340halfwinkickfoul
1labour - eu - party - uk - vote123291laboureupartyuk
2race - champion - world - title - fight70752racechampionworldtitle
3school - education - health - patient - nhs59623schooleducationhealthpatient
4police - murder - court - man - mr44104policemurdercourtman
5rail - train - transport - driver - road40665railtraintransportdriver
6al - syria - syrian - attack - us36236alsyriasyrianattack
7prison - police - inquiry - abuse - court35747prisonpoliceinquiryabuse
8africa - african - nigeria - president - boko28278africaafricannigeriapresident
9fire - blaze - building - firefighter - smoke16759fireblazebuildingfirefighter
10russia - russian - ukraine - putin - president146010russiarussianukraineputin
11coastguard - fish - water - rescue - sea134111coastguardfishwaterrescue
12dog - animal - zoo - cat - rspca131212doganimalzoocat
13sale - company - share - firm - apple130213salecompanysharefirm
14data - security - facebook - user - google122414datasecurityfacebookuser
15energy - oil - gas - climate - price108415energyoilgasclimate
16space - earth - planet - mission - satellite107216spaceearthplanetmission
17cuba - venezuela - president - farc - maduro105717cubavenezuelapresidentfarc
18art - council - library - building - museum104018artcouncillibrarybuilding
19ireland - dup - northern - sinn - féin102019irelanddupnorthernsinn
20bank - tax - fraud - money - bitcoin100820banktaxfraudmoney
21flood - flooding - water - rain - storm95921floodfloodingwaterrain
22trump - clinton - mr - republican - president95522trumpclintonmrrepublican
23film - actor - star - show - best92023filmactorstarshow
24plane - aircraft - flight - drone - pilot91824planeaircraftflightdrone
25korea - north - china - korean - kim86725koreanorthchinakorean
26music - album - song - band - singer83926musicalbumsongband
27virus - ebola - vaccine - infection - disease82727virusebolavaccineinfection
28abortion - hospital - care - death - baby76528abortionhospitalcaredeath
29rate - growth - economy - inflation - bank75929rategrowtheconomyinflation
30airport - airline - heathrow - passenger - runway72730airportairlineheathrowpassenger
31yn - mae - ar - wedi - ei65331ynmaearwedi
32thailand - myanmar - thai - kyi - suu56032thailandmyanmarthaikyi
33attack - paris - french - france - police54233attackparisfrenchfrance
34migrant - refugee - asylum - eu - europe53534migrantrefugeeasylumeu
35ship - ferry - vessel - hms - navy52235shipferryvesselhms
36drug - cannabis - heroin - drugs - cocaine46636drugcannabisheroindrugs
37doping - athlete - iaaf - olympic - wada44937dopingathleteiaafolympic
38bbc - 00 - radio - tv - news44238bbc00radiotv
39pte - soldier - cpl - war - inquest42239ptesoldiercplwar
40india - modi - delhi - bjp - indian41540indiamodidelhibjp
41bird - bee - rspb - wildlife - birds39841birdbeerspbwildlife
42smoking - pollution - air - tobacco - cigarettes39442smokingpollutionairtobacco
43church - bishop - pope - vatican - cardinal39343churchbishoppopevatican
44greece - eurozone - greek - bank - ecb38144greeceeurozonegreekbank
45museum - roman - archaeologist - site - found33545museumromanarchaeologistsite
46alcohol - drink - whisky - drinking - wine32046alcoholdrinkwhiskydrinking
47australia - labor - nauru - australian - turnbull30747australialabornauruaustralian
48car - vw - emission - volkswagen - diesel29948carvwemissionvolkswagen
49unsupported - updated - playback - device - media29449unsupportedupdatedplaybackdevice
50robot - car - vehicle - technology - computer29350robotcarvehicletechnology
51broadband - bt - ofcom - mobile - openreach25751broadbandbtofcommobile
52prince - queen - duchess - royal - duke25352princequeenduchessroyal
53school - pupil - bullying - teacher - student25053schoolpupilbullyingteacher
54festival - event - yorkshire - edinburgh - tour24154festivaleventyorkshireedinburgh
55updated - gmt - bst - 2017 - last24055updatedgmtbst2017
56fifa - blatter - platini - football - swiss22556fifablatterplatinifootball
57food - product - meat - horsemeat - nestle22457foodproductmeathorsemeat
58game - console - nintendo - vr - oculus20958gameconsolenintendovr
59book - novel - author - prize - writer20859booknovelauthorprize
60welsh - language - ashley - sports - sport20160welshlanguageashleysports
61manchester - concert - abedi - grande - ariana19961manchesterconcertabedigrande
62rousseff - lula - brazil - petrobras - temer19662roussefflulabrazilpetrobras
63charity - kids - batmanghelidjh - fundraising - service18563charitykidsbatmanghelidjhfundraising
64mountain - avalanche - everest - climber - snow18564mountainavalancheeverestclimber
65fgm - trafficking - slavery - sex - victim18065fgmtraffickingslaverysex
66trade - tpp - obamacare - ceta - us15966tradetppobamacareceta
67assange - wikileaks - snowden - manning - ecuador15267assangewikileakssnowdenmanning
68trident - defence - nuclear - submarine - army14568tridentdefencenuclearsubmarine
69berlusconi - italy - italian - regeni - renzi13569berlusconiitalyitalianregeni
70choi - park - ms - samsung - lee12870choiparkmssamsung
71mayor - ford - council - rahman - devolution12671mayorfordcouncilrahman
72mine - miner - coal - mining - pit12672mineminercoalmining
73ice - antarctic - sea - arctic - ocean12673iceantarcticseaarctic
74transgender - abortion - law - gay - marriage12174transgenderabortionlawgay
75gambling - lottery - jackpot - ticket - betting12075gamblinglotteryjackpotticket
76gay - marriage - same - sex - ashers11976gaymarriagesamesex
77flag - confederate - white - university - statue11577flagconfederatewhiteuniversity
78fossil - dinosaur - human - modern - homo10978fossildinosaurhumanmodern
79science - research - graphene - prof - prize10979scienceresearchgrapheneprof
80nuclear - japan - reactor - radiation - plant10680nuclearjapanreactorradiation
81tree - ash - trees - woodland - dieback10581treeashtreeswoodland
82trump - golf - crofting - turnberry - hie10482trumpgolfcroftingturnberry
83doping - armstrong - cycling - sharapova - meldonium10183dopingarmstrongcyclingsharapova
84picture - scotlandpictures - bbcscotlandpics - photo - selection10084picturescotlandpicturesbbcscotlandpicsphoto
85water - utilities - customer - cryptosporidium - company8985waterutilitiescustomercryptosporidium
86christmas - cake - santa - going - toy8986christmascakesantagoing
87fashion - dress - vogue - wear - designer8287fashiondressvoguewear
88nba - lakers - cavaliers - warriors - bryant8288nbalakerscavalierswarriors
89woman - women - female - gender - 1007489womanwomenfemalegender
90robot - ant - prof - insect - robots7490robotantprofinsect
91cosby - constand - mueller - swift - lawyer6891cosbyconstandmuellerswift
92note - polymer - bank - banknote - coin6692notepolymerbankbanknote
93argentina - argentine - falklands - falkland - islands6393argentinaargentinefalklandsfalkland
94suicide - happiness - expectancy - life - age6294suicidehappinessexpectancylife
95volcano - ash - eruption - earthquake - bgs6195volcanoasheruptionearthquake
96nfl - patriots - brady - quarterback - bowl6096nflpatriotsbradyquarterback
97light - lighting - sky - dark - clock6097lightlightingskydark
98ring - diamond - jewellery - carat - jewel5298ringdiamondjewellerycarat
99pipeline - dakota - oil - sioux - keystone4999pipelinedakotaoilsioux
100bell - minster - ringers - ringing - imber49100bellminsterringersringing
101mail - royal - post - parcel - delivery47101mailroyalpostparcel
102breastfeeding - advert - body - asa - image47102breastfeedingadvertbodyasa
103sleep - clock - screen - hour - internet46103sleepclockscreenhour
104island - islands - prime - becomes - minister44104islandislandsprimebecomes
105qatar - worker - garment - factory - bangladesh43105qatarworkergarmentfactory
106laser - weapon - firearm - pilot - airgun41106laserweaponfirearmpilot
107palmyra - ancient - syrian - site - cultural39107palmyraancientsyriansite
108pokemon - game - ai - go - alphago39108pokemongameaigo
109flag - emojis - emoji - unicode - design37109flagemojisemojiunicode
110takata - airbags - recall - airbag - honda37110takataairbagsrecallairbag
111clown - clowns - craze - creepy - dressed35111clownclownscrazecreepy
112india - film - indian - bollywood - food34112indiafilmindianbollywood
113airbnb - bite - homeless - social - littlejohn33113airbnbbitehomelesssocial
114follow - - - -33114follow__
115quantum - computing - photon - qubits - computer29115quantumcomputingphotonqubits
116bundy - federal - refuge - rancher - sweat26116bundyfederalrefugerancher
117cubs - baseball - series - curse - mets25117cubsbaseballseriescurse
118india - indian - china - modi - chinese24118indiaindianchinamodi
119sinkhole - hole - florida - fontmell - collapse24119sinkholeholefloridafontmell
120pitch - fixture - referee - rain - postponed24120pitchfixturerefereerain
121bloodhound - speed - car - record - rocket24121bloodhoundspeedcarrecord
122malala - pakistan - yousafzai - taliban - education24122malalapakistanyousafzaitaliban
123depp - joyce - dog - australia - boo22123deppjoycedogaustralia
124list - managerial - below - league - by18124listmanagerialbelowleague
125warrior - joint - unmanned - exercise - navy17125warriorjointunmannedexercise
126polanski - extradition - polish - geimer - poland17126polanskiextraditionpolishgeimer
127deaf - language - bsl - sign - hearing16127deaflanguagebslsign
128name - boys - girls - boy - top15128nameboysgirlsboy
129poppy - war - weeping - cummins - 88815129poppywarweepingcummins
130tattoo - tattooists - tattooing - piercing - tattooist15130tattootattooiststattooingpiercing
131balakrishnan - commune - cult - aravindan - woman13131balakrishnancommunecultaravindan
132visa - brain - cothill - mrs - family13132visabraincothillmrs
133battery - lithium - ion - batteries - cathode13133batterylithiumionbatteries
134peachey - tip - calendar - finance - updated12134peacheytipcalendarfinance
135emperor - akihito - prince - throne - imperial12135emperorakihitoprincethrone
136dog - personality - animal - wolf - human11136dogpersonalityanimalwolf
137decay - dental - tooth - teeth - oral11137decaydentaltoothteeth
138puerto - princess - urdangarin - rico - cristina10138puertoprincessurdangarinrico
139pitt - jolie - paltrow - married - divorce10139pittjoliepaltrowmarried
140minnock - ethan - wildblood - father - court8140minnockethanwildbloodfather
141breaking - bbcbreaking - alert - fullest - via8141breakingbbcbreakingalertfullest
142balcony - berkeley - irish - student - donohoe7142balconyberkeleyirishstudent
143flower - garden - flowered - botanic - arum6143flowergardenfloweredbotanic
144potter - beasts - grindelwald - dumbledore - film6144potterbeastsgrindelwalddumbledore
145canal - waterway - oakham - towpath - lock5145canalwaterwayoakhamtowpath
146carta - magna - 1215 - king - charter5146cartamagna1215king
147mccollum - reid - peru - cocaine - lima5147mccollumreidperucocaine
148film - scotland - location - outlander - movie5148filmscotlandlocationoutlander

</details>

Training hyperparameters

  • —calculate_probabilities: True
  • —language: None
  • —low_memory: False
  • —mintopicsize: 10
  • —ngramrange: (1, 1)
  • —nr_topics: 150
  • —seedtopiclist: None
  • —topnwords: 10
  • —verbose: False

Framework versions

  • —Numpy: 1.23.5
  • —HDBSCAN: 0.8.33
  • —UMAP: 0.5.3
  • —Pandas: 1.5.3
  • —Scikit-Learn: 1.2.2
  • —Sentence-transformers: 2.2.2
  • —Transformers: 4.31.0
  • —Numba: 0.57.1
  • —Plotly: 5.15.0
  • —Python: 3.10.12