Modelpublic
KingKazma/xsum_6789_5000000_2500000_v1_150topics_train
0likes7downloads
Model Card
tags:
- —bertopic libraryname: bertopic pipelinetag: text-classification ---
xsum678950000002500000v1150topicstrain
This is a BERTopic model. BERTopic is a flexible and modular topic modeling framework that allows for the generation of easily interpretable topics from large datasets.
Usage
To use this model, please install BERTopic:
pip install -U bertopicYou can use the model as follows:
python
from bertopic import BERTopic
topic_model = BERTopic.load("KingKazma/xsum_6789_5000000_2500000_v1_150topics_train")
topic_model.get_topic_info()Topic overview
- —Number of topics: 150
- —Number of training documents: 204045
<details> <summary>Click here for an overview of all topics.</summary>
| Topic ID | Topic Keywords | Topic Frequency | Label |
|---|---|---|---|
| -1 | said - year - one - mr - also | 5 | -1saidyearonemr |
| 0 | half - win - kick - foul - game | 120934 | 0halfwinkickfoul |
| 1 | labour - eu - party - uk - vote | 12329 | 1laboureupartyuk |
| 2 | race - champion - world - title - fight | 7075 | 2racechampionworldtitle |
| 3 | school - education - health - patient - nhs | 5962 | 3schooleducationhealthpatient |
| 4 | police - murder - court - man - mr | 4410 | 4policemurdercourtman |
| 5 | rail - train - transport - driver - road | 4066 | 5railtraintransportdriver |
| 6 | al - syria - syrian - attack - us | 3623 | 6alsyriasyrianattack |
| 7 | prison - police - inquiry - abuse - court | 3574 | 7prisonpoliceinquiryabuse |
| 8 | africa - african - nigeria - president - boko | 2827 | 8africaafricannigeriapresident |
| 9 | fire - blaze - building - firefighter - smoke | 1675 | 9fireblazebuildingfirefighter |
| 10 | russia - russian - ukraine - putin - president | 1460 | 10russiarussianukraineputin |
| 11 | coastguard - fish - water - rescue - sea | 1341 | 11coastguardfishwaterrescue |
| 12 | dog - animal - zoo - cat - rspca | 1312 | 12doganimalzoocat |
| 13 | sale - company - share - firm - apple | 1302 | 13salecompanysharefirm |
| 14 | data - security - facebook - user - google | 1224 | 14datasecurityfacebookuser |
| 15 | energy - oil - gas - climate - price | 1084 | 15energyoilgasclimate |
| 16 | space - earth - planet - mission - satellite | 1072 | 16spaceearthplanetmission |
| 17 | cuba - venezuela - president - farc - maduro | 1057 | 17cubavenezuelapresidentfarc |
| 18 | art - council - library - building - museum | 1040 | 18artcouncillibrarybuilding |
| 19 | ireland - dup - northern - sinn - féin | 1020 | 19irelanddupnorthernsinn |
| 20 | bank - tax - fraud - money - bitcoin | 1008 | 20banktaxfraudmoney |
| 21 | flood - flooding - water - rain - storm | 959 | 21floodfloodingwaterrain |
| 22 | trump - clinton - mr - republican - president | 955 | 22trumpclintonmrrepublican |
| 23 | film - actor - star - show - best | 920 | 23filmactorstarshow |
| 24 | plane - aircraft - flight - drone - pilot | 918 | 24planeaircraftflightdrone |
| 25 | korea - north - china - korean - kim | 867 | 25koreanorthchinakorean |
| 26 | music - album - song - band - singer | 839 | 26musicalbumsongband |
| 27 | virus - ebola - vaccine - infection - disease | 827 | 27virusebolavaccineinfection |
| 28 | abortion - hospital - care - death - baby | 765 | 28abortionhospitalcaredeath |
| 29 | rate - growth - economy - inflation - bank | 759 | 29rategrowtheconomyinflation |
| 30 | airport - airline - heathrow - passenger - runway | 727 | 30airportairlineheathrowpassenger |
| 31 | yn - mae - ar - wedi - ei | 653 | 31ynmaearwedi |
| 32 | thailand - myanmar - thai - kyi - suu | 560 | 32thailandmyanmarthaikyi |
| 33 | attack - paris - french - france - police | 542 | 33attackparisfrenchfrance |
| 34 | migrant - refugee - asylum - eu - europe | 535 | 34migrantrefugeeasylumeu |
| 35 | ship - ferry - vessel - hms - navy | 522 | 35shipferryvesselhms |
| 36 | drug - cannabis - heroin - drugs - cocaine | 466 | 36drugcannabisheroindrugs |
| 37 | doping - athlete - iaaf - olympic - wada | 449 | 37dopingathleteiaafolympic |
| 38 | bbc - 00 - radio - tv - news | 442 | 38bbc00radiotv |
| 39 | pte - soldier - cpl - war - inquest | 422 | 39ptesoldiercplwar |
| 40 | india - modi - delhi - bjp - indian | 415 | 40indiamodidelhibjp |
| 41 | bird - bee - rspb - wildlife - birds | 398 | 41birdbeerspbwildlife |
| 42 | smoking - pollution - air - tobacco - cigarettes | 394 | 42smokingpollutionairtobacco |
| 43 | church - bishop - pope - vatican - cardinal | 393 | 43churchbishoppopevatican |
| 44 | greece - eurozone - greek - bank - ecb | 381 | 44greeceeurozonegreekbank |
| 45 | museum - roman - archaeologist - site - found | 335 | 45museumromanarchaeologistsite |
| 46 | alcohol - drink - whisky - drinking - wine | 320 | 46alcoholdrinkwhiskydrinking |
| 47 | australia - labor - nauru - australian - turnbull | 307 | 47australialabornauruaustralian |
| 48 | car - vw - emission - volkswagen - diesel | 299 | 48carvwemissionvolkswagen |
| 49 | unsupported - updated - playback - device - media | 294 | 49unsupportedupdatedplaybackdevice |
| 50 | robot - car - vehicle - technology - computer | 293 | 50robotcarvehicletechnology |
| 51 | broadband - bt - ofcom - mobile - openreach | 257 | 51broadbandbtofcommobile |
| 52 | prince - queen - duchess - royal - duke | 253 | 52princequeenduchessroyal |
| 53 | school - pupil - bullying - teacher - student | 250 | 53schoolpupilbullyingteacher |
| 54 | festival - event - yorkshire - edinburgh - tour | 241 | 54festivaleventyorkshireedinburgh |
| 55 | updated - gmt - bst - 2017 - last | 240 | 55updatedgmtbst2017 |
| 56 | fifa - blatter - platini - football - swiss | 225 | 56fifablatterplatinifootball |
| 57 | food - product - meat - horsemeat - nestle | 224 | 57foodproductmeathorsemeat |
| 58 | game - console - nintendo - vr - oculus | 209 | 58gameconsolenintendovr |
| 59 | book - novel - author - prize - writer | 208 | 59booknovelauthorprize |
| 60 | welsh - language - ashley - sports - sport | 201 | 60welshlanguageashleysports |
| 61 | manchester - concert - abedi - grande - ariana | 199 | 61manchesterconcertabedigrande |
| 62 | rousseff - lula - brazil - petrobras - temer | 196 | 62roussefflulabrazilpetrobras |
| 63 | charity - kids - batmanghelidjh - fundraising - service | 185 | 63charitykidsbatmanghelidjhfundraising |
| 64 | mountain - avalanche - everest - climber - snow | 185 | 64mountainavalancheeverestclimber |
| 65 | fgm - trafficking - slavery - sex - victim | 180 | 65fgmtraffickingslaverysex |
| 66 | trade - tpp - obamacare - ceta - us | 159 | 66tradetppobamacareceta |
| 67 | assange - wikileaks - snowden - manning - ecuador | 152 | 67assangewikileakssnowdenmanning |
| 68 | trident - defence - nuclear - submarine - army | 145 | 68tridentdefencenuclearsubmarine |
| 69 | berlusconi - italy - italian - regeni - renzi | 135 | 69berlusconiitalyitalianregeni |
| 70 | choi - park - ms - samsung - lee | 128 | 70choiparkmssamsung |
| 71 | mayor - ford - council - rahman - devolution | 126 | 71mayorfordcouncilrahman |
| 72 | mine - miner - coal - mining - pit | 126 | 72mineminercoalmining |
| 73 | ice - antarctic - sea - arctic - ocean | 126 | 73iceantarcticseaarctic |
| 74 | transgender - abortion - law - gay - marriage | 121 | 74transgenderabortionlawgay |
| 75 | gambling - lottery - jackpot - ticket - betting | 120 | 75gamblinglotteryjackpotticket |
| 76 | gay - marriage - same - sex - ashers | 119 | 76gaymarriagesamesex |
| 77 | flag - confederate - white - university - statue | 115 | 77flagconfederatewhiteuniversity |
| 78 | fossil - dinosaur - human - modern - homo | 109 | 78fossildinosaurhumanmodern |
| 79 | science - research - graphene - prof - prize | 109 | 79scienceresearchgrapheneprof |
| 80 | nuclear - japan - reactor - radiation - plant | 106 | 80nuclearjapanreactorradiation |
| 81 | tree - ash - trees - woodland - dieback | 105 | 81treeashtreeswoodland |
| 82 | trump - golf - crofting - turnberry - hie | 104 | 82trumpgolfcroftingturnberry |
| 83 | doping - armstrong - cycling - sharapova - meldonium | 101 | 83dopingarmstrongcyclingsharapova |
| 84 | picture - scotlandpictures - bbcscotlandpics - photo - selection | 100 | 84picturescotlandpicturesbbcscotlandpicsphoto |
| 85 | water - utilities - customer - cryptosporidium - company | 89 | 85waterutilitiescustomercryptosporidium |
| 86 | christmas - cake - santa - going - toy | 89 | 86christmascakesantagoing |
| 87 | fashion - dress - vogue - wear - designer | 82 | 87fashiondressvoguewear |
| 88 | nba - lakers - cavaliers - warriors - bryant | 82 | 88nbalakerscavalierswarriors |
| 89 | woman - women - female - gender - 100 | 74 | 89womanwomenfemalegender |
| 90 | robot - ant - prof - insect - robots | 74 | 90robotantprofinsect |
| 91 | cosby - constand - mueller - swift - lawyer | 68 | 91cosbyconstandmuellerswift |
| 92 | note - polymer - bank - banknote - coin | 66 | 92notepolymerbankbanknote |
| 93 | argentina - argentine - falklands - falkland - islands | 63 | 93argentinaargentinefalklandsfalkland |
| 94 | suicide - happiness - expectancy - life - age | 62 | 94suicidehappinessexpectancylife |
| 95 | volcano - ash - eruption - earthquake - bgs | 61 | 95volcanoasheruptionearthquake |
| 96 | nfl - patriots - brady - quarterback - bowl | 60 | 96nflpatriotsbradyquarterback |
| 97 | light - lighting - sky - dark - clock | 60 | 97lightlightingskydark |
| 98 | ring - diamond - jewellery - carat - jewel | 52 | 98ringdiamondjewellerycarat |
| 99 | pipeline - dakota - oil - sioux - keystone | 49 | 99pipelinedakotaoilsioux |
| 100 | bell - minster - ringers - ringing - imber | 49 | 100bellminsterringersringing |
| 101 | mail - royal - post - parcel - delivery | 47 | 101mailroyalpostparcel |
| 102 | breastfeeding - advert - body - asa - image | 47 | 102breastfeedingadvertbodyasa |
| 103 | sleep - clock - screen - hour - internet | 46 | 103sleepclockscreenhour |
| 104 | island - islands - prime - becomes - minister | 44 | 104islandislandsprimebecomes |
| 105 | qatar - worker - garment - factory - bangladesh | 43 | 105qatarworkergarmentfactory |
| 106 | laser - weapon - firearm - pilot - airgun | 41 | 106laserweaponfirearmpilot |
| 107 | palmyra - ancient - syrian - site - cultural | 39 | 107palmyraancientsyriansite |
| 108 | pokemon - game - ai - go - alphago | 39 | 108pokemongameaigo |
| 109 | flag - emojis - emoji - unicode - design | 37 | 109flagemojisemojiunicode |
| 110 | takata - airbags - recall - airbag - honda | 37 | 110takataairbagsrecallairbag |
| 111 | clown - clowns - craze - creepy - dressed | 35 | 111clownclownscrazecreepy |
| 112 | india - film - indian - bollywood - food | 34 | 112indiafilmindianbollywood |
| 113 | airbnb - bite - homeless - social - littlejohn | 33 | 113airbnbbitehomelesssocial |
| 114 | follow - - - - | 33 | 114follow__ |
| 115 | quantum - computing - photon - qubits - computer | 29 | 115quantumcomputingphotonqubits |
| 116 | bundy - federal - refuge - rancher - sweat | 26 | 116bundyfederalrefugerancher |
| 117 | cubs - baseball - series - curse - mets | 25 | 117cubsbaseballseriescurse |
| 118 | india - indian - china - modi - chinese | 24 | 118indiaindianchinamodi |
| 119 | sinkhole - hole - florida - fontmell - collapse | 24 | 119sinkholeholefloridafontmell |
| 120 | pitch - fixture - referee - rain - postponed | 24 | 120pitchfixturerefereerain |
| 121 | bloodhound - speed - car - record - rocket | 24 | 121bloodhoundspeedcarrecord |
| 122 | malala - pakistan - yousafzai - taliban - education | 24 | 122malalapakistanyousafzaitaliban |
| 123 | depp - joyce - dog - australia - boo | 22 | 123deppjoycedogaustralia |
| 124 | list - managerial - below - league - by | 18 | 124listmanagerialbelowleague |
| 125 | warrior - joint - unmanned - exercise - navy | 17 | 125warriorjointunmannedexercise |
| 126 | polanski - extradition - polish - geimer - poland | 17 | 126polanskiextraditionpolishgeimer |
| 127 | deaf - language - bsl - sign - hearing | 16 | 127deaflanguagebslsign |
| 128 | name - boys - girls - boy - top | 15 | 128nameboysgirlsboy |
| 129 | poppy - war - weeping - cummins - 888 | 15 | 129poppywarweepingcummins |
| 130 | tattoo - tattooists - tattooing - piercing - tattooist | 15 | 130tattootattooiststattooingpiercing |
| 131 | balakrishnan - commune - cult - aravindan - woman | 13 | 131balakrishnancommunecultaravindan |
| 132 | visa - brain - cothill - mrs - family | 13 | 132visabraincothillmrs |
| 133 | battery - lithium - ion - batteries - cathode | 13 | 133batterylithiumionbatteries |
| 134 | peachey - tip - calendar - finance - updated | 12 | 134peacheytipcalendarfinance |
| 135 | emperor - akihito - prince - throne - imperial | 12 | 135emperorakihitoprincethrone |
| 136 | dog - personality - animal - wolf - human | 11 | 136dogpersonalityanimalwolf |
| 137 | decay - dental - tooth - teeth - oral | 11 | 137decaydentaltoothteeth |
| 138 | puerto - princess - urdangarin - rico - cristina | 10 | 138puertoprincessurdangarinrico |
| 139 | pitt - jolie - paltrow - married - divorce | 10 | 139pittjoliepaltrowmarried |
| 140 | minnock - ethan - wildblood - father - court | 8 | 140minnockethanwildbloodfather |
| 141 | breaking - bbcbreaking - alert - fullest - via | 8 | 141breakingbbcbreakingalertfullest |
| 142 | balcony - berkeley - irish - student - donohoe | 7 | 142balconyberkeleyirishstudent |
| 143 | flower - garden - flowered - botanic - arum | 6 | 143flowergardenfloweredbotanic |
| 144 | potter - beasts - grindelwald - dumbledore - film | 6 | 144potterbeastsgrindelwalddumbledore |
| 145 | canal - waterway - oakham - towpath - lock | 5 | 145canalwaterwayoakhamtowpath |
| 146 | carta - magna - 1215 - king - charter | 5 | 146cartamagna1215king |
| 147 | mccollum - reid - peru - cocaine - lima | 5 | 147mccollumreidperucocaine |
| 148 | film - scotland - location - outlander - movie | 5 | 148filmscotlandlocationoutlander |
</details>
Training hyperparameters
- —calculate_probabilities: True
- —language: None
- —low_memory: False
- —mintopicsize: 10
- —ngramrange: (1, 1)
- —nr_topics: 150
- —seedtopiclist: None
- —topnwords: 10
- —verbose: False
Framework versions
- —Numpy: 1.23.5
- —HDBSCAN: 0.8.33
- —UMAP: 0.5.3
- —Pandas: 1.5.3
- —Scikit-Learn: 1.2.2
- —Sentence-transformers: 2.2.2
- —Transformers: 4.31.0
- —Numba: 0.57.1
- —Plotly: 5.15.0
- —Python: 3.10.12
