Modelpublic
KingKazma/cnn_dailymail_6789_200000_100000_v1_150topics_train
0likes15downloads
Model Card
tags:
- —bertopic libraryname: bertopic pipelinetag: text-classification ---
cnndailymail6789200000100000v1150topics_train
This is a BERTopic model. BERTopic is a flexible and modular topic modeling framework that allows for the generation of easily interpretable topics from large datasets.
Usage
To use this model, please install BERTopic:
pip install -U bertopicYou can use the model as follows:
python
from bertopic import BERTopic
topic_model = BERTopic.load("KingKazma/cnn_dailymail_6789_200000_100000_v1_150topics_train")
topic_model.get_topic_info()Topic overview
- —Number of topics: 150
- —Number of training documents: 200000
<details> <summary>Click here for an overview of all topics.</summary>
| Topic ID | Topic Keywords | Topic Frequency | Label |
|---|---|---|---|
| -1 | said - one - year - people - also | 5 | -1saidoneyearpeople |
| 0 | league - player - club - cup - goal | 104194 | 0leagueplayerclubcup |
| 1 | police - said - told - murder - court | 19383 | 1policesaidtoldmurder |
| 2 | security - us - military - government - said | 14660 | 2securityusmilitarygovernment |
| 3 | race - win - champion - open - murray | 6315 | 3racewinchampionopen |
| 4 | nfl - fight - game - team - player | 4973 | 4nflfightgameteam |
| 5 | dog - animal - cat - zoo - pet | 2700 | 5doganimalcatzoo |
| 6 | obama - republican - president - republicans - romney | 2115 | 6obamarepublicanpresidentrepublicans |
| 7 | car - driver - driving - vehicle - road | 2068 | 7cardriverdrivingvehicle |
| 8 | flight - plane - passenger - airline - airport | 2016 | 8flightplanepassengerairline |
| 9 | nhs - bank - patient - eu - cent | 1995 | 9nhsbankpatienteu |
| 10 | show - film - cosby - movie - actor | 1914 | 10showfilmcosbymovie |
| 11 | weather - storm - snow - rain - water | 1874 | 11weatherstormsnowrain |
| 12 | shark - whale - ship - oil - sea | 1577 | 12sharkwhaleshipoil |
| 13 | fashion - art - painting - artist - collection | 1513 | 13fashionartpaintingartist |
| 14 | war - soldier - army - scotland - british | 1485 | 14warsoldierarmyscotland |
| 15 | space - earth - mars - planet - nasa | 1300 | 15spaceearthmarsplanet |
| 16 | ebola - virus - disease - health - outbreak | 1212 | 16ebolavirusdiseasehealth |
| 17 | russian - russia - ukraine - putin - ukrainian | 1193 | 17russianrussiaukraineputin |
| 18 | haiti - cuba - chavez - cuban - president | 1173 | 18haiticubachavezcuban |
| 19 | korea - north - korean - kim - south | 1120 | 19koreanorthkoreankim |
| 20 | china - chinese - chinas - hong - beijing | 928 | 20chinachinesechinashong |
| 21 | property - house - price - home - estate | 909 | 21propertyhousepricehome |
| 22 | mandela - africa - african - boko - haram | 884 | 22mandelaafricaafricanboko |
| 23 | bali - thai - thailand - philippines - bangkok | 866 | 23balithaithailandphilippines |
| 24 | apple - iphone - device - apples - ipad | 862 | 24appleiphonedeviceapples |
| 25 | prince - royal - duchess - queen - princess | 827 | 25princeroyalduchessqueen |
| 26 | fire - blaze - firefighter - smoke - flame | 769 | 26fireblazefirefightersmoke |
| 27 | mexico - mexican - cartel - border - drug | 746 | 27mexicomexicancartelborder |
| 28 | food - sugar - diet - calorie - chocolate | 739 | 28foodsugardietcalorie |
| 29 | school - education - pupil - schools - teacher | 725 | 29schooleducationpupilschools |
| 30 | india - delhi - indian - indias - singh | 558 | 30indiadelhiindianindias |
| 31 | facebook - user - app - social - twitter | 537 | 31facebookuserappsocial |
| 32 | album - music - song - bieber - band | 536 | 32albummusicsongbieber |
| 33 | pope - vatican - francis - church - cardinal | 534 | 33popevaticanfrancischurch |
| 34 | name - child - boo - baby - wedding | 525 | 34namechildboobaby |
| 35 | marijuana - smoking - tobacco - drug - cannabis | 520 | 35marijuanasmokingtobaccodrug |
| 36 | sandusky - penn - student - paterno - fraternity | 505 | 36sanduskypennstudentpaterno |
| 37 | internet - computer - hacker - online - user | 490 | 37internetcomputerhackeronline |
| 38 | weight - size - diet - stone - fat | 466 | 38weightsizedietstone |
| 39 | book - novel - author - shades - potter | 398 | 39booknovelauthorshades |
| 40 | japan - japanese - china - nuclear - reactor | 397 | 40japanjapanesechinanuclear |
| 41 | marriage - samesex - gay - state - court | 396 | 41marriagesamesexgaystate |
| 42 | ancient - archaeologist - tomb - roman - site | 384 | 42ancientarchaeologisttombroman |
| 43 | cancer - patient - skin - breast - treatment | 381 | 43cancerpatientskinbreast |
| 44 | mayor - ford - weiner - occupy - blasio | 374 | 44mayorfordweineroccupy |
| 45 | energy - gas - price - fracking - oil | 361 | 45energygaspricefracking |
| 46 | saatchi - madoff - ecclestone - lawson - nigella | 318 | 46saatchimadoffecclestonelawson |
| 47 | abortion - baby - ivf - breastfeeding - woman | 312 | 47abortionbabyivfbreastfeeding |
| 48 | christmas - shopper - shopping - tree - store | 309 | 48christmasshoppershoppingtree |
| 49 | nazi - hitler - jews - camp - auschwitz | 308 | 49nazihitlerjewscamp |
| 50 | climate - ice - warming - change - carbon | 275 | 50climateicewarmingchange |
| 51 | berlusconi - italian - roma - berlusconis - mafia | 263 | 51berlusconiitalianromaberlusconis |
| 52 | rail - train - hs2 - london - passenger | 260 | 52railtrainhs2london |
| 53 | transcript - student - news - todays - cnn | 256 | 53transcriptstudentnewstodays |
| 54 | lottery - ticket - jackpot - winning - powerball | 248 | 54lotteryticketjackpotwinning |
| 55 | abbott - minister - australian - asylum - australia | 239 | 55abbottministeraustralianasylum |
| 56 | fossil - specie - neanderthals - dinosaur - human | 237 | 56fossilspecieneanderthalsdinosaur |
| 57 | kasem - hospital - euthanasia - ashya - kerri | 224 | 57kasemhospitaleuthanasiaashya |
| 58 | hotel - beach - island - resort - city | 223 | 58hotelbeachislandresort |
| 59 | robot - 3d - printer - toy - technology | 214 | 59robot3dprintertoy |
| 60 | jackson - jacksons - aeg - murray - michael | 209 | 60jacksonjacksonsaegmurray |
| 61 | brain - autism - sleep - alzheimers - adhd | 208 | 61brainautismsleepalzheimers |
| 62 | food - meat - product - cull - beef | 204 | 62foodmeatproductcull |
| 63 | game - console - xbox - gaming - playstation | 201 | 63gameconsolexboxgaming |
| 64 | hollande - sarkozy - trierweiler - french - francois | 196 | 64hollandesarkozytrierweilerfrench |
| 65 | alcohol - wine - drinking - beer - drink | 180 | 65alcoholwinedrinkingbeer |
| 66 | woman - childcare - child - benefit - work | 174 | 66womanchildcarechildbenefit |
| 67 | tower - building - 911 - memorial - york | 172 | 67towerbuilding911memorial |
| 68 | epstein - prince - roberts - andrew - sex | 162 | 68epsteinprincerobertsandrew |
| 69 | wars - film - star - movie - hobbit | 152 | 69warsfilmstarmovie |
| 70 | spanish - gibraltar - spain - eta - basque | 143 | 70spanishgibraltarspaineta |
| 71 | jobs - billion - apple - wealth - gates | 139 | 71jobsbillionapplewealth |
| 72 | waste - water - bag - plastic - toilet | 137 | 72wastewaterbagplastic |
| 73 | sotomayor - court - justice - supreme - ginsburg | 131 | 73sotomayorcourtjusticesupreme |
| 74 | falklands - clarkson - argentina - falkland - islands | 130 | 74falklandsclarksonargentinafalkland |
| 75 | miner - mine - factory - garment - bangladesh | 129 | 75minerminefactorygarment |
| 76 | fgm - circumcision - hpv - genital - mutilation | 127 | 76fgmcircumcisionhpvgenital |
| 77 | pollution - allergy - air - smog - pollen | 115 | 77pollutionallergyairsmog |
| 78 | bosnian - mladic - serb - srebrenica - war | 113 | 78bosnianmladicserbsrebrenica |
| 79 | eye - ear - hand - surgery - implant | 100 | 79eyeearhandsurgery |
| 80 | vitamin - statin - caffeine - risk - heart | 98 | 80vitaminstatincaffeinerisk |
| 81 | jeffs - flds - utah - church - polygamy | 95 | 81jeffsfldsutahchurch |
| 82 | travolta - scientology - polanski - church - cruise | 93 | 82travoltascientologypolanskichurch |
| 83 | toyota - recall - gm - vehicle - ignition | 92 | 83toyotarecallgmvehicle |
| 84 | miss - pageant - beauty - competition - universe | 89 | 84misspageantbeautycompetition |
| 85 | kyle - routh - sniper - littlefield - kyles | 85 | 85kylerouthsniperlittlefield |
| 86 | veil - muslim - niqab - ban - burka | 81 | 86veilmuslimniqabban |
| 87 | hair - amish - beard - mullet - moustache | 79 | 87hairamishbeardmullet |
| 88 | cruise - amoeba - norovirus - ill - illness | 78 | 88cruiseamoebanorovirusill |
| 89 | ring - diamond - jewelry - jewellery - heist | 76 | 89ringdiamondjewelryjewellery |
| 90 | corruption - country - population - index - happiness | 76 | 90corruptioncountrypopulationindex |
| 91 | clown - ghost - haunted - exorcism - ghostly | 73 | 91clownghosthauntedexorcism |
| 92 | bobbi - kristina - houston - whitney - gordon | 68 | 92bobbikristinahoustonwhitney |
| 93 | dubai - hajj - pilgrim - mecca - mme | 68 | 93dubaihajjpilgrimmecca |
| 94 | balloon - heene - trappe - falcon - circus | 66 | 94balloonheenetrappefalcon |
| 95 | park - ski - canyon - national - cave | 64 | 95parkskicanyonnational |
| 96 | expedition - pole - antarctic - ice - ship | 64 | 96expeditionpoleantarcticice |
| 97 | hockey - nhl - ice - game - kings | 63 | 97hockeynhlicegame |
| 98 | bull - gored - pamplona - bullfighting - bullfight | 62 | 98bullgoredpamplonabullfighting |
| 99 | king - luther - civil - lincoln - kings | 61 | 99kingluthercivillincoln |
| 100 | bucket - bowl - als - challenge - puppy | 60 | 100bucketbowlalschallenge |
| 101 | tibetan - tibet - dalai - tibetans - lama | 60 | 101tibetantibetdalaitibetans |
| 102 | mushroom - ash - tree - pumpkin - plant | 59 | 102mushroomashtreepumpkin |
| 103 | ballet - filin - bolshoi - dancer - dmitrichenko | 50 | 103balletfilinbolshoidancer |
| 104 | gm - crop - food - plant - genetically | 50 | 104gmcropfoodplant |
| 105 | disney - disneyland - walt - park - frozen | 45 | 105disneydisneylandwaltpark |
| 106 | nuclear - davos - treaty - obama - weapon | 45 | 106nucleardavostreatyobama |
| 107 | bitcoin - currency - coin - bitcoins - note | 43 | 107bitcoincurrencycoinbitcoins |
| 108 | gun - laser - 3d - printer - weapon | 42 | 108gunlaser3dprinter |
| 109 | teeth - dentist - dental - tooth - denture | 40 | 109teethdentistdentaltooth |
| 110 | fragrance - scent - perfume - smell - bottle | 39 | 110fragrancescentperfumesmell |
| 111 | holiday - apd - tax - flight - thanksgiving | 38 | 111holidayapdtaxflight |
| 112 | oldest - age - imich - okawa - birthday | 36 | 112oldestageimichokawa |
| 113 | plate - search - camera - police - database | 36 | 113platesearchcamerapolice |
| 114 | kitty - hello - hong - kong - sanrio | 32 | 114kittyhellohongkong |
| 115 | nobel - prize - peace - award - committee | 31 | 115nobelprizepeaceaward |
| 116 | violin - orchestra - stradivarius - instrument - stradivari | 31 | 116violinorchestrastradivariusinstrument |
| 117 | dna - graphene - cell - genome - synthetic | 30 | 117dnagraphenecellgenome |
| 118 | teresa - giudice - gabor - anhalt - zsa | 29 | 118teresagiudicegaboranhalt |
| 119 | gandolfini - sopranos - gandolfinis - soprano - actor | 27 | 119gandolfinisopranosgandolfinissoprano |
| 120 | turing - bletchley - enigma - turings - code | 26 | 120turingbletchleyenigmaturings |
| 121 | nelson - napoleon - battle - trafalgar - hms | 26 | 121nelsonnapoleonbattletrafalgar |
| 122 | redskins - name - native - snyder - mascot | 25 | 122redskinsnamenativesnyder |
| 123 | marilyn - fawcett - monroe - oneal - farrah | 25 | 123marilynfawcettmonroeoneal |
| 124 | helmet - virtual - oculus - headset - vr | 25 | 124helmetvirtualoculusheadset |
| 125 | eurovision - contest - song - conchita - azerbaijan | 23 | 125eurovisioncontestsongconchita |
| 126 | flag - union - national - flags - st | 21 | 126flagunionnationalflags |
| 127 | clooney - amal - alamuddin - chao - george | 20 | 127clooneyamalalamuddinchao |
| 128 | python - monty - cleese - pythons - idle | 19 | 128pythonmontycleesepythons |
| 129 | accent - dialect - language - cromarty - sound | 19 | 129accentdialectlanguagecromarty |
| 130 | mayan - apocalypse - maya - calendar - end | 18 | 130mayanapocalypsemayacalendar |
| 131 | evolution - creationism - scientific - intelligent - theory | 18 | 131evolutioncreationismscientificintelligent |
| 132 | prabowo - indonesia - jakarta - widodo - jokowi | 17 | 132prabowoindonesiajakartawidodo |
| 133 | favourite - fan - top - yougov - five | 15 | 133favouritefantopyougov |
| 134 | detroit - poverty - city - census - rate | 15 | 134detroitpovertycitycensus |
| 135 | arafat - arafats - polonium - palestinian - polonium210 | 15 | 135arafatarafatspoloniumpalestinian |
| 136 | dmlaterbundle - twittervia - lanza - zann - ilfracombe | 13 | 136dmlaterbundletwittervialanzazann |
| 137 | clock - time - hour - daylight - westworth | 13 | 137clocktimehourdaylight |
| 138 | ikea - furniture - ikeas - kamprad - fsc | 12 | 138ikeafurnitureikeaskamprad |
| 139 | phone - radiation - mobile - cancer - cell | 10 | 139phoneradiationmobilecancer |
| 140 | dangi - guinness - kulkarni - tall - mruga | 9 | 140dangiguinnesskulkarnitall |
| 141 | vick - vicks - nfl - falcons - virginia | 9 | 141vickvicksnflfalcons |
| 142 | bulb - light - leds - paddle - bulbs | 8 | 142bulblightledspaddle |
| 143 | wormhole - photon - teleportation - relativity - warp | 7 | 143wormholephotonteleportationrelativity |
| 144 | bundy - cliven - bundys - cattle - land | 6 | 144bundyclivenbundyscattle |
| 145 | valentines - cuddle - romantic - hess - cuddling | 6 | 145valentinescuddleromantichess |
| 146 | port - cairo - almasry - egypt - ministry | 6 | 146portcairoalmasryegypt |
| 147 | sanford - sanfords - jenny - carolina - mark | 5 | 147sanfordsanfordsjennycarolina |
| 148 | deeds - gus - creigh - virginia - son | 5 | 148deedsguscreighvirginia |
</details>
Training hyperparameters
- —calculate_probabilities: False
- —language: english
- —low_memory: False
- —mintopicsize: 10
- —ngramrange: (1, 1)
- —nr_topics: 150
- —seedtopiclist: None
- —topnwords: 10
- —verbose: False
Framework versions
- —Numpy: 1.23.5
- —HDBSCAN: 0.8.33
- —UMAP: 0.5.3
- —Pandas: 1.5.3
- —Scikit-Learn: 1.2.2
- —Sentence-transformers: 2.2.2
- —Transformers: 4.31.0
- —Numba: 0.57.1
- —Plotly: 5.15.0
- —Python: 3.10.12
