Modelpublic
KingKazma/cnn_dailymail_108_50000_25000_validation
0likes4downloads
Model Card
tags:
- —bertopic libraryname: bertopic pipelinetag: text-classification ---
cnndailymail1085000025000_validation
This is a BERTopic model. BERTopic is a flexible and modular topic modeling framework that allows for the generation of easily interpretable topics from large datasets.
Usage
To use this model, please install BERTopic:
pip install -U bertopicYou can use the model as follows:
python
from bertopic import BERTopic
topic_model = BERTopic.load("KingKazma/cnn_dailymail_108_50000_25000_validation")
topic_model.get_topic_info()Topic overview
- —Number of topics: 92
- —Number of training documents: 13368
<details> <summary>Click here for an overview of all topics.</summary>
| Topic ID | Topic Keywords | Topic Frequency | Label |
|---|---|---|---|
| -1 | said - police - one - year - also | 5 | -1saidpoliceoneyear |
| 0 | league - game - player - goal - season | 4918 | 0leaguegameplayergoal |
| 1 | isis - syria - islamic - group - iraq | 2700 | 1isissyriaislamicgroup |
| 2 | dog - animal - elephant - bear - cat | 415 | 2doganimalelephantbear |
| 3 | labour - mr - party - election - cameron | 386 | 3labourmrpartyelection |
| 4 | flight - plane - aircraft - pilot - crash | 340 | 4flightplaneaircraftpilot |
| 5 | hair - fashion - dress - look - model | 248 | 5hairfashiondresslook |
| 6 | car - driver - driving - road - police | 227 | 6cardriverdrivingroad |
| 7 | food - cent - sugar - health - per | 221 | 7foodcentsugarhealth |
| 8 | police - officer - shooting - shot - said | 215 | 8policeofficershootingshot |
| 9 | clinton - email - obama - president - state | 213 | 9clintonemailobamapresident |
| 10 | cricket - england - cup - world - zealand | 191 | 10cricketenglandcupworld |
| 11 | property - house - home - room - price | 184 | 11propertyhousehomeroom |
| 12 | fight - pacquiao - mayweather - manny - floyd | 171 | 12fightpacquiaomayweathermanny |
| 13 | hamilton - mercedes - race - prix - rosberg | 135 | 13hamiltonmercedesraceprix |
| 14 | baby - hospital - birth - mother - child | 127 | 14babyhospitalbirthmother |
| 15 | murray - wells - tennis - andy - match | 127 | 15murraywellstennisandy |
| 16 | eclipse - earth - solar - sun - planet | 102 | 16eclipseearthsolarsun |
| 17 | police - abuse - sex - sexual - child | 98 | 17policeabusesexsexual |
| 18 | apple - watch - device - user - google | 96 | 18applewatchdeviceuser |
| 19 | netanyahu - iran - nuclear - israel - israeli | 83 | 19netanyahuirannuclearisrael |
| 20 | putin - russian - nemtsov - moscow - russia | 82 | 20putinrussiannemtsovmoscow |
| 21 | weight - fat - diet - size - stone | 81 | 21weightfatdietsize |
| 22 | race - armstrong - doping - world - tour | 78 | 22racearmstrongdopingworld |
| 23 | court - fraud - money - bank - mr | 76 | 23courtfraudmoneybank |
| 24 | cheltenham - hurdle - horse - race - jockey | 74 | 24cheltenhamhurdlehorserace |
| 25 | mcilroy - round - masters - woods - golf | 72 | 25mcilroyroundmasterswoods |
| 26 | prince - charles - royal - duchess - camilla | 72 | 26princecharlesroyalduchess |
| 27 | fraternity - university - sae - chapter - oklahoma | 68 | 27fraternityuniversitysaechapter |
| 28 | chan - sukumaran - bali - indonesian - mack | 65 | 28chansukumaranbaliindonesian |
| 29 | ebola - sierra - virus - leone - disease | 64 | 29ebolasierravirusleone |
| 30 | school - teacher - student - girl - sexual | 58 | 30schoolteacherstudentgirl |
| 31 | fire - building - explosion - blaze - firefighter | 52 | 31firebuildingexplosionblaze |
| 32 | nfl - borland - football - 49ers - season | 52 | 32nflborlandfootball49ers |
| 33 | clarkson - bbc - gear - top - jeremy | 50 | 33clarksonbbcgeartop |
| 34 | ski - skier - mountain - avalanche - rock | 47 | 34skiskiermountainavalanche |
| 35 | patient - nhs - ae - cancer - hospital | 46 | 35patientnhsaecancer |
| 36 | india - rape - documentary - indian - singh | 45 | 36indiarapedocumentaryindian |
| 37 | mr - death - court - emery - miss | 43 | 37mrdeathcourtemery |
| 38 | show - corden - host - stewart - williams | 42 | 38showcordenhoststewart |
| 39 | car - vehicle - electric - cars - tesla | 40 | 39carvehicleelectriccars |
| 40 | school - child - education - porn - sex | 38 | 40schoolchildeducationporn |
| 41 | boko - haram - nigeria - nigerian - nigerias | 37 | 41bokoharamnigerianigerian |
| 42 | marijuana - drug - cannabis - colorado - lsd | 34 | 42marijuanadrugcannabiscolorado |
| 43 | law - indiana - gay - marriage - religious | 33 | 43lawindianagaymarriage |
| 44 | ferguson - department - police - justice - report | 32 | 44fergusondepartmentpolicejustice |
| 45 | image - photographer - photography - photograph - photo | 31 | 45imagephotographerphotographyphotograph |
| 46 | snow - inch - winter - ice - storm | 30 | 46snowinchwinterice |
| 47 | basketball - ncaa - coach - tournament - game | 30 | 47basketballncaacoachtournament |
| 48 | tsarnaev - boston - dzhokhar - tamerlan - tsarnaevs | 30 | 48tsarnaevbostondzhokhartamerlan |
| 49 | durst - dursts - berman - orleans - robert | 29 | 49durstdurstsbermanorleans |
| 50 | jesus - ancient - stone - cave - circle | 29 | 50jesusancientstonecave |
| 51 | zayn - band - direction - singer - dance | 29 | 51zaynbanddirectionsinger |
| 52 | film - movie - vivian - hollywood - script | 23 | 52filmmovievivianhollywood |
| 53 | korean - korea - kim - north - lippert | 23 | 53koreankoreakimnorth |
| 54 | weather - rain - temperature - snow - today | 23 | 54weatherraintemperaturesnow |
| 55 | robbery - woodger - store - cash - police | 22 | 55robberywoodgerstorecash |
| 56 | parade - patricks - st - irish - green | 21 | 56paradepatricksstirish |
| 57 | secret - clancy - service - agent - white | 20 | 57secretclancyserviceagent |
| 58 | hernandez - lloyd - jenkins - hernandezs - lloyds | 20 | 58hernandezlloydjenkinshernandezs |
| 59 | nazi - anne - nazis - war - camp | 20 | 59naziannenaziswar |
| 60 | snowden - intelligence - gchq - security - agency | 18 | 60snowdenintelligencegchqsecurity |
| 61 | huang - chinese - china - mingxi - chen | 17 | 61huangchinesechinamingxi |
| 62 | wedding - married - marlee - platt - woodyard | 17 | 62weddingmarriedmarleeplatt |
| 63 | drug - cocaine - jailed - cannabis - tobacco | 17 | 63drugcocainejailedcannabis |
| 64 | cnn - transcript - student - news - roll | 17 | 64cnntranscriptstudentnews |
| 65 | pope - francis - vatican - naples - pontiff | 17 | 65popefrancisvaticannaples |
| 66 | richard - iii - leicester - king - iiis | 17 | 66richardiiileicesterking |
| 67 | chinese - tourist - temple - thailand - buddhist | 16 | 67chinesetouristtemplethailand |
| 68 | china - chinese - internet - chai - stopera | 16 | 68chinachineseinternetchai |
| 69 | execution - lethal - gissendaner - injection - drug | 16 | 69executionlethalgissendanerinjection |
| 70 | woman - marriage - men - attractive - chalmers | 15 | 70womanmarriagemenattractive |
| 71 | vanuatu - cyclone - vila - port - pam | 15 | 71vanuatucyclonevilaport |
| 72 | poldark - turner - demelza - aidan - drama | 15 | 72poldarkturnerdemelzaaidan |
| 73 | point - rebound - scored - points - harden | 14 | 73pointreboundscoredpoints |
| 74 | rail - calais - parking - migrant - dickens | 13 | 74railcalaisparkingmigrant |
| 75 | johnson - student - virginia - charlottesville - uva | 13 | 75johnsonstudentvirginiacharlottesville |
| 76 | cuba - havana - cuban - rousseff - us | 13 | 76cubahavanacubanrousseff |
| 77 | paris - attack - synagogue - hebdo - charlie | 13 | 77parisattacksynagoguehebdo |
| 78 | duckenfield - mr - gate - hillsborough - disaster | 12 | 78duckenfieldmrgatehillsborough |
| 79 | gordon - bobbi - kristina - phil - dr | 12 | 79gordonbobbikristinaphil |
| 80 | knox - sollecito - kercher - raffaele - amanda | 12 | 80knoxsollecitokercherraffaele |
| 81 | coin - medal - war - auction - cross | 12 | 81coinmedalwarauction |
| 82 | starbucks - schultz - race - racial - campaign | 12 | 82starbucksschultzraceracial |
| 83 | cosby - cosbys - thompson - bill - welles | 11 | 83cosbycosbysthompsonbill |
| 84 | jeffs - flds - rivette - compound - speer | 10 | 84jeffsfldsrivettecompound |
| 85 | selma - alabama - march - bridge - civil | 8 | 85selmaalabamamarchbridge |
| 86 | jobs - naomi - fortune - redballoon - bn | 8 | 86jobsnaomifortuneredballoon |
| 87 | brain - object - retina - neuron - word | 8 | 87brainobjectretinaneuron |
| 88 | netflix - tv - content - streaming - screen | 8 | 88netflixtvcontentstreaming |
| 89 | social - user - tweet - twitter - tool | 7 | 89socialusertweettwitter |
| 90 | cunard - bird - darshan - ship - liner | 6 | 90cunardbirddarshanship |
</details>
Training hyperparameters
- —calculate_probabilities: True
- —language: english
- —low_memory: False
- —mintopicsize: 10
- —ngramrange: (1, 1)
- —nr_topics: None
- —seedtopiclist: None
- —topnwords: 10
- —verbose: False
Framework versions
- —Numpy: 1.22.4
- —HDBSCAN: 0.8.33
- —UMAP: 0.5.3
- —Pandas: 1.5.3
- —Scikit-Learn: 1.2.2
- —Sentence-transformers: 2.2.2
- —Transformers: 4.31.0
- —Numba: 0.57.1
- —Plotly: 5.13.1
- —Python: 3.10.12
