Modelpublic
ctam8736/bertopic-20-newsgroups
0likes6downloads
Model Card
tags:
- —bertopic libraryname: bertopic pipelinetag: text-classification ---
bertopic-20-newsgroups
This is a BERTopic model. BERTopic is a flexible and modular topic modeling framework that allows for the generation of easily interpretable topics from large datasets.
Usage
To use this model, please install BERTopic:
pip install -U bertopicYou can use the model as follows:
python
from bertopic import BERTopic
topic_model = BERTopic.load("ctam8736/bertopic-20-newsgroups")
topic_model.get_topic_info()Topic overview
- —Number of topics: 135
- —Number of training documents: 11314
<details> <summary>Click here for an overview of all topics.</summary>
| Topic ID | Topic Keywords | Topic Frequency | Label |
|---|---|---|---|
| -1 | article - information - subject - re - what | 10 | -1articleinformationsubjectre |
| 0 | scsi - scsi2 - scsi1 - drives - bios | 3737 | 0scsiscsi2scsi1drives |
| 1 | nhl - puck - leafs - flyers - pitching | 976 | 1nhlpuckleafsflyers |
| 2 | firearm - firearms - handgun - guns - gun | 918 | 2firearmfirearmshandgunguns |
| 3 | ford - honda - nissan - bmw - dealer | 409 | 3fordhondanissanbmw |
| 4 | encryption - encrypted - crypto - nsa - chip | 387 | 4encryptionencryptedcryptonsa |
| 5 | atheism - atheist - atheists - christianity - belief | 377 | 5atheismatheistatheistschristianity |
| 6 | hezbollah - gaza - lebanon - palestinians - lebanese | 342 | 6hezbollahgazalebanonpalestinians |
| 7 | window - x11r5 - openwindows - x11 - x11r4 | 249 | 7windowx11r5openwindowsx11 |
| 8 | modems - modem - mouse - ports - port | 243 | 8modemsmodemmouseports |
| 9 | anonymity - anonymous - mailing - usenet - newsgroups | 151 | 9anonymityanonymousmailingusenet |
| 10 | armenians - armenia - armenian - azerbaijani - azerbaijan | 147 | 10armeniansarmeniaarmenianazerbaijani |
| 11 | clinton - stephanopoulos - secretary - president - congress | 135 | 11clintonstephanopoulossecretarypresident |
| 12 | os - windows - win32 - microsoft - win31 | 133 | 12oswindowswin32microsoft |
| 13 | diseases - disease - candida - infection - infections | 113 | 13diseasesdiseasecandidainfection |
| 14 | superstition - msg - sensitivity - glutamate - causes | 100 | 14superstitionmsgsensitivityglutamate |
| 15 | laserjet - inkjet - printers - bubblejet - bubblejets | 86 | 15laserjetinkjetprintersbubblejet |
| 16 | billboard - billboards - nasa - space - advertising | 75 | 16billboardbillboardsnasaspace |
| 17 | radar - detectors - detector - detecting - radarjust | 68 | 17radardetectorsdetectordetecting |
| 18 | speeding - speeds - mph - speed - driving | 64 | 18speedingspeedsmphspeed |
| 19 | ssto - moonbase - moon - lunar - billion | 63 | 19sstomoonbasemoonlunar |
| 20 | station - nasa - redesign - space - shuttle | 61 | 20stationnasaredesignspace |
| 21 | eternity - afterlife - heaven - hell - judgement | 49 | 21eternityafterlifeheavenhell |
| 22 | testament - manuscripts - scripture - bible - hebrew | 47 | 22testamentmanuscriptsscripturebible |
| 23 | homosexuality - heterosexual - homosexual - homosexuals - gays | 45 | 23homosexualityheterosexualhomosexualhomosexuals |
| 24 | libertarians - libertarian - libertarianism - regulation - governments | 44 | 24libertarianslibertarianlibertarianismregulation |
| 25 | islamic - muslim - islam - muslims - koran | 44 | 25islamicmuslimislammuslims |
| 26 | tax - taxes - vat - deficits - income | 44 | 26taxtaxesvatdeficits |
| 27 | oil - drain - engine - fuel - dumping | 44 | 27oildrainenginefuel |
| 28 | helmet - helmets - head - protection - gloves | 43 | 28helmethelmetsheadprotection |
| 29 | fonts - font - ttfonts - truetype - printing | 42 | 29fontsfontttfontstruetype |
| 30 | morality - moral - morals - instinctive - immoral | 39 | 30moralitymoralmoralsinstinctive |
| 31 | colormaps - colourmap - colormap - xalloccolor - cwcolormap | 39 | 31colormapscolourmapcolormapxalloccolor |
| 32 | homosexuals - molesters - homosexual - homosexuality - pedophilia | 38 | 32homosexualsmolestershomosexualhomosexuality |
| 33 | migraine - migraines - headache - headaches - analgesics | 37 | 33migrainemigrainesheadacheheadaches |
| 34 | resurrection - gospels - tomb - testament - jesuss | 37 | 34resurrectiongospelstombtestament |
| 35 | graphics - copyright - images - siggraph - image | 37 | 35graphicscopyrightimagessiggraph |
| 36 | mormon - mormons - lds - brigham - utah | 35 | 36mormonmormonsldsbrigham |
| 37 | scientific - scipsychology - scientist - science - methodology | 34 | 37scientificscipsychologyscientistscience |
| 38 | tapes - tape - backup - copy - floppy | 34 | 38tapestapebackupcopy |
| 39 | drugs - marijuana - drug - legalizing - legalization | 34 | 39drugsmarijuanadruglegalizing |
| 40 | punishment - punish - murder - penalty - murderer | 34 | 40punishmentpunishmurderpenalty |
| 41 | sphere - globe - radius - pointstruct - circle | 34 | 41spheregloberadiuspointstruct |
| 42 | surgery - patients - hernia - massager - pain | 33 | 42surgerypatientsherniamassager |
| 43 | genocide - bosnia - atheism - serbs - christians | 32 | 43genocidebosniaatheismserbs |
| 44 | insurance - liability - insureyear - deductible - accident | 32 | 44insuranceliabilityinsureyeardeductible |
| 45 | polygon - polygons - triangulation - hexagons - polyn | 30 | 45polygonpolygonstriangulationhexagons |
| 46 | spacecraft - galileo - galileos - mission - magellan | 29 | 46spacecraftgalileogalileosmission |
| 47 | countersteering - countersteeringfaq - countersteer - riding - bikes | 29 | 47countersteeringcountersteeringfaqcountersteerriding |
| 48 | antenna - antennas - transmitters - transmitting - radios | 28 | 48antennaantennastransmitterstransmitting |
| 49 | canine - dogs - dog - spaniel - springer | 28 | 49caninedogsdogspaniel |
| 50 | batteries - battery - electrolyte - galvanized - zinc | 28 | 50batteriesbatteryelectrolytegalvanized |
| 51 | oscilloscope - scopes - scope - oscilliscopes - digital | 27 | 51oscilloscopescopesscopeoscilliscopes |
| 52 | xgrabkey - definekeys - accelerators - accelerator - shiftkeyq | 27 | 52xgrabkeydefinekeysacceleratorsaccelerator |
| 53 | protoncentaur - centaur - proton - accelerator - nuclear | 27 | 53protoncentaurcentaurprotonaccelerator |
| 54 | telephone - dial - phone - call - lines | 26 | 54telephonedialphonecall |
| 55 | marriages - wedding - vows - weddings - marriage | 25 | 55marriagesweddingvowsweddings |
| 56 | ibm - levels - level - nasa - software | 25 | 56ibmlevelslevelnasa |
| 57 | nasa - aerospace - astronomy - spacecraft - astronomical | 24 | 57nasaaerospaceastronomyspacecraft |
| 58 | motif - neosoft - unix - platforms - software | 24 | 58motifneosoftunixplatforms |
| 59 | nuclear - cooling - reactor - tower - towers | 23 | 59nuclearcoolingreactortower |
| 60 | injuries - struck - snot - rocks - warningplease | 23 | 60injuriesstrucksnotrocks |
| 61 | transmissions - shifter - automatics - autos - auto | 22 | 61transmissionsshifterautomaticsautos |
| 62 | lzr1260 - printing - mwt9caxaxaxaxaxaxaxaxaxaxaxaxax - m9l0qaxaxaxaxaxaxaxaxaxaxaxaxaxax - mi68qaxaxaxaxaxaxaxaxaxaxaxaxaxax | 22 | 62lzr1260printingmwt9caxaxaxaxaxaxaxaxaxaxaxaxaxm9l0qaxaxaxaxaxaxaxaxaxaxaxaxaxax |
| 63 | cview - files - directory - file - tmp | 21 | 63cviewfilesdirectoryfile |
| 64 | immaculate - mary - marys - conception - catholics | 21 | 64immaculatemarymarysconception |
| 65 | cryptology - cryptanalyst - crypt - cryptanalysis - ciphers | 20 | 65cryptologycryptanalystcryptcryptanalysis |
| 66 | hotelco - hotels - resorts - hotel - tickets | 20 | 66hotelcohotelsresortshotel |
| 67 | 3dos - 3do - 3ds - 3d - 3dstudio | 20 | 673dos3do3ds3d |
| 68 | comet - comets - jupiter - asteroids - jovian | 20 | 68cometcometsjupiterasteroids |
| 69 | polishing - scratches - paint - rubbing - glaze | 20 | 69polishingscratchespaintrubbing |
| 70 | newsgroup - groups - groupsplit - group - split | 20 | 70newsgroupgroupsgroupsplitgroup |
| 71 | koresh - koreshs - david - sermon - biblical | 20 | 71koreshkoreshsdavidsermon |
| 72 | parking - parked - liability - unsafe - stickers | 20 | 72parkingparkedliabilityunsafe |
| 73 | trumpet - tcp - windows - winqvtnet - winsock | 19 | 73trumpettcpwindowswinqvtnet |
| 74 | freon - heater - coolant - r12 - vents | 19 | 74freonheatercoolantr12 |
| 75 | sabbath - commandments - sunday - worship - church | 19 | 75sabbathcommandmentssundayworship |
| 76 | geekdom - computer - fourdcom - csws18icsunysbedu - psychnet | 19 | 76geekdomcomputerfourdcomcsws18icsunysbedu |
| 77 | bosnia - serbs - sanctions - somalia - war | 18 | 77bosniaserbssanctionssomalia |
| 78 | soundblaster - midi - midimapper - soundexe - wavfiles | 18 | 78soundblastermidimidimappersoundexe |
| 79 | condo - remodeled - townhome - bedroom - rent | 18 | 79condoremodeledtownhomebedroom |
| 80 | odometers - odometer - sensor - mileage - sensors | 18 | 80odometersodometersensormileage |
| 81 | joystick - joysticks - joyport - joyread - hardware | 17 | 81joystickjoysticksjoyportjoyread |
| 82 | abortion - abortions - roe - proabortion - fetus | 17 | 82abortionabortionsroeproabortion |
| 83 | seizures - seizure - allergies - corn - cereal | 17 | 83seizuresseizureallergiescorn |
| 84 | sobriety - sober - drinking - drink - drinks | 17 | 84sobrietysoberdrinkingdrink |
| 85 | nubus - lciiipowerpc - pds - powerpcs - powerpc | 17 | 85nubuslciiipowerpcpdspowerpcs |
| 86 | mining - miners - minerals - miner - mineral | 17 | 86miningminersmineralsminer |
| 87 | outlets - outlet - electrical - wiring - grounded | 16 | 87outletsoutletelectricalwiring |
| 88 | rosicrucianum - rosicrucian - orders - order - organization | 16 | 88rosicrucianumrosicrucianordersorder |
| 89 | tempest - shielding - surveillance - encryption - electromagnetic | 16 | 89tempestshieldingsurveillanceencryption |
| 90 | monitor - monitors - screen - scrolling - display | 16 | 90monitormonitorsscreenscrolling |
| 91 | krillean - photographs - photography - kirlian - pictures | 16 | 91krilleanphotographsphotographykirlian |
| 92 | scanner - scanners - scanning - scans - scanman | 16 | 92scannerscannersscanningscans |
| 93 | sexism - sexist - extramarital - islamic - marriage | 16 | 93sexismsexistextramaritalislamic |
| 94 | noisy - noise - noises - rattled - quiets | 16 | 94noisynoisenoisesrattled |
| 95 | orion - astronomy - museum - prototype - space | 15 | 95orionastronomymuseumprototype |
| 96 | easter - pagan - celebrating - feast - celebration | 15 | 96easterpagancelebratingfeast |
| 97 | batf - assault - waco - blasting - blast | 15 | 97batfassaultwacoblasting |
| 98 | batchfile - ini - updating - file - winfileini | 15 | 98batchfileiniupdatingfile |
| 99 | copyprotect - copying - protected - copy - protection | 15 | 99copyprotectcopyingprotectedcopy |
| 100 | 42 - tiff - tiff6 - significance - universe | 14 | 10042tifftiff6significance |
| 101 | stove - stoves - splitfires - splitfire - burns | 14 | 101stovestovessplitfiressplitfire |
| 102 | automotive - backing - lights - corvette - reverse | 14 | 102automotivebackinglightscorvette |
| 103 | dock - docks - minidocks - portable - minidock | 14 | 103dockdocksminidocksportable |
| 104 | cdaudio - stereo - audio - soundbase - speakers | 14 | 104cdaudiostereoaudiosoundbase |
| 105 | uv - flashlight - houselights - fluorescent - lamps | 14 | 105uvflashlighthouselightsfluorescent |
| 106 | papal - papacy - pope - popes - schism | 14 | 106papalpapacypopepopes |
| 107 | scsi - quadra - quadras - quadraspecific - firmware | 14 | 107scsiquadraquadrasquadraspecific |
| 108 | crohns - colitis - dietary - gastroenterology - diet | 13 | 108crohnscolitisdietarygastroenterology |
| 109 | crashes - powerbook - plugged - corrupted - duos | 13 | 109crashespowerbookpluggedcorrupted |
| 110 | eyedness - handedness - righteye - righthandedness - eyes | 13 | 110eyednesshandednessrighteyerighthandedness |
| 111 | wrench - pliers - tool - tools - srb | 13 | 111wrenchplierstooltools |
| 112 | scripture - scriptures - prophecy - revelation - revelations | 13 | 112scripturescripturesprophecyrevelation |
| 113 | nikon - lens - lenses - olympus - 35mm | 13 | 113nikonlenslensesolympus |
| 114 | prosecution - suspects - encrypted - defendant - incriminate | 13 | 114prosecutionsuspectsencrypteddefendant |
| 115 | wheel - shaftdrives - wheelies - wheelie - shaftdrive | 12 | 115wheelshaftdriveswheelieswheelie |
| 116 | obesity - rebound - dieting - diet - metabolism | 12 | 116obesityrebounddietingdiet |
| 117 | adl - adls - spying - fbi - investigation | 12 | 117adladlsspyingfbi |
| 118 | lunar - moon - exploration - attend - conference | 12 | 118lunarmoonexplorationattend |
| 119 | draftees - draft - selective - military - abolished | 12 | 119drafteesdraftselectivemilitary |
| 120 | sunrise - sunset - daylight - algorithm - astronomical | 12 | 120sunrisesunsetdaylightalgorithm |
| 121 | octopus - octopuses - octopi - squid - octapus | 12 | 121octopusoctopusesoctopisquid |
| 122 | gassing - explosion - gas - explode - explosive | 11 | 122gassingexplosiongasexplode |
| 123 | tutorial - handbook - chemistry - paperback - books | 11 | 123tutorialhandbookchemistrypaperback |
| 124 | amp - decibels - current - ampere - db | 11 | 124ampdecibelscurrentampere |
| 125 | uniforms - jerseys - uniform - mets - reds | 11 | 125uniformsjerseysuniformmets |
| 126 | eugenics - eugenic - geneticallyengineered - genetic - genetically | 11 | 126eugenicseugenicgeneticallyengineeredgenetic |
| 127 | fractals - fractal - fractally - compression - pascalfractals | 11 | 127fractalsfractalfractallycompression |
| 128 | sunview - xputimage - pixmap - pixmaps - ximage | 11 | 128sunviewxputimagepixmappixmaps |
| 129 | waving - wave - waves - bikers - bikes | 11 | 129wavingwavewavesbikers |
| 130 | vocoder - compressionalgorithms - compression - modems - cryptophones | 11 | 130vocodercompressionalgorithmscompressionmodems |
| 131 | mouse - jumpiness - mousecom - mouseits - jumps | 11 | 131mousejumpinessmousecommouseits |
| 132 | netware - lan - workgroup - workgroups - w4wg | 10 | 132netwarelanworkgroupworkgroups |
| 133 | timers - timer - ultralong - clock - oscillator | 10 | 133timerstimerultralongclock |
</details>
Training hyperparameters
- —calculate_probabilities: False
- —language: english
- —low_memory: False
- —mintopicsize: 10
- —ngramrange: (1, 1)
- —nr_topics: auto
- —seedtopiclist: None
- —topnwords: 10
- —verbose: True
- —zeroshotminsimilarity: 0.7
- —zeroshottopiclist: None
Framework versions
- —Numpy: 1.23.5
- —HDBSCAN: 0.8.33
- —UMAP: 0.5.5
- —Pandas: 2.2.1
- —Scikit-Learn: 1.3.1
- —Sentence-transformers: 2.5.1
- —Transformers: 4.37.0.dev0
- —Numba: 0.59.1
- —Plotly: 5.20.0
- —Python: 3.10.4
