CoolFace
Modelpublic

KingKazma/xsum_6789_5000000_2500000_v1_50topics_train

sourceHugging Faceupdated 3y agoView on Hugging Face
0likes5downloads
Model Card

tags:

  • —bertopic libraryname: bertopic pipelinetag: text-classification ---

xsum678950000002500000v150topicstrain

This is a BERTopic model. BERTopic is a flexible and modular topic modeling framework that allows for the generation of easily interpretable topics from large datasets.

Usage

To use this model, please install BERTopic:

pip install -U bertopic

You can use the model as follows:

python
from bertopic import BERTopic
topic_model = BERTopic.load("KingKazma/xsum_6789_5000000_2500000_v1_50topics_train")

topic_model.get_topic_info()

Topic overview

  • —Number of topics: 50
  • —Number of training documents: 204045

<details> <summary>Click here for an overview of all topics.</summary>

Topic IDTopic KeywordsTopic FrequencyLabel
-1said - mr - would - one - year6-1saidmrwouldone
0win - game - half - second - right1209340wingamehalfsecond
1said - would - labour - eu - party189171saidwouldlaboureu
2said - police - mr - court - would142692saidpolicemrcourt
3mr - president - said - government - us128713mrpresidentsaidgovernment
4bank - company - sale - said - year93444bankcompanysalesaid
5fire - said - flood - people - water29125firesaidfloodpeople
6airport - flight - space - plane - aircraft26426airportflightspaceplane
7trump - mr - us - clinton - said26017trumpmrusclinton
8energy - oil - rate - growth - price23018energyoilrategrowth
9sea - water - ship - said - coastguard21839seawatershipsaid
10dog - animal - bird - said - zoo189910doganimalbirdsaid
11president - fifa - mr - government - cuba170711presidentfifamrgovernment
12film - bbc - actor - star - show166512filmbbcactorstar
13drug - alcohol - smoking - pollution - health134013drugalcoholsmokingpollution
14music - album - song - band - chart119314musicalbumsongband
15virus - ebola - health - infection - vaccine82715virusebolahealthinfection
16yn - ar - wedi - ei - bod76516ynarwediei
17robot - car - research - technology - science56017robotcarresearchtechnology
18india - indian - delhi - indias - modi46918indiaindiandelhiindias
19found - museum - site - fossil - roman43119foundmuseumsitefossil
20church - bishop - pope - vatican - cardinal42920churchbishoppopevatican
21australia - australian - mr - nauru - prime38121australiaaustralianmrnauru
22unsupported - updated - playback - device - media34222unsupportedupdatedplaybackdevice
23prince - royal - queen - duchess - duke29323princeroyalqueenduchess
24marriage - gay - law - samesex - transgender26624marriagegaylawsamesex
25updated - bst - gmt - last - 201723525updatedbstgmtlast
26food - product - meat - horsemeat - cheese23226foodproductmeathorsemeat
27woman - fashion - dress - women - wear20927womanfashiondresswomen
28book - novel - author - prize - writer20228booknovelauthorprize
29mountain - avalanche - climber - everest - snow20129mountainavalancheclimbereverest
30trident - defence - submarine - nuclear - army18030tridentdefencesubmarinenuclear
31christmas - bell - cake - poppy - minster15231christmasbellcakepoppy
32cosby - clown - constand - mr - cosbys14432cosbyclownconstandmr
33water - utilities - customer - company - said12533waterutilitiescustomercompany
34sleep - suicide - life - people - health11834sleepsuicidelifepeople
35flag - confederate - white - university - statue11535flagconfederatewhiteuniversity
36nba - warriors - lakers - cavaliers - game10936nbawarriorslakerscavaliers
37picture - scotlandpicturesbbccouk - bbcscotlandpics - photo - selection9837picturescotlandpicturesbbccoukbbcscotlandpicsphoto
38flag - emojis - deaf - emoji - language8938flagemojisdeafemoji
39ring - diamond - jewellery - carat - jewel6539ringdiamondjewellerycarat
40pokemon - game - go - ai - player4940pokemongamegoai
41takata - airbags - recall - honda - airbag3741takataairbagsrecallhonda
42follow - - - -3542follow__
43depp - joyce - dog - boo - pistol2943deppjoycedogboo
44leaguebyleague - list - managerial - below - appear2644leaguebyleaguelistmanagerialbelow
45name - top - girls - boys - boy1745nametopgirlsboys
46film - potter - scotland - beasts - grindelwald1546filmpotterscotlandbeasts
47balcony - irish - berkeley - student - donohoe1047balconyirishberkeleystudent
48flower - garden - flowered - botanic - arum648flowergardenfloweredbotanic

</details>

Training hyperparameters

  • —calculate_probabilities: True
  • —language: english
  • —low_memory: False
  • —mintopicsize: 10
  • —ngramrange: (1, 1)
  • —nr_topics: 50
  • —seedtopiclist: None
  • —topnwords: 10
  • —verbose: False

Framework versions

  • —Numpy: 1.23.5
  • —HDBSCAN: 0.8.33
  • —UMAP: 0.5.3
  • —Pandas: 1.5.3
  • —Scikit-Learn: 1.2.2
  • —Sentence-transformers: 2.2.2
  • —Transformers: 4.31.0
  • —Numba: 0.57.1
  • —Plotly: 5.15.0
  • —Python: 3.10.12