CoolFace
Datasetpublic

Linkhero2/bertopic-conflictos-chile-v18-pure

🏆 BERTopic v18 - "The Pure" Hypothesis Entity fusions created artificial high-frequency tokens that dominated n-grams, causing redundancy. Changes from v17: REMOVED all entity fusions (text is now natural) RESTORED ngram_range=(1, 4) to capture full phrases PartOfSpeech + MMR(0.8) representation chain top_n_words=7 Expected Result: Keywords like "tribunal ambiental antofagasta" instead of "tribunalambiental antofagasta"… See the full description on the dataset page: https://huggingface.co/datasets/Linkhero2/bertopic-conflictos-chile-v18-pure.

sourceHugging Faceupdated 9mo agoView on Hugging Face
0likes21downloads
Dataset Card

🏆 BERTopic v18 - "The Pure"

Hypothesis

Entity fusions created artificial high-frequency tokens that dominated n-grams, causing redundancy.

Changes from v17:

  1. 1.REMOVED all entity fusions (text is now natural)
  2. 2.RESTORED ngram_range=(1, 4) to capture full phrases
  3. 3.PartOfSpeech + MMR(0.8) representation chain
  4. 4.topnwords=7

Expected Result:

Keywords like "tribunal ambiental antofagasta" instead of "tribunalambiental antofagasta"

Results:

  • —K Natural: 51 topics
  • —Total docs: 3,268