Datasetpublic

ManBib/Discord-Unveiled-Extracted

Discord Unveiled - Filtered Dataset This dataset contains superficially filtered and processed Discord message data from the Discord Unveiled dataset. Data Processing The data has been processed to: Convert JSON data to CSV format. Remove messages from bots. Filter out messages containing only URLs, mentions, channels or discord emojis. Filter out messages that are not in English using a FastText language identification model. Data Fields The CSV… See the full description on the dataset page: https://huggingface.co/datasets/ManBib/Discord-Unveiled-Extracted.

sourceHugging Facemitupdated 1y agoView on Hugging Face

2likes623downloads

Dataset Card

Discord Unveiled - Filtered Dataset

This dataset contains superficially filtered and processed Discord message data from the Discord Unveiled dataset.

Data Processing

The data has been processed to:

—Convert JSON data to CSV format.
—Remove messages from bots.
—Filter out messages containing only URLs, mentions, channels or discord emojis.
—Filter out messages that are not in English using a FastText language identification model.

Data Fields

The CSV files in this dataset contain the following fields:

—timestamp: The timestamp when the message was sent.
—user_id: The ID of the user who sent the message.
—username: The username of the user who sent the message.
—content: The cleaned and filtered message content.

Limitations

—The filtering process is not perfect and some irrelevant or non-English messages are present.