Daankular/twitch-chat
Twitch Chat Messages Each Twitch channel is stored as its own dataset config, with its chat messages under data/<channel>/. Data arrives as small append-only chunk files (data/<channel>/<chunk-id>.jsonl) added on every publish cycle -- existing chunks are immutable and never re-uploaded, so cost per publish only scales with new messages, not the dataset's total size. Sharding chunks into a per-channel directory also keeps any single directory well under the Hub's 10… See the full description on the dataset page: https://huggingface.co/datasets/Daankular/twitch-chat.
Twitch Chat Messages
Each Twitch channel is stored as its own dataset config, with its chat messages under data/<channel>/. Data arrives as small append-only chunk files (data/<channel>/<chunk-id>.jsonl) added on every publish cycle -- existing chunks are immutable and never re-uploaded, so cost per publish only scales with new messages, not the dataset's total size. Sharding chunks into a per-channel directory also keeps any single directory well under the Hub's 10,000-files-per-directory limit. Some channels also have a one-time legacy data/<channel>.jsonl from before this format existed.
Important row fields: raw_message, message_id, user_id, username, text, badges, emotes, tmi_sent_ts, and stream_offset_ms.