tengomucho/english_quotes_sanitized
This dataset is the same as Abirate/english_quotes, but I sanitized the author and sanitized the text to avoid weird characters. from ftfy import fix_encoding from datasets import load_dataset def correct_encoding(examples): quote = examples["quote"] author = examples["author"] # remove trailing comma from authors and fix encoding author = author.rstrip(",") author = fix_encoding(author) examples["author"] = author # fix encoding quote = fix_encoding(quote)… See the full description on the dataset page: https://huggingface.co/datasets/tengomucho/english_quotes_sanitized.
This repository belongs to tengomucho on Hugging Face.
CoolFace never edits a repository it does not host. Visibility, licence, collaborators and gating are all managed at the source.
