CoolFace
Datasetpublic

yourbench-testing/test-unicode

Test Unicode This dataset was generated using YourBench (v0.6.0), an open-source framework for generating domain-specific benchmarks from document collections. Pipeline Steps ingestion: Read raw source documents, convert them to normalized markdown and save for downstream steps Reproducibility To reproduce this dataset, use YourBench v0.6.0 with the following configuration: hf_configuration: hf_dataset_name: test-unicode hf_organization:… See the full description on the dataset page: https://huggingface.co/datasets/yourbench-testing/test-unicode.

sourceHugging Faceupdated 10mo agoView on Hugging Face
0likes3downloads
Dataset Card

<img src="https://raw.githubusercontent.com/huggingface/yourbench/main/docs/assets/yourbench-badge-web.png" alt="Built with YourBench" width="200" height="32" />

Test Unicode

This dataset was generated using YourBench (v0.6.0), an open-source framework for generating domain-specific benchmarks from document collections.

Pipeline Steps

  • —ingestion: Read raw source documents, convert them to normalized markdown and save for downstream steps

Reproducibility

To reproduce this dataset, use YourBench v0.6.0 with the following configuration:

yaml
hf_configuration:
  hf_dataset_name: test-unicode
  hf_organization: $HF_ORGANISATION
  push_to_hub: true
pipeline:
  ingestion:
    source_documents_dir: test_unicode_fix
    output_dir: test_unicode_fix/output
    supported_file_extensions:
    - .txt

(This dataset card was automatically generated by YourBench)