Apppublic

HuggingFaceBio/carbon-tokenization-02-tokenizers-compared

sourceHugging Faceupdated 4mo agoView on Hugging Face

1likes

App README

Per-base, BPE, and 6-mer on the same DNA sequence

Standalone widget from the Carbon tokenization article. Embed via:

html

<iframe src="https://huggingfacebio-carbon-tokenization-02-tokenizers-compared.hf.space" loading="lazy"></iframe>

Generated from `blog-preview.html` by widgets/_extract.py — edit the source there, not here.