Apppublic

HuggingFaceBio/carbon-tokenization-01-prefix-ambiguity

sourceHugging Faceupdated 4mo agoView on Hugging Face

1likes

App README

Prefix ambiguity, in a vocabulary that holds five plausible next tokens

Standalone widget from the Carbon tokenization article. Embed via:

html

<iframe src="https://huggingfacebio-carbon-tokenization-01-prefix-ambiguity.hf.space" loading="lazy"></iframe>

Generated from `blog-preview.html` by widgets/_extract.py — edit the source there, not here.