Modelpublic

JanTempus/cross-over-climbmix400b-s7-tokenizers

sourceHugging Faceotherupdated 4mo agoView on Hugging Face

1likes

Model Card

Rounded LP Tokenizers

This repository contains rounded tokenizer artifacts from cross_over_climbmix400b_s7.

Each tokenizer directory contains:

—tokenizer.json
—tokenizer_config.json

Included Tokenizers

—vocab_131072/lp_131072_all_ones
—vocab_131072/lp_131072_bias
—vocab_131072/lp_131072_det
—vocab_16384/lp_16384_all_ones
—vocab_16384/lp_16384_bias
—vocab_16384/lp_16384_det
—vocab_262144/lp_262144_all_ones
—vocab_262144/lp_262144_bias
—vocab_262144/lp_262144_det
—vocab_32768/lp_32768_all_ones
—vocab_32768/lp_32768_bias
—vocab_32768/lp_32768_det
—vocab_65536/lp_65536_all_ones
—vocab_65536/lp_65536_bias
—vocab_65536/lp_65536_det
—vocab_8192/lp_8192_all_ones
—vocab_8192/lp_8192_bias
—vocab_8192/lp_8192_det