ryanscottbarrett/braille256-v3

Braille256-v3: Grade Infinity Universal Braille Model

A 27.8M parameter language model trained natively on Braille Unicode using SentencePiece Unigram tokenization for superior compression.

Key Features

• —SentencePiece Unigram: Likelihood-optimized tokenization (superior to BPE)
• —4096 Vocabulary: Learned contractions across 7 languages
• —Multilingual: English, French, German, Spanish, Italian, Portuguese, Dutch
• —Cross-Linguistic Patterns: Discovers universal Braille compressions

Learned Contractions

Training Details

Architecture

Hidden Size: 512
Layers: 8
Attention Heads: 8
Max Sequence Length: 1024
Tokenizer: SentencePiece Unigram

Usage

from braille_unigram_model import Braille256UnigramModel, BrailleUnigramTokenizer

model = Braille256UnigramModel.from_pretrained("ryanscottbarrett/braille256-v3")
tokenizer = BrailleUnigramTokenizer.from_pretrained("ryanscottbarrett/braille256-v3/tokenizer")

# Encode Braille text
text = "⠞⠓⠑⠀⠟⠥⠊⠉⠅⠀⠃⠗⠕⠺⠝⠀⠋⠕⠭"
tokens = tokenizer.encode(text)
print(f"Compression: {len(text)}/{len(tokens)} = {len(text)/len(tokens):.2f}x")

Research Goals

This model is part of the Grade Infinity Braille research project:

1. 1.Can neural networks discover universal Braille contractions?
2. 2.Do cross-linguistic patterns emerge from multilingual training?
3. 3.Is SentencePiece Unigram superior to BPE for Braille?

Citation

@misc{braille256v3,
  author = {Ryan Barrett},
  title = {Braille256-v3: Grade Infinity Universal Braille Model},
  year = {2024},
  publisher = {HuggingFace},
  url = {https://huggingface.co/ryanscottbarrett/braille256-v3}
}

License

MIT