Modelpublic

vtava/Tiny-LLM-PDelta3-GDN2-InputRoute

sourceHugging Faceupdated 6d agoView on Hugging Face

0likes

Model Card

Tiny-LLM-PDelta3-GDN2-InputRoute

Research artifact from TinyCeNN-LM. Architecture: TinyCeNN-LM experiment.

Architecture

—Architecture/run type: TinyCeNN-LM experiment
—Base model: arnir0/Tiny-LLM
—Dataset: HuggingFaceFW/fineweb-edu
—Source code: https://github.com/vtavakkoli/TinyCeNN-LM

Latest saved results

Metric	Value
`feature_dim`	96

The Hugging Face repository keeps timestamped run artifacts under runs/. This preserves training reports, configs and run metadata independently of the temporary Colab filesystem.

Saved experiment files

—pdelta3_config.json
—tiny_llm_pdelta3_report.json

Reproducibility

Run the matching notebook from the TinyCeNN-LM repository. Colab notebooks use a Hugging Face write token from the HF_TOKEN Colab Secret; tokens should never be pasted into notebook source.

Limitations

This is a research checkpoint. Metrics saved here are the metrics produced by the corresponding training notebook/script; unless explicitly marked as held-out evaluation, they should not be treated as publication-grade benchmark results. Generation quality can differ substantially from the base model.

Citation

If you use this experimental checkpoint, cite the TinyCeNN-LM repository and the upstream base model.