CoolFace
Modelpublic

vtava/Qwen35-0.8B-FlyCore-v1-From-v3

sourceHugging Faceupdated 6d agoView on Hugging Face
0likes306downloads
Model Card

Qwen35-0.8B-FlyCore-v1-From-v3

Research artifact from TinyCeNN-LM. Architecture: FlyCore-v1 initialized from trained Qwen3.5 FlyFFN-v3 AllFFN standalone.

Architecture

  • Architecture/run type: FlyCore-v1 initialized from trained Qwen3.5 FlyFFN-v3 AllFFN standalone
  • Base model: Qwen/Qwen3.5-0.8B
  • Dataset: Not recorded
  • Source code: https://github.com/vtavakkoli/TinyCeNN-LM

Latest saved results

MetricValue
num_shards8

The Hugging Face repository keeps timestamped run artifacts under runs/. This preserves training reports, configs and run metadata independently of the temporary Colab filesystem.

Saved experiment files

  • .hf_run_archive/standalone-20260918T221649Z/config.json
  • .hf_run_archive/standalone-20260918T221649Z/flycore_config.json
  • .hf_run_archive/standalone-20260918T221649Z/generation_config.json
  • .hf_run_archive/standalone-20260918T221649Z/report.json
  • .hf_run_archive/standalone-20260918T221649Z/tokenizer_config.json
  • config.json
  • flycore_config.json
  • generation_config.json
  • report.json
  • tokenizer_config.json

Reproducibility

Run the matching notebook from the TinyCeNN-LM repository. Colab notebooks use a Hugging Face write token from the HF_TOKEN Colab Secret; tokens should never be pasted into notebook source.

Limitations

This is a research checkpoint. Metrics saved here are the metrics produced by the corresponding training notebook/script; unless explicitly marked as held-out evaluation, they should not be treated as publication-grade benchmark results. Generation quality can differ substantially from the base model.

Citation

If you use this experimental checkpoint, cite the TinyCeNN-LM repository and the upstream base model.