CoolFace
Apppublic

fourlhs/nano-gpt-z

sourceHugging Faceupdated 7mo agoView on Hugging Face
0likes
45 commits on main
a8923827mo ago

fix: handle missing checkpoint gracefully, remove timeout param

Nikos Fourlis
d01757b7mo ago

refactor: replace Gradio with Flask for better reliability

Nikos Fourlis
34a26337mo ago

debug: add logging to generate function

Nikos Fourlis
c25d9fa7mo ago

fix: dont skip sentence if only one sentence generated

Nikos Fourlis
009b77a7mo ago

fix: cast slider parameters to correct types (int/float)

Nikos Fourlis
120f1e57mo ago

feat: auto-download checkpoint from GitHub release

Nikos Fourlis
1a3a8ed7mo ago

fix: improve checkpoint not found error message

Nikos Fourlis
0732f147mo ago

debug: add detailed logging for checkpoint path discovery

Nikos Fourlis
45c46d87mo ago

docs: add HF Spaces README with configuration

Nikos Fourlis
b5189837mo ago

fix: make checkpoint path flexible to support multiple locations

Nikos Fourlis
c0003b77mo ago

fix: update Dockerfile to expect checkpoint in root

Nikos Fourlis
0f16e0e7mo ago

chore: add HuggingFace Spaces deployment (Dockerfile, .dockerignore)

Nikos Fourlis
4b80dcf7mo ago

Merge remote changes

Nikos Fourlis
b5f5a637mo ago

fix: fix export func bug in export.py

fourlhs
c9b01447mo ago

fix: fix naming bug in export.py

fourlhs
d83ff7f7mo ago

fix: fix loading base bug in evaluate.py

fourlhs
d9c87687mo ago

typo

fourlhs
2acf4e97mo ago

fix: fix loading base model bug in finetune.py

fourlhs
887078c7mo ago

fix(generation): fix top_p mask bug

fourlhs
416af8a7mo ago

new params for a new train

fourlhs
ec63e9d7mo ago

update comments

fourlhs
7c53e9a7mo ago

update load_checkpoint in train.py

fourlhs
546baeb7mo ago

update load_checkpoint in train.py

fourlhs
5b48e5b7mo ago

add torch.compile

fourlhs
3b84cc07mo ago

start over

fourlhs
830992b7mo ago

comment out torch.compile to find out whether thats why loss isnt decreasing

fourlhs
f11786f7mo ago

upd params on train.py

fourlhs
21151d07mo ago

upd params on train.py

fourlhs
49f65dc7mo ago

upd lr and min_lr

fourlhs
b3efc7e7mo ago

changed warmup_steps

fourlhs
537c6217mo ago

changed batch_size in train.py

fourlhs
84b33f37mo ago

fix: remove GradScaler from train.py and change params

fourlhs
644151e7mo ago

fix: adjust eval_interval and add token assertion

Nikos Fourlis
8c1eeb37mo ago

feat: increase pretraining tokens to 1B

Nikos Fourlis
30783b87mo ago

feat: add bfloat16 mixed precision and torch.compile

Nikos Fourlis
4db763d7mo ago

refactor: use F.scaled_dot_product_attention for optimized attention

Nikos Fourlis
1af71b37mo ago

feat: add env variables and fix comments

Nikos Fourlis
83563827mo ago

feat: add build.sh

Nikos Fourlis
0535b957mo ago

feat: update training pipeline, quantised WASM inference, and data prep. fix minor bugs.

Nikos Fourlis
deae9777mo ago

feat: implement cpp inference architecture

Nikos Fourlis
e82a7407mo ago

add evaluation pipeline (perplexity + style shift)

Nikos Fourlis
69528837mo ago

feat: implement finetuning loop

Nikos Fourlis
04a801b7mo ago

add data pipeline: FineWeb-Edu pretraining + Gen Z finetuning + WikiText-103 coherence test

Nikos Fourlis
767a45e7mo ago

feat: add training loop

Nikos Fourlis
6fe0f147mo ago

initial commit: prepare folder structure and implement model.py

Nikos Fourlis