CoolFace
Datasetpublic

abhisu30/transformer-hackathon-leaderboard

🏆 Transformer Hackathon Leaderboard Build Your Own GPT • Train • Compete • Win! 📊 Current Standings Lower perplexity = better model performance Rank Name Team Perplexity ⬇️ Loss Tokens/sec Timestamp 🥇 Kay sep kay 1.9439 0.6647 67774 2026-02-07 21:29 🥈 Praneeth Solo 1.9832 0.6847 91551 2026-02-07 21:35 🥉 James Faul, Vatsala BA 1.9970 0.6917 149140 2026-02-07 20:18 4 ImageBear Solo 1.9983 0.6923 67189 2026-02-07 20:10 5 Matt O Solo 2.0216… See the full description on the dataset page: https://huggingface.co/datasets/abhisu30/transformer-hackathon-leaderboard.

sourceHugging Faceupdated 8mo agoView on Hugging Face
0likes19downloads
Dataset Card

🏆 Transformer Hackathon Leaderboard

Build Your Own GPT • Train • Compete • Win!

📊 Current Standings

Lower perplexity = better model performance

RankNameTeamPerplexity ⬇️LossTokens/secTimestamp
🥇Kay sepkay1.94390.6647677742026-02-07 21:29
🥈PraneethSolo1.98320.6847915512026-02-07 21:35
🥉James Faul, VatsalaBA1.99700.69171491402026-02-07 20:18
4ImageBearSolo1.99830.6923671892026-02-07 20:10
5Matt OSolo2.02160.7039642862026-02-07 21:05
6weldonSolo2.02800.7070656892026-02-07 21:12
7NickSolo2.02810.7071639512026-02-07 21:38
8MegumiSolo2.03040.7082656142026-02-07 21:40
9Jack G. ConradSolo2.04760.7167664172026-02-07 21:39
10AbhiBlueBird2.04940.717502026-02-07 07:43
11Abhi_1Redbird2.04940.717502026-02-07 07:51
12AllenSolo2.05310.7193654462026-02-07 21:35
13Mark PedigoSolo2.05460.7201655822026-02-07 21:32
14AbhiRed Team2.05710.7213646822026-02-07 21:35
15DSMSolo2.06610.7256637072026-02-07 21:35
16MaheshwariSolo2.06740.7263663152026-02-07 21:08
17DSMSolo2.06930.7272673732026-02-07 19:46
18H100 5min D1024Solo2.18880.7833892962026-02-07 21:00
19H100 5minSolo2.22330.79901436392026-02-07 20:18
20KaraConrads2.34910.8540661742026-02-07 20:57
21Scott MSolo2.91521.0699678902026-02-07 20:23
22MacbookPro 5min 2layerSolo3.43631.2344119402026-02-07 21:09
23MacBookPro 5minSolo4.72251.552340552026-02-07 20:13
24TestUserTestTeam99.99004.500010002026-02-07 08:02
25TestUserTestTeam99.99004.500010002026-02-07 08:03
26HedgehogSolo1337.00002.345718752026-02-07 19:34

🎯 Competition Categories

  • —Best Perplexity: Lowest perplexity score wins! 🏆
  • —Best Efficiency: Highest tokens/second during training ⚡
  • —Most Creative: Best generated text samples 🎨

🚀 How to Participate

bash
# Clone the repository
git clone https://github.com/abhishekadile/Transformer_Repo-
cd Transformer_Repo-

# Install dependencies
pip install -r requirements.txt

# Run the hackathon pipeline
python run_hackathon.py

The script will:

  1. 1.Download the TinyStories dataset
  2. 2.Train your model for 45 minutes
  3. 3.Evaluate performance
  4. 4.Submit to this leaderboard!

📈 Leaderboard Schema

  • —name: Participant name
  • —team: Team name (optional)
  • —perplexity: Model perplexity - lower is better
  • —loss: Final validation cross-entropy loss
  • —tokens_per_sec: Training throughput
  • —timestamp: Submission time

🔧 Optimization Tips

  • —🚀 Enable mixed precision: --use-amp
  • —📦 Increase batch size if GPU allows
  • —📈 Try different learning rates
  • —🧠 Experiment with model size in config.py

📚 Resources

Good luck and have fun! 🎉