Modelpublic

ridger/SpikeGPT-OpenWebText-216M

sourceHugging Faceapache-2.0updated 3y agoView on Hugging Face

14likes

Model Card

Model Description

SpikeGPT-OpenWebText-216M is a L18-D768 SpikeGPT model trained on OpenWebText. See https://github.com/ridgerchu/SpikeGPT for details.

ctxlen = 1024 nlayer = 18 n_embd = 768