yujiepan/starcoder-tiny-random

yujiepan/starcoder-tiny-random

This model is randomly initialized, using the config from bigcode/starcoderbase-7b but with the following modifications:

{
  "n_embd": 32,
  "n_head": 8,
  "n_inner": 128,
  "n_layer": 1,
}