mwhanna/gemma-scope-transcoders

This is a re-upload of the GemmaScope transcoders originally released here. They have been converted to .safetensors format for convenient use with circuit-tracer—this format loads significantly faster, and can easily be offloaded onto disk. If you would like to use the original transcoders with circuit-tracer, you can use this repo, which points to the original transcoders.

transcoders:

• —"hf://google/gemma-scope-2b-pt-transcoders/layer0/width16k/averagel076/params.npz"
• —"hf://google/gemma-scope-2b-pt-transcoders/layer1/width16k/averagel065/params.npz"
• —"hf://google/gemma-scope-2b-pt-transcoders/layer2/width16k/averagel049/params.npz"
• —"hf://google/gemma-scope-2b-pt-transcoders/layer3/width16k/averagel054/params.npz"
• —"hf://google/gemma-scope-2b-pt-transcoders/layer4/width16k/averagel088/params.npz"
• —"hf://google/gemma-scope-2b-pt-transcoders/layer5/width16k/averagel087/params.npz"
• —"hf://google/gemma-scope-2b-pt-transcoders/layer6/width16k/averagel095/params.npz"
• —"hf://google/gemma-scope-2b-pt-transcoders/layer7/width16k/averagel070/params.npz"
• —"hf://google/gemma-scope-2b-pt-transcoders/layer8/width16k/averagel052/params.npz"
• —"hf://google/gemma-scope-2b-pt-transcoders/layer9/width16k/averagel072/params.npz"
• —"hf://google/gemma-scope-2b-pt-transcoders/layer10/width16k/averagel088/params.npz"
• —"hf://google/gemma-scope-2b-pt-transcoders/layer11/width16k/averagel05/params.npz"
• —"hf://google/gemma-scope-2b-pt-transcoders/layer12/width16k/averagel06/params.npz"
• —"hf://google/gemma-scope-2b-pt-transcoders/layer13/width16k/averagel08/params.npz"
• —"hf://google/gemma-scope-2b-pt-transcoders/layer14/width16k/averagel08/params.npz"
• —"hf://google/gemma-scope-2b-pt-transcoders/layer15/width16k/averagel08/params.npz"
• —"hf://google/gemma-scope-2b-pt-transcoders/layer16/width16k/averagel010/params.npz"
• —"hf://google/gemma-scope-2b-pt-transcoders/layer17/width16k/averagel012/params.npz"
• —"hf://google/gemma-scope-2b-pt-transcoders/layer18/width16k/averagel013/params.npz"
• —"hf://google/gemma-scope-2b-pt-transcoders/layer19/width16k/averagel012/params.npz"
• —"hf://google/gemma-scope-2b-pt-transcoders/layer20/width16k/averagel011/params.npz"
• —"hf://google/gemma-scope-2b-pt-transcoders/layer21/width16k/averagel013/params.npz"
• —"hf://google/gemma-scope-2b-pt-transcoders/layer22/width16k/averagel015/params.npz"
• —"hf://google/gemma-scope-2b-pt-transcoders/layer23/width16k/averagel025/params.npz"
• —"hf://google/gemma-scope-2b-pt-transcoders/layer24/width16k/averagel037/params.npz"
• —"hf://google/gemma-scope-2b-pt-transcoders/layer25/width16k/averagel041/params.npz"