egolimblevskaia/circuitlens-gemma-2-2btranscoder-descriptions-and-evaluations
CircuitLens & WeightLens: Transcoder Descriptions and Evaluations This dataset contains automatically generated descriptions and evaluation metrics for Gemma-2-2B transcoders, produced using CircuitLens and WeightLens methods. Methods CircuitLens: https://github.com/egolimblevskaia/CircuitLens WeightLens: https://github.com/egolimblevskaia/WeightLens Dataset Structure The dataset is organized by layers (0, 4, 7, 10, 12, 15, 18, 21, 23, 25), with… See the full description on the dataset page: https://huggingface.co/datasets/egolimblevskaia/circuitlens-gemma-2-2btranscoder-descriptions-and-evaluations.
CircuitLens & WeightLens: Transcoder Descriptions and Evaluations
This dataset contains automatically generated descriptions and evaluation metrics for Gemma-2-2B transcoders, produced using CircuitLens and WeightLens methods.
Methods
- CircuitLens: https://github.com/egolimblevskaia/CircuitLens
- WeightLens: https://github.com/egolimblevskaia/WeightLens
Dataset Structure
The dataset is organized by layers (0, 4, 7, 10, 12, 15, 18, 21, 23, 25), with each layer containing CSV files for different description methods:
├── layer_0/
│ ├── WeightLens.csv
│ ├── WeightLens_Out.csv
│ ├── WeightLens_Out_LLM.csv
│ ├── CircuitLens-Input.csv
│ ├── CircuitLens-Full.csv
│ ├── CircuitLens-Input_top.csv
│ ├── CircuitLens-Full_top.csv
│ ├── WL_CircuitLens-Full.csv
│ ├── Neuronpedia.csv
│ └── MaxAct.csv
├── layer_4/
│ └── ...
└── ...CSV Columns
Paper
Circuit Insights: Towards Interpretability Beyond Activations
Elena Golimblevskaia, Aakriti Jain, Bruno Puri, Ammar Ibrahim, Wojciech Samek, and Sebastian Lapuschkin
https://arxiv.org/abs/2510.14936
Citation
@article{golimblevskaia2024circuit,
title={Circuit Insights: Towards Interpretability Beyond Activations},
author={Golimblevskaia, Elena and Jain, Aakriti and Puri, Bruno and Ibrahim, Ammar and Samek, Wojciech and Lapuschkin, Sebastian},
journal={arXiv preprint arXiv:2510.14936},
year={2024}
}