namannn/llama2-7b-hyperboloid-pruned-9-alpaca

Pruned LLaMA Model

This is a pruned version of the LLaMA2-7b model based on hyperboloid method where similarity was calculated based on hyperbolic distance. 9 layers have been pruned. The alpaca dataset was used as calibration data here.