ernlavr/Alpaca-Llama3.1-KD

Dataset Card for Alpaca-Llama3.1-KD This dataset was introduced in the paper SigmaScale: LLM Compression with SVD-based Low-Rank Decomposition and Learned Scaling Matrices. The official code repository can be found here: ernlavr/SigmaScale. Dataset Summary This dataset is a distilled version of the classic tatsu-lab/alpaca dataset. It utilizes Meta-Llama-3.1-8B-Instruct as an answer generation model to generate high-quality, instruction-following responses for… See the full description on the dataset page: https://huggingface.co/datasets/ernlavr/Alpaca-Llama3.1-KD.