llama-embeddings
paired-llama-3.2-1b-embeddings-lmsys-chat-1m
Paired Llama 3.2 1B Token Embeddings (LMSYS-Chat-1M)
This dataset contains paired activations corresponding to single token locations extracted from Meta's Llama 3.2 1B Instruct on conversations from LMSYS-Chat-1M.
Embeddings are provided for layers 5 through 14, which capture the most interesting intermediate representations.
This dataset was built to study things like:
Learning different basis for activations at a given layer
Studying if there are cases where position encodes… See the full description on the dataset page: https://huggingface.co/datasets/scaleinvariant/paired-llama-3.2-1b-embeddings-lmsys-chat-1m.sl-multi-embeddings-results-40-llama-selfnewsqa-multi-embeddings-results-40-llama-selfalqa-multi-embeddings-results-40-llama-selfLLAMA_SKILLSPAN_EMBEDDINGS_LLM_RAG_50LLAMA_SKILLSPAN_EMBEDDINGS_LLM_RAG_75_openai