datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
paired-llama-3.2-1b-embeddings-lmsys-chat-1m
Paired Llama 3.2 1B Token Embeddings (LMSYS-Chat-1M)
This dataset contains paired activations corresponding to single token locations extracted from Meta's Llama 3.2 1B Instruct on conversations from LMSYS-Chat-1M.
Embeddings are provided for layers 5 through 14, which capture the most interesting intermediate representations.
This dataset was built to study things like:
Learning different basis for activations at a given layer
Studying if there are cases where position encodes… See the full description on the dataset page: https://huggingface.co/datasets/scaleinvariant/paired-llama-3.2-1b-embeddings-lmsys-chat-1m.sl-multi-embeddings-results-40-llama-selfnewsqa-multi-embeddings-results-40-llama-selfalqa-multi-embeddings-results-40-llama-selfLLAMA_SKILLSPAN_EMBEDDINGS_LLM_RAG_50LLAMA_SKILLSPAN_EMBEDDINGS_LLM_RAG_75_openaiLLAMA_CONLL2003_EMBEDDINGS_LLM_RAG_25_openaiLLAMA_SKILLSPAN_EMBEDDINGS_LLM_RAG_75LLAMA_WNUT_17_EMBEDDINGS_LLM_RAG_25LLAMA_WNUT_17_EMBEDDINGS_LLM_RAG_50LLAMA_WNUT_17_EMBEDDINGS_LLM_RAG_50_openaiLLAMA_CONLL2003_EMBEDDINGS_LLM_RAG_50_openaiLLAMA_CONLL2003_EMBEDDINGS_LLM_RAG_75_openaiLLAMA_SKILLSPAN_EMBEDDINGS_LLM_RAG_25_openaiLLAMA_GUM_EMBEDDINGS_LLM_RAG_75_openaiLLAMA_GUM_EMBEDDINGS_LLM_RAG_50_openaiLLAMA_SKILLSPAN_EMBEDDINGS_LLM_RAG_25LLAMA_WNUT_17_EMBEDDINGS_LLM_RAG_75LLAMA_WNUT_17_EMBEDDINGS_LLM_RAG_25_openaiLLAMA_WNUT_17_EMBEDDINGS_LLM_RAG_75_openaiLLAMA_SKILLSPAN_EMBEDDINGS_LLM_RAG_50_openaiLLAMA_GUM_EMBEDDINGS_LLM_RAG_25_openai