mini-llm
Datasets
All datasets matching “mini-llm”CDB_DEC2024-CochranSampled_MiniLLMV2_Emb
CrediBench Web Content Embeddings (December 2024)
This repository contains MiniLLM_MultiLingual_V2 embeddings for the CrediBench WebContent (December 2024) dataset.
Source dataset:https://huggingface.co/datasets/Hussein-Abdallah/CrediBench-WebContent-Dec2024_CochranSampled
Overview
The source dataset is a Cochran-sampled subset of the December 2024 CrediBench WebContent corpus. Documents are sampled independently for each web domain using Cochran's sampling… See the full description on the dataset page: https://huggingface.co/datasets/credi-net/CDB_DEC2024-CochranSampled_MiniLLMV2_Emb.pile-diff_samp-qwen_1.8B-qwen_104M-r0.5This repository contains the refined pre-training corpus from the paper MiniPLM: Knowledge Distillation for Pre-Training Language Models.
Code: https://github.com/thu-coai/MiniPLM
sinst
sinst dataset
Original version: Super-Natural-Instructions
This dataset is used to evaluate MiniLLM.
dolly
Dolly Dataset
Original version: aisquared/databricks-dolly-15k.
This dataset is used to train MiniLLM.
dolly-processeduinst
uinst dataset
Original version: Unnatural-Instructions
This dataset is used to evaluate MiniLLM