knowledge-distillation
indoBERT-Knowledge-distillation-en-id-SBERTindoBERT-Knowledge-distillation-en-idknowledge-distillation-2024deprecated-distillbert-tasb-en-id-mmarco-knowledge-distillationknowledge-distillation-weightsgrad-knowledge-distillationdeprecated-distillbert-en-id-mmarco-knowledge-distillationknowledge-distillation
ExperimentDATA_knowledge_distillation_vs_fine_tuningopenthoughts3_math
OpenThoughts3 Math
This dataset contains the math-only, complete-solution subset used for supervised fine-tuning in LLM-Fusion experiments. It was derived from open-thoughts/OpenThoughts3-1.2M.
Dataset summary
103,760 training rows
32,193 unique math questions
Up to four solutions per question, selected deterministically with seed 20260910
All rows have domain = "math" and source = "ai2-adapt-dev/openmath-2-math"
Solutions are retained only when the assistant… See the full description on the dataset page: https://huggingface.co/datasets/knowledge-distillation/openthoughts3_math.han-knowledge-compression-distillation-dataset-v1
Humanoid Knowledge Compression & Embedding Distillation Dataset
This dataset captures knowledge transfer
between high-capacity cognitive nodes
and lightweight humanoid edge agents.
It includes embedding compression,
distillation mappings, and performance delta tracking.
Objective
To enable scalable knowledge sharing
across heterogeneous humanoid agents.
Data Fields
source_model_id
target_agent_id
original_embedding_vector
compressed_embedding_vector… See the full description on the dataset page: https://huggingface.co/datasets/achiepatricia/han-knowledge-compression-distillation-dataset-v1.knowledgedistillation_trainingdeepmath_klear_full