ArcOffical/PiCo-dataset-general-7b
PiCo-7B Instruction Dataset A high-quality, high-variability instruction dataset for PiCo-7B (ArcOffical/PiCo-7B), an approximately 6.95B-parameter (~7B) large language model featuring an Adaptive Hierarchical Mixture of Experts (AHMoE) architecture. The official model card describes 30 layers, including 15 MoE layers and 15 dense layers, with approximately 2.63B active parameters per token and a 131,072-token context window.[^1] Purpose This dataset teaches… See the full description on the dataset page: https://huggingface.co/datasets/ArcOffical/PiCo-dataset-general-7b.
018
