CPU-Hybrid-MoE/DeepSeek-V3-0324-CPU-NUMA4-AMXINT8
021
For inference with sglang and kt-kernel: https://lmsys.org/blog/2025-10-22-KTransformers/
This version is packed specifically for NUMA tensor parallel = 4
For inference with sglang and kt-kernel: https://lmsys.org/blog/2025-10-22-KTransformers/
This version is packed specifically for NUMA tensor parallel = 4