CoolFace
Modelpublic

cortexso/intellect-2

sourceHugging Faceapache-2.0updated 1y agoView on Hugging Face
1likes216downloads
Model Card

Overview

Prime Intellect released INTELLECT-2, a 32 billion parameter large language model (LLM) trained through distributed reinforcement learning on globally donated GPU resources. Built on the Qwen2 architecture and fine-tuned with the prime-rl framework, INTELLECT-2 demonstrates strong performance in math, coding, and logical reasoning.

This model leverages GRPO (Generalized Reinforcement Policy Optimization) over verifiable rewards, introducing asynchronous distributed RL training with enhanced stability techniques. While its primary focus was on verifiable mathematical and coding tasks, it remains compatible with general-purpose text generation tasks.

Variants

INTELLECT-2

NoVariantBranchCortex CLI command
1INTELLECT-2 (32B)32bcortex run intellect-2:32b

Each branch includes multiple GGUF quantized versions, optimized for various hardware configurations:

  • —INTELLECT-2-32B: q2k, q3kl, q3km, q3ks, q4km, q4ks, q5km, q5ks, q6k, q8_0

Use it with Jan (UI)

  1. 1.Install Jan using Quickstart
  2. 2.Use in Jan model Hub:
bash
   cortexso/intellect-2

Use it with Cortex (CLI)

  1. 1.Install Cortex using Quickstart
  2. 2.Run the model with command:
bash
   cortex run intellect-2

Credits