CoolFace
Modelpublic

ArtusDev/ByteDance-Seed_Seed-X-PPO-7B-EXL3

sourceHugging Faceotherupdated 1y agoView on Hugging Face
1likes16downloads
Model Card

EXL3 Quants of ByteDance-Seed/Seed-X-PPO-7B

EXL3 quants of ByteDance-Seed/Seed-X-PPO-7B using <a href="https://github.com/turboderp-org/exllamav3/">exllamav3</a> for quantization.

Quants

Quant(Revision)Bits per WeightHead Bits
2.5_H62.56
3.0_H63.06
3.5_H63.56
4.0_H64.06
4.5_H64.56
5.0_H65.06
5.5_H65.56
6.0_H66.06
6.5_H66.56
7.0_H67.06
7.5_H67.56
8.0_H88.08

Downloading quants with huggingface-cli

<details> <summary>Click to view download instructions</summary>

Install hugginface-cli:

bash
pip install -U "huggingface_hub[cli]"

Download quant by targeting the specific quant revision (branch):

huggingface-cli download ArtusDev/ByteDance-Seed_Seed-X-PPO-7B-EXL3 --revision "5.0bpw_H6" --local-dir ./

</details>