CoolFace
Modelpublic

AaryanK/GLM-4.7-Flash-GGUF

sourceHugging Facemitupdated 8mo agoView on Hugging Face
7likes735downloads
Model Card

GLM-4.7-Flash-GGUF

<div align="center"> <img src="https://raw.githubusercontent.com/zai-org/GLM-4.5/refs/heads/main/resources/logo.svg" width="15%"/> </div>

Description

This repository contains GGUF format model files for Zhipu AI's GLM-4.7-Flash.

GLM-4.7-Flash is a highly efficient 30B-A3B Mixture-of-Experts (MoE) model. It is designed to be the strongest model in the 30B parameter class, offering a powerful option for lightweight deployment that perfectly balances performance and efficiency.

Evaluation Results

BenchmarkGLM-4.7-FlashQwen3-30B-A3B-Thinking-2507GPT-OSS-20B
AIME 2591.685.091.7
GPQA75.273.471.5
LCB v664.066.061.0
HLE14.49.810.9
SWE-bench Verified59.222.034.0
τ²-Bench79.549.047.7
BrowseComp42.82.2928.3

Files & Quantization

To see the available files, please verify the Files and versions tab.

How to Run (llama.cpp)

Recommended Parameters:

  • —Temperature: 1.0 (Standard) or 0.7 (For stricter adherence)
  • —Top-P: 0.95
  • —Context: -c (Adjust based on available RAM).

CLI Example

bash
./llama-cli -m GLM-4.7-Flash.Q4_K_M.gguf \
  -c 8192 \
  --temp 1.0 \
  --top-p 0.95 \
  -p "User: Write a Python script to calculate Fibonacci numbers.\nAssistant:" \
  -cnv

Server Example

bash
./llama-server -m GLM-4.7-Flash.Q4_K_M.gguf \
  --port 8080 \
  --host 0.0.0.0 \
  -c 16384 \
  -ngl 99