awq
Datasets
All datasets matching “awq”awq-model-zoootto-taxonomy-sdg-mistral-small-24b-instruct-2501-awqrocm-vlm-ocr-awq-configs
ROCm VLM/OCR AWQ+BF16 Serving Config Bundle
A4 @ 200 DPI coverage verified (max_model_len >= 8192, visual tokens ~3800 + text ~4096).
Model Profiles
Profile
Model
Quant
max_model_len
Concurrent VRAM
vllm-qwen3-vl-awq.json
cyankiwi/Qwen3-VL-8B-Instruct-AWQ-4bit
AWQ W4A16
8192
0.30
vllm-bizonai-bf16.json
ONTHEIT/BizOnAI-OCR
BF16
8192
0.26
sglang-qwen3-vl-awq.json
cyankiwi/Qwen3-VL-8B-Instruct-AWQ-4bit
AWQ W4A16
8192
0.30
A4 @ 200 DPI Token… See the full description on the dataset page: https://huggingface.co/datasets/yakdoli/rocm-vlm-ocr-awq-configs.all-Meta-Llama-3.1-70B-Instruct-AWQ-INT4details_maldv__Awqward2.5-32B-Instruct_v2
Dataset Card for Evaluation run of maldv/Awqward2.5-32B-Instruct
Dataset automatically created during the evaluation run of model maldv/Awqward2.5-32B-Instruct.
The dataset is composed of 116 configuration, each one coresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest results.
An… See the full description on the dataset page: https://huggingface.co/datasets/OALL/details_maldv__Awqward2.5-32B-Instruct_v2.all-Qwen2.5-72B-Instruct-AWQ
