rocm
Qwen3.8-Flash-Next-ROCmFP4-FAST-imatrix-GGUFQwen3.8-Flash-Next-Uncensored-ROCmFP4-FAST-GGUFQwen-3.8-27B-ROCmFP4-FAST-GGUFQwen3.8-27B-ROCmFP4-STRIX-MTP-GGUFOrnith-1.5-35B-A3B-ROCmFP4-GGUFQwen3.8-27B-Uncensored-ROCmFP4-STRIX-MTP-GGUFQwen3.8-27B-Uncensored-Q4_0-ROCmFP4-STRIXDeepSeek-V4-Flash-0731-ROCmFP3
Datasets
All datasets matching “rocm”rocmrocm-vlm-ocr-awq-configs
ROCm VLM/OCR AWQ+BF16 Serving Config Bundle
A4 @ 200 DPI coverage verified (max_model_len >= 8192, visual tokens ~3800 + text ~4096).
Model Profiles
Profile
Model
Quant
max_model_len
Concurrent VRAM
vllm-qwen3-vl-awq.json
cyankiwi/Qwen3-VL-8B-Instruct-AWQ-4bit
AWQ W4A16
8192
0.30
vllm-bizonai-bf16.json
ONTHEIT/BizOnAI-OCR
BF16
8192
0.26
sglang-qwen3-vl-awq.json
cyankiwi/Qwen3-VL-8B-Instruct-AWQ-4bit
AWQ W4A16
8192
0.30
A4 @ 200 DPI Token… See the full description on the dataset page: https://huggingface.co/datasets/yakdoli/rocm-vlm-ocr-awq-configs.deepseek-v4-flash-rocm-vllm-repro
Reproducing DeepSeek-V4-Flash on AMD ROCm with vLLM: 32K Correctness and TopK Sweep
This article summarizes an engineering reproduction of
deepseek-ai/DeepSeek-V4-Flash on an AMD ROCm ModelScope DSW instance. The work
focuses on a practical question: can a complex, fast-moving DeepSeek-V4-Flash
serving path be turned into a reproducible ROCm baseline with explicit
correctness gates?
The answer from this run is yes, with an important boundary: the current setup
is a fallback-heavy… See the full description on the dataset page: https://huggingface.co/datasets/lyydfys/deepseek-v4-flash-rocm-vllm-repro.installamacpp-rocmwan2.2-rocm-profiles
Wan2.2 Sequence Parallel ROCm Profiles (MI300X)
This dataset contains PyTorch/Perfetto traces, offline execution logs, serving benchmarks, and comparative reports for Wan2.2-T2V-A14B sequence-parallel runs on AMD ROCm (gfx942, 8x MI300X node).
Dataset Directory Structure
reports/ / Root:
wan22_rocm_sp_sweep_analysis.md: 3-way sequence parallel topology comparison report.
wan22_profile_u4_r1_analysis.md: Detailed analysis of the Ulysses-4 topology.… See the full description on the dataset page: https://huggingface.co/datasets/Akshat/wan2.2-rocm-profiles.rocm-agent-sft
