AMD-Pro-BenchCommunity

13,812 benchmarks in 32 GPU combinations documented

MMLU-Pro results on AMD GPUs

3 results · 3 sources · 3 measurements

Scores from different versions, task subsets, harnesses and scoring rules are not directly comparable. How results are reviewed

Documented results

3 selected tests
View
Report
Custom evaluation
Qwen3.8-Flash-NextUD-Q3_K_XLModel ref. ↗MMLU-ProLLST protocol 1.0 subset · 42 pinned LLST v1.0 questions; not the full MMLU-Pro benchmark32K configured context
85.71 %Score · n = 100 · 14 categories; five-shot validation examples
——2 × RX 7900 XTXMulti-GPU · split unknown · 24 GB VRAM/GPU
Configuration
Memory
24 GB VRAM/GPU
OS
Ubuntu 24.04 LTS
Engine
llama.cpp
Backend
ROCm / HIP
Harness
Local LLM Standard Test (LLST) 1.0 / EvalScope
Prompt / output
? / ? tokens
Context
32768
Concurrency
Not reported
Date
2026-09-17
Full record →
View
Report
Generic LLM
halogen-swift1.5-qwen3.8-flash-next-v2-abliteratedHalogen v2 HT/I4R mixed4-bitWeights ↗MMLU-ProOne question per14subjects; seed71 concurrent request
10 correctScore · n = 14 · Accuracy
——1 × Ryzen AI Max+ 395Single GPU · Unified memory · 128 GB RAM
Configuration
Memory
Unified memory · 128 GB RAM
OS
Not reported
Engine
halogen-flash-server
Backend
Not reported
Harness
Model-author14-question reasoning sample
Prompt / output
? / ? tokens
Context
Not reported
Concurrency
1
Date
Not reported
Full record →
View
Report
Generic LLM
Gemma4-26B-CIRU-AMD-STRIX-vLLMW4A16 INT4 group64Weights ↗MMLU-Pro100 tasks
72.5 %Score · n = 100 · Accuracy
——GPU count unknownUnknown · Unified memory · 128 GB RAM
Configuration
Memory
Unified memory · 128 GB RAM
OS
Not reported
Engine
vLLM (Ciru modified)
Backend
ROCm / AITER
Harness
EvalScope1.12.0
Prompt / output
? / ? tokens
Context
Not reported
Concurrency
Not reported
Date
Not reported
Full record →
Versions and harnesses

Versions: LLST protocol 1.0 subset
Harnesses: EvalScope1.12.0, Local LLM Standard Test (LLST) 1.0 / EvalScope, Model-author14-question reasoning sample

Explore all 3 results →

This is a selection across sources, not a ranking or a matched experiment. Reading benchmark reports

GPU benchmark pages: RX 7900 XTX · Ryzen AI Max+ 395