AMD-Pro-BenchCommunity

13,812 benchmarks in 32 GPU combinations documented

Mistral-7B-Instruct-v0.3 on AMD GPUs

66 results · 5 sources · 84 measurements

Explore all results

Grouped by reported model identity. Exact weights, quantizations and software can differ. How results are reviewed

Documented results

24 selected tests
View
ReportGeneric LLM		Mistral-7B-Instruct-v0.3Q8_0Model ref. ↗Token speed——
73.97 tok/sGeneration · mean · per request
1 × R9700Single GPU · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Ubuntu 24.04
Engine
llama.cpp
Backend
Vulkan / Mesa RADV
Harness
Not reported
Prompt / output
? / 128 tokens
Context
Not reported
Concurrency
Not reported
Date
2025-11-18
Full record →
View
ReportGeneric LLM		Mistral-7B-Instruct-v0.3Q8_0Model ref. ↗Token speed—
4,946.52 tok/sPrefill · mean · per request
—1 × R9700Single GPU · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Ubuntu 24.04
Engine
llama.cpp
Backend
ROCm 7.0.0
Harness
Not reported
Prompt / output
512 / ? tokens
Context
Not reported
Concurrency
Not reported
Date
2026-05-14
Full record →
View
Reportllama-bench		Mistral-7B-Instruct-v0.3Q8_0Model ref. ↗Token speed——
75.01 tok/sGeneration · mean · per request
1 × RX 9070 XTSingle GPU · 16 GB VRAM/GPU
Configuration
Memory
16 GB VRAM/GPU
OS
Ubuntu 26.04 LTS / Linux 7.0
Engine
llama.cpp
Backend
Vulkan
Harness
Phoronix Test Suite / llama-bench
Prompt / output
0 / 128 tokens
Context
Not reported
Concurrency
Not reported
Date
2026-06-01
Full record →
View
ReportLocalMaxxing		Mistral-7B-Instruct-v0.3Q4_K_MWeights ↗Token speed——
52.2 tok/sGeneration · median · per request
1 × Ryzen AI Max+ 395Single GPU · Unified memory · 96 GB RAM
Configuration
Memory
Unified memory · 96 GB RAM
OS
Ubuntu 24.04
Engine
Loculus Core
Backend
vulkan
Harness
LocalMaxxing community speed test; lmx 0.1.56
Prompt / output
314 / 256 tokens
Context
2048
Concurrency
1
Date
2026-10-30
Full record →
View
Reportllama-bench		Mistral-7B-Instruct-v0.3Q8_0Model ref. ↗Token speed—
2,979.05 tok/sPrefill · mean · per request
—1 × RX 7900 XTXSingle GPU · 24 GB VRAM/GPU
Configuration
Memory
24 GB VRAM/GPU
OS
Ubuntu 26.04 / Linux7.0
Engine
llama.cpp
Backend
Vulkan
Harness
Phoronix Test Suite / llama-bench
Prompt / output
2048 / 0 tokens
Context
Not reported
Concurrency
1
Date
Not reported
Full record →
View
ReportGeneric LLM		Mistral-7B-Instruct-v0.3Q8_0Model ref. ↗Token speed——
67.02 tok/sGeneration · mean · per request
1 × R9700Single GPU · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Ubuntu 24.04
Engine
llama.cpp
Backend
HIP / ROCm 7.1
Harness
Not reported
Prompt / output
? / 128 tokens
Context
Not reported
Concurrency
Not reported
Date
2025-11-18
Full record →
View
ReportGeneric LLM		Mistral-7B-Instruct-v0.3Q8_0Model ref. ↗Token speed—
4,921.32 tok/sPrefill · mean · per request
—1 × R9700Single GPU · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Ubuntu 24.04
Engine
llama.cpp
Backend
ROCm 7.2.3
Harness
Not reported
Prompt / output
512 / ? tokens
Context
Not reported
Concurrency
Not reported
Date
2026-05-14
Full record →
View
Reportllama-bench		Mistral-7B-Instruct-v0.3Q8_0Model ref. ↗Token speed——
74.26 tok/sGeneration · mean · per request
1 × RX 9070Single GPU · 16 GB VRAM/GPU
Configuration
Memory
16 GB VRAM/GPU
OS
Ubuntu 26.04 LTS / Linux 7.0
Engine
llama.cpp
Backend
Vulkan
Harness
Phoronix Test Suite / llama-bench
Prompt / output
0 / 128 tokens
Context
Not reported
Concurrency
Not reported
Date
2026-06-01
Full record →
View
ReportLocalMaxxing		Mistral-7B-Instruct-v0.3Q4_K_MWeights ↗Token speed
1,136.6 tok/sEstimated prefill rate · median · per request
——1 × Ryzen AI Max+ 395Single GPU · Unified memory · 96 GB RAM
Configuration
Memory
Unified memory · 96 GB RAM
OS
Ubuntu 24.04
Engine
Loculus Core
Backend
vulkan
Harness
LocalMaxxing community speed test; lmx 0.1.56
Prompt / output
314 / 256 tokens
Context
2048
Concurrency
1
Date
2026-10-30
Full record →
View
Reportllama-bench		Mistral-7B-Instruct-v0.3Q8_0Model ref. ↗Token speed—
2,672.53 tok/sPrefill · mean · per request
—1 × RX 7900 XTSingle GPU · 20 GB VRAM/GPU
Configuration
Memory
20 GB VRAM/GPU
OS
Ubuntu 26.04 / Linux7.0
Engine
llama.cpp
Backend
Vulkan
Harness
Phoronix Test Suite / llama-bench
Prompt / output
2048 / 0 tokens
Context
Not reported
Concurrency
1
Date
Not reported
Full record →
View
ReportGeneric LLM		Mistral-7B-Instruct-v0.3Q8_0Model ref. ↗Token speed—
3,484.94 tok/sPrefill · mean · per request
—1 × R9700Single GPU · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Ubuntu 24.04
Engine
llama.cpp
Backend
Vulkan / Mesa RADV
Harness
Not reported
Prompt / output
512 / ? tokens
Context
Not reported
Concurrency
Not reported
Date
2025-11-18
Full record →
View
Reportllama-bench		Mistral-7B-Instruct-v0.3Q8_0Model ref. ↗Token speed——
52.09 tok/sGeneration · mean · per request
1 × RX 9070 GRESingle GPU · 12 GB VRAM/GPU
Configuration
Memory
12 GB VRAM/GPU
OS
Ubuntu 26.04 LTS / Linux 7.0
Engine
llama.cpp
Backend
Vulkan
Harness
Phoronix Test Suite / llama-bench
Prompt / output
0 / 128 tokens
Context
Not reported
Concurrency
Not reported
Date
2026-06-01
Full record →
View
Reportllama-bench		Mistral-7B-Instruct-v0.3Q8_0Model ref. ↗Token speed—
2,238.05 tok/sPrefill · mean · per request
—1 × RX 7900 GRESingle GPU · 16 GB VRAM/GPU
Configuration
Memory
16 GB VRAM/GPU
OS
Ubuntu 26.04 / Linux7.0
Engine
llama.cpp
Backend
Vulkan
Harness
Phoronix Test Suite / llama-bench
Prompt / output
2048 / 0 tokens
Context
Not reported
Concurrency
1
Date
Not reported
Full record →
View
ReportGeneric LLM		Mistral-7B-Instruct-v0.3Q8_0Model ref. ↗Token speed—
4,098.24 tok/sPrefill · mean · per request
—1 × R9700Single GPU · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Ubuntu 24.04
Engine
llama.cpp
Backend
HIP / ROCm 7.1
Harness
Not reported
Prompt / output
512 / ? tokens
Context
Not reported
Concurrency
Not reported
Date
2025-11-18
Full record →
View
Reportllama-bench		Mistral-7B-Instruct-v0.3Q8_0Model ref. ↗Token speed—
4,297.83 tok/sPrefill · mean · per request
—1 × RX 9070 XTSingle GPU · 16 GB VRAM/GPU
Configuration
Memory
16 GB VRAM/GPU
OS
Ubuntu 26.04 LTS / Linux 7.0
Engine
llama.cpp
Backend
Vulkan
Harness
Phoronix Test Suite / llama-bench
Prompt / output
2048 / 0 tokens
Context
Not reported
Concurrency
Not reported
Date
2026-06-01
Full record →
View
Reportllama-bench		Mistral-7B-Instruct-v0.3Q8_0Model ref. ↗Token speed—
1,814.38 tok/sPrefill · mean · per request
—1 × RX 7800 XTSingle GPU · 16 GB VRAM/GPU
Configuration
Memory
16 GB VRAM/GPU
OS
Ubuntu 26.04 / Linux7.0
Engine
llama.cpp
Backend
Vulkan
Harness
Phoronix Test Suite / llama-bench
Prompt / output
2048 / 0 tokens
Context
Not reported
Concurrency
1
Date
Not reported
Full record →
View
ReportGeneric LLM		Mistral-7B-Instruct-v0.3Q8_0Model ref. ↗Token speed—
3,320.68 tok/sPrefill · mean · per request
—1 × R9700Single GPU · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Ubuntu 24.04
Engine
llama.cpp
Backend
Vulkan / Mesa RADV
Harness
Not reported
Prompt / output
1024 / ? tokens
Context
Not reported
Concurrency
Not reported
Date
2025-11-18
Full record →
View
Reportllama-bench		Mistral-7B-Instruct-v0.3Q8_0Model ref. ↗Token speed—
3,487.32 tok/sPrefill · mean · per request
—1 × RX 9070Single GPU · 16 GB VRAM/GPU
Configuration
Memory
16 GB VRAM/GPU
OS
Ubuntu 26.04 LTS / Linux 7.0
Engine
llama.cpp
Backend
Vulkan
Harness
Phoronix Test Suite / llama-bench
Prompt / output
2048 / 0 tokens
Context
Not reported
Concurrency
Not reported
Date
2026-06-01
Full record →
View
Reportllama-bench		Mistral-7B-Instruct-v0.3Q8_0Model ref. ↗Token speed——
99 tok/sGeneration · mean · per request
1 × RX 7900 XTXSingle GPU · 24 GB VRAM/GPU
Configuration
Memory
24 GB VRAM/GPU
OS
Ubuntu 26.04 / Linux7.0
Engine
llama.cpp
Backend
Vulkan
Harness
Phoronix Test Suite / llama-bench
Prompt / output
0 / 128 tokens
Context
Not reported
Concurrency
1
Date
Not reported
Full record →
View
ReportGeneric LLM		Mistral-7B-Instruct-v0.3Q8_0Model ref. ↗Token speed—
3,928.92 tok/sPrefill · mean · per request
—1 × R9700Single GPU · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Ubuntu 24.04
Engine
llama.cpp
Backend
HIP / ROCm 7.1
Harness
Not reported
Prompt / output
1024 / ? tokens
Context
Not reported
Concurrency
Not reported
Date
2025-11-18
Full record →
View
Reportllama-bench		Mistral-7B-Instruct-v0.3Q8_0Model ref. ↗Token speed—
2,964.4 tok/sPrefill · mean · per request
—1 × RX 9070 GRESingle GPU · 12 GB VRAM/GPU
Configuration
Memory
12 GB VRAM/GPU
OS
Ubuntu 26.04 LTS / Linux 7.0
Engine
llama.cpp
Backend
Vulkan
Harness
Phoronix Test Suite / llama-bench
Prompt / output
2048 / 0 tokens
Context
Not reported
Concurrency
Not reported
Date
2026-06-01
Full record →
View
Reportllama-bench		Mistral-7B-Instruct-v0.3Q8_0Model ref. ↗Token speed——
85.05 tok/sGeneration · mean · per request
1 × RX 7900 XTSingle GPU · 20 GB VRAM/GPU
Configuration
Memory
20 GB VRAM/GPU
OS
Ubuntu 26.04 / Linux7.0
Engine
llama.cpp
Backend
Vulkan
Harness
Phoronix Test Suite / llama-bench
Prompt / output
0 / 128 tokens
Context
Not reported
Concurrency
1
Date
Not reported
Full record →
View
ReportGeneric LLM		Mistral-7B-Instruct-v0.3Q8_0Model ref. ↗Token speed—
3,052 tok/sPrefill · mean · per request
—1 × R9700Single GPU · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Ubuntu 24.04
Engine
llama.cpp
Backend
Vulkan / Mesa RADV
Harness
Not reported
Prompt / output
2048 / ? tokens
Context
Not reported
Concurrency
Not reported
Date
2025-11-18
Full record →
View
Reportllama-bench		Mistral-7B-Instruct-v0.3Q8_0Model ref. ↗Power & energy0 input · 128 output
27 WPower draw · Per GPU
——1 × RX 9070 GRESingle GPU · 12 GB VRAM/GPU
Configuration
Memory
12 GB VRAM/GPU
OS
Ubuntu 26.04 LTS / Linux 7.0
Engine
llama.cpp
Backend
Vulkan
Harness
Phoronix Test Suite / llama-bench
Prompt / output
0 / 128 tokens
Context
Not reported
Concurrency
Not reported
Date
2026-06-01
Full record →
Quantizations and software

Quantizations: Q4_K_M, Q8_0
Engines: llama.cpp, Loculus Core

Explore all 66 results →

This is a selection across sources, not a ranking or a matched experiment. Reading benchmark reports

GPU benchmark pages: R9700 · RX 9070 XT · RX 9070 · RX 9070 GRE · RX 7900 XTX · RX 7900 XT · RX 7900 GRE · RX 7800 XT · Ryzen AI Max+ 395