AMD-Pro-BenchCommunity

13,812 benchmarks in 32 GPU combinations documented

4 × R9700 LLM benchmarks

102 results · 158 measurements · 9 sources

Device specifications
VariantMemoryMemory typeBusBandwidthFP16 matrixINT8 matrix
R9700 ↗32 GBGDDR6256-bit640 GB/s191 TFLOPS383 TOPS

Manufacturer specifications. Shared system RAM is not dedicated VRAM. Unreported values remain —; measured LLM results retain their reported configuration.

Selected reported tests

24 of 102 results

Source-reported results, selected across reports by documentation quality. Match configurations before comparing values.

View
Report
LocalMaxxing
DeepSeek-V4-FlashMQ2RModel ref. ↗Token speed—
389.19 tok/sPrefill · median · per request
54.27 tok/sGeneration · median · per request
4 × R9700Tensor parallel · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Ubuntu 26.04
Engine
hipfire
Backend
rocm
Harness
LocalMaxxing community speed test; exact client where reported
Prompt / output
2052 / 512 tokens
Context
2052
Concurrency
1
Date
2026-08-10
Full record →
View
Report
Generic LLM
DeepSeek-R1-Distill-Qwen-14BBF16Model ref. ↗Token speed
41.5 tok/sThroughput · per request
——4 × R9700Tensor parallel · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Linux (distribution not reported)
Engine
vLLM
Backend
ROCm 7.2.2 container / 6.4.3 host
Harness
Not reported
Prompt / output
? / ? tokens
Context
Not reported
Concurrency
1
Date
2026-05-22
Full record →
View
Report
BetterBench
Qwen3.8-Flash-NextMXFP4Weights ↗BetterBench—
3,207.8 tok/sPrefill · median · per request
—4 × R9700Tensor parallel · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Linux 7.2.3-070203-generic
Engine
vLLM
Backend
ROCm 10.0.0
Harness
BetterBench
Prompt / output
1514 / 16 tokens
Context
524288
Concurrency
1
Date
2026-09-04
Full record →
View
Report
Serving benchmark
Qwen3.6-27BBF16Weights ↗Token speed1 · halo-arena-v1
34.08 tok/sThroughput · aggregate
—
35.58 tok/sGeneration · per request
4 × R9700Tensor parallel · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Not reported
Engine
vLLM
Backend
ROCm / HIP
Harness
radeonrun bench.py (source profile framework: llama-benchy)
Prompt / output
512 / ? tokens
Context
2304
Concurrency
1
Date
2026-07-31
Full record →
View
Report
Serving benchmark
Qwen3.6-35B-A3BBF16Weights ↗Token speed1 · halo-arena-v1
34.25 tok/sThroughput · aggregate
—
39.85 tok/sGeneration · per request
4 × R9700Multi-GPU · split unknown · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Not reported
Engine
llama.cpp
Backend
ROCm / HIP
Harness
radeonrun bench.py (source profile framework: llama-benchy)
Prompt / output
589 / ? tokens
Context
32768
Concurrency
1
Date
2026-07-31
Full record →
View
Report
Serving benchmark
Qwen3.6-35B-A3BBF16Weights ↗Token speed1 · halo-arena-v1
96.85 tok/sThroughput · aggregate
—
103.47 tok/sGeneration · per request
4 × R9700Tensor parallel · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Not reported
Engine
vLLM
Backend
ROCm / HIP
Harness
radeonrun bench.py (source profile framework: llama-benchy)
Prompt / output
512 / ? tokens
Context
2304
Concurrency
1
Date
2026-07-31
Full record →
View
Report
Serving benchmark
Qwen3.8-Flash-NextMXFP4 experts / FP8 denseWeights ↗Token speed——
219 tok/sGeneration · per request
4 × R9700Tensor parallel · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Linux (distribution unreported)
Engine
vLLM + r9700-stack
Backend
ROCm 10
Harness
Not reported
Prompt / output
? / ? tokens
Context
32768
Concurrency
1
Date
Not reported
Full record →
View
Report
Generic LLM
Qwen3.8-27BFP8Model ref. ↗Token speed—
17,636 tok/sPrefill · peak · unknown
—4 × R9700Multi-GPU · split unknown · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Not reported
Engine
vLLM Radiance
Backend
Not reported
Harness
Not reported
Prompt / output
? / ? tokens
Context
Not reported
Concurrency
Not reported
Date
Not reported
Full record →
View
Report
Generic LLM
DeepSeek-R1-Distill-Qwen-32BQuant not reportedModel ref. ↗Token speed
40 output tokens/sToken throughput · Aggregate
——4 × R9700Multi-GPU · split unknown · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Ubuntu 22.04
Engine
vLLM
Backend
Not reported
Harness
Not reported
Prompt / output
? / ? tokens
Context
Not reported
Concurrency
Not reported
Date
Not reported
Full record →
View
Report
LocalMaxxing
Qwen3.6-35B-A3BMQ4RModel ref. ↗Token speed
6,001.4 tok/sThroughput · median · aggregate
——4 × R9700Independent replicas · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Ubuntu 26.04
Engine
hipfire
Backend
rocm
Harness
LocalMaxxing community speed test; exact client where reported
Prompt / output
0 / 64 tokens
Context
1024
Concurrency
112
Date
2026-08-10
Full record →
View
Report
Generic LLM
DeepSeek-R1-Distill-Qwen-14BBF16Model ref. ↗Token speed——
42 tok/sGeneration · per request
4 × R9700Tensor parallel · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Linux (distribution not reported)
Engine
vLLM
Backend
ROCm 7.2.2 container / 6.4.3 host
Harness
Not reported
Prompt / output
? / ? tokens
Context
Not reported
Concurrency
1
Date
2026-05-22
Full record →
View
Report
BetterBench
Qwen3.8-Flash-NextMXFP4Weights ↗BetterBench—
3,508.6 tok/sPrefill · median · per request
—4 × R9700Tensor parallel · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Linux 7.2.3-070203-generic
Engine
vLLM
Backend
ROCm 10.0.0
Harness
BetterBench
Prompt / output
5918 / 16 tokens
Context
524288
Concurrency
1
Date
2026-09-04
Full record →
View
Report
Serving benchmark
Qwen3.6-27BBF16Weights ↗Token speed1 · halo-arena-v1
115.22 tok/sThroughput · aggregate
—
32.42 tok/sGeneration · per request
4 × R9700Tensor parallel · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Not reported
Engine
vLLM
Backend
ROCm / HIP
Harness
radeonrun bench.py (source profile framework: llama-benchy)
Prompt / output
512 / ? tokens
Context
2304
Concurrency
4
Date
2026-07-31
Full record →
View
Report
Serving benchmark
Qwen3.6-35B-A3BBF16Weights ↗Token speed1 · halo-arena-v1
53.68 tok/sThroughput · aggregate
—
19.9 tok/sGeneration · per request
4 × R9700Multi-GPU · split unknown · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Not reported
Engine
llama.cpp
Backend
ROCm / HIP
Harness
radeonrun bench.py (source profile framework: llama-benchy)
Prompt / output
? / ? tokens
Context
32768
Concurrency
4
Date
2026-07-31
Full record →
View
Report
Serving benchmark
Qwen3.6-35B-A3BBF16Weights ↗Token speed1 · halo-arena-v1
289.86 tok/sThroughput · aggregate
—
82.6 tok/sGeneration · per request
4 × R9700Tensor parallel · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Not reported
Engine
vLLM
Backend
ROCm / HIP
Harness
radeonrun bench.py (source profile framework: llama-benchy)
Prompt / output
512 / ? tokens
Context
2304
Concurrency
4
Date
2026-07-31
Full record →
View
Report
BetterBench
Qwen3.8-Flash-NextMXFP4 experts / FP8 denseWeights ↗Token speed
172 tok/sThroughput · aggregate
——4 × R9700Tensor parallel · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Linux (distribution unreported)
Engine
vLLM + r9700-stack
Backend
ROCm 10
Harness
BetterBench
Prompt / output
? / ? tokens
Context
32768
Concurrency
1
Date
Not reported
Full record →
View
Report
Generic LLM
Qwen3.8-27BFP8Model ref. ↗Token speed——
36.6 tok/sGeneration · peak · unknown
4 × R9700Multi-GPU · split unknown · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Not reported
Engine
vLLM Radiance
Backend
Not reported
Harness
Not reported
Prompt / output
? / ? tokens
Context
Not reported
Concurrency
Not reported
Date
Not reported
Full record →
View
Report
Generic LLM
DeepSeek-R1-Distill-Qwen-32BQuant not reportedModel ref. ↗Token speed
189 output tokens/sToken throughput · Aggregate
——4 × R9700Multi-GPU · split unknown · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Ubuntu 22.04
Engine
vLLM
Backend
Not reported
Harness
Not reported
Prompt / output
? / ? tokens
Context
Not reported
Concurrency
Not reported
Date
Not reported
Full record →
View
Report
LocalMaxxing
Qwen3.6-35B-A3BMQ4RModel ref. ↗Token speed
5,993.3 tok/sThroughput · median · aggregate
——4 × R9700Independent replicas · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Ubuntu 26.04
Engine
hipfire
Backend
rocm
Harness
LocalMaxxing community speed test; exact client where reported
Prompt / output
0 / 64 tokens
Context
1024
Concurrency
100
Date
2026-08-10
Full record →
View
Report
Generic LLM
gemma-4-26B-A4B-itBF16Model ref. ↗Token speed
24.2 tok/sThroughput · per request
——4 × R9700Tensor parallel · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Linux (distribution not reported)
Engine
vLLM
Backend
ROCm 7.2.2 container / 6.4.3 host
Harness
Not reported
Prompt / output
? / ? tokens
Context
Not reported
Concurrency
1
Date
2026-05-22
Full record →
View
Report
BetterBench
Qwen3.8-Flash-NextMXFP4Weights ↗BetterBench—
3,570.9 tok/sPrefill · median · per request
—4 × R9700Tensor parallel · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Linux 7.2.3-070203-generic
Engine
vLLM
Backend
ROCm 10.0.0
Harness
BetterBench
Prompt / output
11794 / 16 tokens
Context
524288
Concurrency
1
Date
2026-09-04
Full record →
View
Report
Serving benchmark
Qwen3.6-27BBF16Weights ↗Token speed1 · halo-arena-v1
14.43 tok/sThroughput · aggregate
—
0.91 tok/sGeneration · per request
4 × R9700Tensor parallel · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Not reported
Engine
vLLM
Backend
ROCm / HIP
Harness
radeonrun bench.py (source profile framework: llama-benchy)
Prompt / output
512 / ? tokens
Context
2304
Concurrency
16
Date
2026-07-31
Full record →
View
Report
Serving benchmark
Qwen3.6-35B-A3BBF16Weights ↗Token speed1 · halo-arena-v1
3.11 tok/sThroughput · aggregate
—
7.03 tok/sGeneration · per request
4 × R9700Multi-GPU · split unknown · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Not reported
Engine
llama.cpp
Backend
ROCm / HIP
Harness
radeonrun bench.py (source profile framework: llama-benchy)
Prompt / output
? / ? tokens
Context
32768
Concurrency
16
Date
2026-07-31
Full record →
View
Report
Serving benchmark
Qwen3.6-35B-A3BBF16Weights ↗Token speed1 · halo-arena-v1
134.34 tok/sThroughput · aggregate
—
29.48 tok/sGeneration · per request
4 × R9700Tensor parallel · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Not reported
Engine
vLLM
Backend
ROCm / HIP
Harness
radeonrun bench.py (source profile framework: llama-benchy)
Prompt / output
512 / ? tokens
Context
2304
Concurrency
16
Date
2026-07-31
Full record →
Models and software in this collection

Model families: DeepSeek R1, DeepSeek V4, GPT-OSS, Gemma 4, Llama 3.1, Qwen3.5, Qwen3.6, Qwen3.8

Engines: hipfire, llama.cpp, vLLM, vLLM + r9700-stack, vLLM Radiance

Methodology and evidence standards · Download the research dataset