AMD-Pro-BenchCommunity

13,812 benchmarks in 32 GPU combinations documented

Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NEO-CODER-MAX-MTP on R9700

102 results · 2 sources · 230 measurements

Grouped by reported model identity. Exact weights, quantizations and software can differ. How results are reviewed

Documented results

24 selected tests
View
Report
Generic LLM
Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NEO-CODER-MAX-MTPIQ4_XSWeights ↗Token speed—
840.3 tok/sPrefill · per request
47.35 tok/sGeneration · per request
1 × R9700Single GPU · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
CachyOS (Arch-based)
Engine
llama.cpp
Backend
Vulkan / Mesa RADV 26.x
Harness
phase1_turbo_ab.py
Prompt / output
38724 / 141 tokens
Context
262144
Concurrency
1
Date
2026-09-10
Full record →
View
Report
Serving benchmark
Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NEO-CODER-MAX-MTPQ4_K_MWeights ↗Token speed——
27.3 tok/sGeneration · median · per request
1 × R9700Single GPU · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Linux (kernel 6.17.0-1028-oem)
Engine
Paiton + vLLM
Backend
ROCm
Harness
benchmark_http.py
Prompt / output
128 / 128 tokens
Context
8192
Concurrency
1
Date
Not reported
Full record →
View
Report
Generic LLM
Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NEO-CODER-MAX-MTPIQ4_XSWeights ↗Token speed—
979.39 tok/sPrefill · per request
32.48 tok/sGeneration · per request
1 × R9700Single GPU · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
CachyOS (Arch-based)
Engine
llama.cpp
Backend
Vulkan / Mesa RADV 26.x
Harness
Not reported
Prompt / output
2363 / 768 tokens
Context
262144
Concurrency
1
Date
2026-09-10
Full record →
View
Report
Serving benchmark
Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NEO-CODER-MAX-MTPQ4_K_MWeights ↗Token speed——
27.1 tok/sGeneration · median · per request
1 × R9700Single GPU · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Linux (kernel 6.17.0-1028-oem)
Engine
Paiton + vLLM
Backend
ROCm
Harness
benchmark_http.py
Prompt / output
1024 / 128 tokens
Context
8192
Concurrency
1
Date
Not reported
Full record →
View
Report
Generic LLM
Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NEO-CODER-MAX-MTPIQ4_XSWeights ↗Token speed—
883.46 tok/sPrefill · per request
30.18 tok/sGeneration · per request
1 × R9700Single GPU · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
CachyOS (Arch-based)
Engine
llama.cpp
Backend
Vulkan / Mesa RADV 26.x
Harness
Not reported
Prompt / output
38725 / 768 tokens
Context
262144
Concurrency
1
Date
2026-09-10
Full record →
View
Report
Serving benchmark
Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NEO-CODER-MAX-MTPQ4_K_MWeights ↗Token speed——
26.5 tok/sGeneration · median · per request
1 × R9700Single GPU · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Linux (kernel 6.17.0-1028-oem)
Engine
Paiton + vLLM
Backend
ROCm
Harness
benchmark_http.py
Prompt / output
4096 / 128 tokens
Context
8192
Concurrency
1
Date
Not reported
Full record →
View
Report
Generic LLM
Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NEO-CODER-MAX-MTPIQ4_XSWeights ↗Token speed—
615.88 tok/sPrefill · per request
25.72 tok/sGeneration · per request
1 × R9700Single GPU · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
CachyOS (Arch-based)
Engine
llama.cpp
Backend
Vulkan / Mesa RADV 26.x
Harness
Not reported
Prompt / output
128938 / 768 tokens
Context
262144
Concurrency
1
Date
2026-09-10
Full record →
View
Report
Serving benchmark
Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NEO-CODER-MAX-MTPQ4_K_MWeights ↗Token speed——
26.2 tok/sGeneration · median · per request
1 × R9700Single GPU · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Linux (kernel 6.17.0-1028-oem)
Engine
llama.cpp
Backend
ROCm
Harness
benchmark_http.py
Prompt / output
128 / 128 tokens
Context
8192
Concurrency
1
Date
Not reported
Full record →
View
Report
Generic LLM
Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NEO-CODER-MAX-MTPIQ4_XSWeights ↗Token speed—
977.71 tok/sPrefill · per request
32.19 tok/sGeneration · per request
1 × R9700Single GPU · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
CachyOS (Arch-based)
Engine
llama.cpp
Backend
Vulkan / Mesa RADV 26.x
Harness
Not reported
Prompt / output
2365 / 148 tokens
Context
262144
Concurrency
1
Date
2026-09-10
Full record →
View
Report
Serving benchmark
Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NEO-CODER-MAX-MTPQ4_K_MWeights ↗Token speed——
25.86 tok/sGeneration · median · per request
1 × R9700Single GPU · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Linux (kernel 6.17.0-1028-oem)
Engine
llama.cpp
Backend
ROCm
Harness
benchmark_http.py
Prompt / output
1024 / 128 tokens
Context
8192
Concurrency
1
Date
Not reported
Full record →
View
Report
Generic LLM
Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NEO-CODER-MAX-MTPIQ4_XSWeights ↗Token speed—
994.14 tok/sPrefill · per request
31.38 tok/sGeneration · per request
1 × R9700Single GPU · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
CachyOS (Arch-based)
Engine
llama.cpp
Backend
Vulkan / Mesa RADV 26.x
Harness
Not reported
Prompt / output
14789 / 240 tokens
Context
262144
Concurrency
1
Date
2026-09-10
Full record →
View
Report
Serving benchmark
Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NEO-CODER-MAX-MTPQ4_K_MWeights ↗Token speed——
24.97 tok/sGeneration · median · per request
1 × R9700Single GPU · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Linux (kernel 6.17.0-1028-oem)
Engine
llama.cpp
Backend
ROCm
Harness
benchmark_http.py
Prompt / output
4096 / 128 tokens
Context
8192
Concurrency
1
Date
Not reported
Full record →
View
Report
Generic LLM
Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NEO-CODER-MAX-MTPIQ4_XSWeights ↗Token speed—
882.3 tok/sPrefill · per request
29.95 tok/sGeneration · per request
1 × R9700Single GPU · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
CachyOS (Arch-based)
Engine
llama.cpp
Backend
Vulkan / Mesa RADV 26.x
Harness
Not reported
Prompt / output
38724 / 208 tokens
Context
262144
Concurrency
1
Date
2026-09-10
Full record →
View
Report
Serving benchmark
Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NEO-CODER-MAX-MTPQ4_K_MWeights ↗Latency128 input · 1 output · 1 concurrent request
271 msLatency · Per request
——1 × R9700Single GPU · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Linux (kernel 6.17.0-1028-oem)
Engine
Paiton + vLLM
Backend
ROCm
Harness
benchmark_http.py
Prompt / output
128 / 1 tokens
Context
8192
Concurrency
1
Date
Not reported
Full record →
View
Report
Generic LLM
Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NEO-CODER-MAX-MTPIQ4_XSWeights ↗Token speed—
616.13 tok/sPrefill · per request
25.73 tok/sGeneration · per request
1 × R9700Single GPU · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
CachyOS (Arch-based)
Engine
llama.cpp
Backend
Vulkan / Mesa RADV 26.x
Harness
Not reported
Prompt / output
128939 / 160 tokens
Context
262144
Concurrency
1
Date
2026-09-10
Full record →
View
Report
Serving benchmark
Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NEO-CODER-MAX-MTPQ4_K_MWeights ↗Latency128 input · 1 output · 1 concurrent request
273 msLatency · Per request
——1 × R9700Single GPU · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Linux (kernel 6.17.0-1028-oem)
Engine
Paiton + vLLM
Backend
ROCm
Harness
benchmark_http.py
Prompt / output
128 / 1 tokens
Context
8192
Concurrency
1
Date
Not reported
Full record →
View
Report
Generic LLM
Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NEO-CODER-MAX-MTPIQ4_XSWeights ↗Token speed—
519.19 tok/sPrefill · per request
23.49 tok/sGeneration · per request
1 × R9700Single GPU · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
CachyOS (Arch-based)
Engine
llama.cpp
Backend
Vulkan / Mesa RADV 26.x
Harness
Not reported
Prompt / output
184174 / 133 tokens
Context
262144
Concurrency
1
Date
2026-09-10
Full record →
View
Report
Serving benchmark
Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NEO-CODER-MAX-MTPQ4_K_MWeights ↗Latency128 input · 1 output · 1 concurrent request
271 msTime to first token · Per request
——1 × R9700Single GPU · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Linux (kernel 6.17.0-1028-oem)
Engine
Paiton + vLLM
Backend
ROCm
Harness
benchmark_http.py
Prompt / output
128 / 1 tokens
Context
8192
Concurrency
1
Date
Not reported
Full record →
View
Report
Generic LLM
Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NEO-CODER-MAX-MTPQ4_K_SWeights ↗Token speed—
854.21 tok/sPrefill · per request
47.57 tok/sGeneration · per request
1 × R9700Single GPU · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
CachyOS (Arch-based)
Engine
llama.cpp
Backend
Vulkan / Mesa RADV 26.x
Harness
phase1_turbo_ab.py
Prompt / output
38725 / 233 tokens
Context
262144
Concurrency
1
Date
2026-09-10
Full record →
View
Report
Serving benchmark
Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NEO-CODER-MAX-MTPQ4_K_MWeights ↗Latency128 input · 1 output · 1 concurrent request
273 msTime to first token · Per request
——1 × R9700Single GPU · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Linux (kernel 6.17.0-1028-oem)
Engine
Paiton + vLLM
Backend
ROCm
Harness
benchmark_http.py
Prompt / output
128 / 1 tokens
Context
8192
Concurrency
1
Date
Not reported
Full record →
View
Report
Generic LLM
Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NEO-CODER-MAX-MTPQ4_K_SWeights ↗Token speed—
1,002.24 tok/sPrefill · per request
31.91 tok/sGeneration · per request
1 × R9700Single GPU · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
CachyOS (Arch-based)
Engine
llama.cpp
Backend
Vulkan / Mesa RADV 26.x
Harness
Not reported
Prompt / output
2364 / 768 tokens
Context
262144
Concurrency
1
Date
2026-09-10
Full record →
View
Report
Serving benchmark
Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NEO-CODER-MAX-MTPQ4_K_MWeights ↗Latency128 input · 128 output · 1 concurrent request
4,925 msLatency · Per request
——1 × R9700Single GPU · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Linux (kernel 6.17.0-1028-oem)
Engine
Paiton + vLLM
Backend
ROCm
Harness
benchmark_http.py
Prompt / output
128 / 128 tokens
Context
8192
Concurrency
1
Date
Not reported
Full record →
View
Report
Generic LLM
Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NEO-CODER-MAX-MTPQ4_K_SWeights ↗Token speed—
897.95 tok/sPrefill · per request
29.74 tok/sGeneration · per request
1 × R9700Single GPU · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
CachyOS (Arch-based)
Engine
llama.cpp
Backend
Vulkan / Mesa RADV 26.x
Harness
Not reported
Prompt / output
38726 / 768 tokens
Context
262144
Concurrency
1
Date
2026-09-10
Full record →
View
Report
Serving benchmark
Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NEO-CODER-MAX-MTPQ4_K_MWeights ↗Latency128 input · 128 output · 1 concurrent request
4,929 msLatency · Per request
——1 × R9700Single GPU · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Linux (kernel 6.17.0-1028-oem)
Engine
Paiton + vLLM
Backend
ROCm
Harness
benchmark_http.py
Prompt / output
128 / 128 tokens
Context
8192
Concurrency
1
Date
Not reported
Full record →
Quantizations and software

Quantizations: IQ4_XS, Q4_K_M, Q4_K_S
Engines: llama.cpp, Paiton + vLLM

Explore all 102 results →

This is a selection across sources, not a ranking or a matched experiment. Reading benchmark reports

GPU benchmark pages: R9700