AMD-Pro-BenchCommunity

13,812 benchmarks in 32 GPU combinations documented

Llama-2-13b on AMD GPUs

13 results · 3 sources · 14 measurements

Explore all results

Grouped by reported model identity. Exact weights, quantizations and software can differ. How results are reviewed

Documented results

13 selected tests
View
ReportGeneric LLM		Llama-2-13bQ4_K_MModel ref. ↗Token speed
35.4 tok/sInput + output · mean · per request
——1 × R9700Single GPU · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Linux; kernel 6.17.5-v8-16k+
Engine
llama.cpp
Backend
Vulkan
Harness
Not reported
Prompt / output
4096 / 128 tokens
Context
Not reported
Concurrency
Not reported
Date
2025-11-24
Full record →
View
ReportGeneric LLM		Llama-2-13bQ4_K_MWeights ↗Token speed——
4.38 tok/sGeneration · per request
1 × W7700Single GPU · 16 GB VRAM/GPU
Configuration
Memory
16 GB VRAM/GPU
OS
Raspberry Pi OS
Engine
llama.cpp
Backend
Vulkan
Harness
Not reported
Prompt / output
? / ? tokens
Context
Not reported
Concurrency
Not reported
Date
Not reported
Full record →
View
ReportGeneric LLM		Llama-2-13bQ4_K_MWeights ↗Token speed——
8.41 tok/sGeneration · per request
1 × W7700Single GPU · 16 GB VRAM/GPU
Configuration
Memory
16 GB VRAM/GPU
OS
Ubuntu 24.04
Engine
llama.cpp
Backend
Vulkan
Harness
llama-cli
Prompt / output
? / ? tokens
Context
Not reported
Concurrency
Not reported
Date
2024-12-10
Full record →
View
ReportGeneric LLM		Llama-2-13bQ4_K_MModel ref. ↗Token speed—
10.1 tok/sPrefill · mean · per request
—1 × R9700Single GPU · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Linux; kernel 6.17.5-v8-16k+
Engine
llama.cpp
Backend
Vulkan
Harness
Not reported
Prompt / output
512 / ? tokens
Context
Not reported
Concurrency
Not reported
Date
2025-11-24
Full record →
View
ReportGeneric LLM		Llama-2-13bQ4_K_MWeights ↗Power & energy
108 WPower draw · Whole system
——1 × W7700Single GPU · 16 GB VRAM/GPU
Configuration
Memory
16 GB VRAM/GPU
OS
Raspberry Pi OS
Engine
llama.cpp
Backend
Vulkan
Harness
Not reported
Prompt / output
? / ? tokens
Context
Not reported
Concurrency
Not reported
Date
Not reported
Full record →
View
ReportGeneric LLM		Llama-2-13bQ4_K_MModel ref. ↗Token speed—
37.95 tok/sPrefill · mean · per request
—1 × R9700Single GPU · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Linux; kernel 6.17.5-v8-16k+
Engine
llama.cpp
Backend
Vulkan
Harness
Not reported
Prompt / output
4096 / ? tokens
Context
Not reported
Concurrency
Not reported
Date
2025-11-24
Full record →
View
ReportGeneric LLM		Llama-2-13bQ4_K_MModel ref. ↗Token speed——
1.79 tok/sGeneration · mean · per request
1 × R9700Single GPU · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Linux; kernel 6.17.5-v8-16k+
Engine
llama.cpp
Backend
Vulkan
Harness
Not reported
Prompt / output
? / 128 tokens
Context
Not reported
Concurrency
Not reported
Date
2025-11-24
Full record →
View
ReportGeneric LLM		Llama-2-13bQ4_K_MModel ref. ↗Token speed
522.4 tok/sInput + output · mean · per request
——1 × R9700Single GPU · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Linux; kernel 6.17.0-6-generic
Engine
llama.cpp
Backend
Vulkan
Harness
Not reported
Prompt / output
4096 / 128 tokens
Context
Not reported
Concurrency
Not reported
Date
2025-11-25
Full record →
View
ReportGeneric LLM		Llama-2-13bQ4_K_MModel ref. ↗Token speed—
1,030.19 tok/sPrefill · mean · per request
—1 × R9700Single GPU · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Linux; kernel 6.17.0-6-generic
Engine
llama.cpp
Backend
Vulkan
Harness
Not reported
Prompt / output
512 / ? tokens
Context
Not reported
Concurrency
Not reported
Date
2025-11-25
Full record →
View
ReportGeneric LLM		Llama-2-13bQ4_K_MModel ref. ↗Token speed—
863.6 tok/sPrefill · mean · per request
—1 × R9700Single GPU · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Linux; kernel 6.17.0-6-generic
Engine
llama.cpp
Backend
Vulkan
Harness
Not reported
Prompt / output
4096 / ? tokens
Context
Not reported
Concurrency
Not reported
Date
2025-11-25
Full record →
View
ReportGeneric LLM		Llama-2-13bQ4_K_MModel ref. ↗Token speed——
58.41 tok/sGeneration · mean · per request
1 × R9700Single GPU · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Linux; kernel 6.17.0-6-generic
Engine
llama.cpp
Backend
Vulkan
Harness
Not reported
Prompt / output
? / 128 tokens
Context
Not reported
Concurrency
Not reported
Date
2025-11-25
Full record →
View
ReportGeneric LLM		Llama-2-13bQ4_K_MModel ref. ↗Power & energy
144.8 WPower draw · Unknown
——1 × R9700Single GPU · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Linux; kernel 6.17.5-v8-16k+
Engine
llama.cpp
Backend
Vulkan
Harness
Not reported
Prompt / output
? / ? tokens
Context
Not reported
Concurrency
Not reported
Date
2025-11-24
Full record →
View
ReportGeneric LLM		Llama-2-13bQ4_K_MModel ref. ↗Power & energy
333.7 WPower draw · Unknown
——1 × R9700Single GPU · 32 GB VRAM/GPU
Configuration
Memory
32 GB VRAM/GPU
OS
Linux; kernel 6.17.0-6-generic
Engine
llama.cpp
Backend
Vulkan
Harness
Not reported
Prompt / output
? / ? tokens
Context
Not reported
Concurrency
Not reported
Date
2025-11-25
Full record →
Quantizations and software

Quantizations: Q4_K_M
Engines: llama.cpp

Explore all 13 results →

This is a selection across sources, not a ranking or a matched experiment. Reading benchmark reports

GPU benchmark pages: W7700 · R9700