Qwen2.5-Coder-14B-Instruct on AMD GPUs

18 results · 2 sources · 23 measurements

Grouped by reported model identity. Exact weights, quantizations and software can differ. How results are reviewed

Documented results

18 selected tests


View ReportGeneric LLM	Qwen2.5-Coder-14B-InstructQ4_0Model ref. ↗	Token speed	—	~400 tok/sPrefill · range lower · per request ~800 tok/sPrefill · range upper · per request	~35 tok/sGeneration · range lower · per request ~38 tok/sGeneration · range upper · per request	1 × RX 7700 XTSingle GPU · 12 GB VRAM/GPU Configuration Memory 12 GB VRAM/GPU OS Windows 11 Engine llama.cpp Backend ROCm / HIP Harness Author daily-use timing Prompt / output ? / ? tokens Context 32768 Concurrency Not reported Date Not reported Full record →
View Reportllama-bench	Qwen2.5-Coder-14B-InstructQ4_K_MWeights ↗	Token speed	—	1,232.42 tok/sPrefill · mean · per request	—	1 × RX 9060 XTSingle GPU · 16 GB VRAM/GPU Configuration Memory 16 GB VRAM/GPU OS CachyOS / kernel 7.1.3-2-cachyos Engine llama.cpp Backend ROCm / HIP Harness llama-bench Prompt / output 512 / 0 tokens Context Not reported Concurrency Not reported Date 2026-07-18 Full record →
View ReportGeneric LLM	Qwen2.5-Coder-14B-InstructQ4_0Model ref. ↗	Token speed	—	~400 tok/sPrefill · range lower · per request ~700 tok/sPrefill · range upper · per request	~35 tok/sGeneration · per request	1 × RX 7700 XTSingle GPU · 12 GB VRAM/GPU Configuration Memory 12 GB VRAM/GPU OS Windows 11 Engine llama.cpp Backend ROCm / HIP Harness Author daily-use timing Prompt / output ? / ? tokens Context 32768 Concurrency Not reported Date Not reported Full record →
View Reportllama-bench	Qwen2.5-Coder-14B-InstructQ4_K_MWeights ↗	Token speed	—	—	31.33 tok/sGeneration · mean · per request	1 × RX 9060 XTSingle GPU · 16 GB VRAM/GPU Configuration Memory 16 GB VRAM/GPU OS CachyOS / kernel 7.1.3-2-cachyos Engine llama.cpp Backend ROCm / HIP Harness llama-bench Prompt / output 0 / 128 tokens Context Not reported Concurrency Not reported Date 2026-07-18 Full record →
View Reportllama-bench	Qwen2.5-Coder-14B-InstructQ4_K_MWeights ↗	Token speed	—	1,257.44 tok/sPrefill · mean · per request	—	1 × RX 9060 XTSingle GPU · 16 GB VRAM/GPU Configuration Memory 16 GB VRAM/GPU OS CachyOS / kernel 7.1.3-2-cachyos Engine llama.cpp Backend Vulkan Harness llama-bench Prompt / output 512 / 0 tokens Context Not reported Concurrency Not reported Date 2026-07-18 Full record →
View Reportllama-bench	Qwen2.5-Coder-14B-InstructQ4_K_MWeights ↗	Token speed	—	—	33.44 tok/sGeneration · mean · per request	1 × RX 9060 XTSingle GPU · 16 GB VRAM/GPU Configuration Memory 16 GB VRAM/GPU OS CachyOS / kernel 7.1.3-2-cachyos Engine llama.cpp Backend Vulkan Harness llama-bench Prompt / output 0 / 128 tokens Context Not reported Concurrency Not reported Date 2026-07-18 Full record →
View Reportllama-bench	Qwen2.5-Coder-14B-InstructQ5_K_MWeights ↗	Token speed	—	1,141.48 tok/sPrefill · mean · per request	—	1 × RX 9060 XTSingle GPU · 16 GB VRAM/GPU Configuration Memory 16 GB VRAM/GPU OS CachyOS / kernel 7.1.3-2-cachyos Engine llama.cpp Backend ROCm / HIP Harness llama-bench Prompt / output 512 / 0 tokens Context Not reported Concurrency Not reported Date 2026-07-18 Full record →
View Reportllama-bench	Qwen2.5-Coder-14B-InstructQ5_K_MWeights ↗	Token speed	—	—	28.12 tok/sGeneration · mean · per request	1 × RX 9060 XTSingle GPU · 16 GB VRAM/GPU Configuration Memory 16 GB VRAM/GPU OS CachyOS / kernel 7.1.3-2-cachyos Engine llama.cpp Backend ROCm / HIP Harness llama-bench Prompt / output 0 / 128 tokens Context Not reported Concurrency Not reported Date 2026-07-18 Full record →
View Reportllama-bench	Qwen2.5-Coder-14B-InstructQ5_K_MWeights ↗	Token speed	—	1,207.39 tok/sPrefill · mean · per request	—	1 × RX 9060 XTSingle GPU · 16 GB VRAM/GPU Configuration Memory 16 GB VRAM/GPU OS CachyOS / kernel 7.1.3-2-cachyos Engine llama.cpp Backend Vulkan Harness llama-bench Prompt / output 512 / 0 tokens Context Not reported Concurrency Not reported Date 2026-07-18 Full record →
View Reportllama-bench	Qwen2.5-Coder-14B-InstructQ5_K_MWeights ↗	Token speed	—	—	28.84 tok/sGeneration · mean · per request	1 × RX 9060 XTSingle GPU · 16 GB VRAM/GPU Configuration Memory 16 GB VRAM/GPU OS CachyOS / kernel 7.1.3-2-cachyos Engine llama.cpp Backend Vulkan Harness llama-bench Prompt / output 0 / 128 tokens Context Not reported Concurrency Not reported Date 2026-07-18 Full record →
View Reportllama-bench	Qwen2.5-Coder-14B-InstructQ8_0Weights ↗	Token speed	—	1,405.74 tok/sPrefill · mean · per request	—	1 × RX 9060 XTSingle GPU · 16 GB VRAM/GPU Configuration Memory 16 GB VRAM/GPU OS CachyOS / kernel 7.1.3-2-cachyos Engine llama.cpp Backend ROCm / HIP Harness llama-bench Prompt / output 512 / 0 tokens Context Not reported Concurrency Not reported Date 2026-07-18 Full record →
View Reportllama-bench	Qwen2.5-Coder-14B-InstructQ8_0Weights ↗	Token speed	—	—	19.9 tok/sGeneration · mean · per request	1 × RX 9060 XTSingle GPU · 16 GB VRAM/GPU Configuration Memory 16 GB VRAM/GPU OS CachyOS / kernel 7.1.3-2-cachyos Engine llama.cpp Backend ROCm / HIP Harness llama-bench Prompt / output 0 / 128 tokens Context Not reported Concurrency Not reported Date 2026-07-18 Full record →
View Reportllama-bench	Qwen2.5-Coder-14B-InstructQ8_0Weights ↗	Token speed	—	1,287.98 tok/sPrefill · mean · per request	—	1 × RX 9060 XTSingle GPU · 16 GB VRAM/GPU Configuration Memory 16 GB VRAM/GPU OS CachyOS / kernel 7.1.3-2-cachyos Engine llama.cpp Backend Vulkan Harness llama-bench Prompt / output 512 / 0 tokens Context Not reported Concurrency Not reported Date 2026-07-18 Full record →
View Reportllama-bench	Qwen2.5-Coder-14B-InstructQ8_0Weights ↗	Token speed	—	—	20.2 tok/sGeneration · mean · per request	1 × RX 9060 XTSingle GPU · 16 GB VRAM/GPU Configuration Memory 16 GB VRAM/GPU OS CachyOS / kernel 7.1.3-2-cachyos Engine llama.cpp Backend Vulkan Harness llama-bench Prompt / output 0 / 128 tokens Context Not reported Concurrency Not reported Date 2026-07-18 Full record →
View Reportllama-bench	Qwen2.5-Coder-14B-InstructQ4_K_MModel ref. ↗	Token speed	—	1,211.32 tok/sPrefill · mean · per request	—	1 × RX 9060 XTSingle GPU · 16 GB VRAM/GPU Configuration Memory 16 GB VRAM/GPU OS CachyOS / kernel 7.1.3-2-cachyos Engine llama.cpp Backend ROCm / HIP Harness llama-bench Prompt / output 512 / 0 tokens Context Not reported Concurrency Not reported Date Not reported Full record →
View Reportllama-bench	Qwen2.5-Coder-14B-InstructQ4_K_MModel ref. ↗	Token speed	—	—	30.79 tok/sGeneration · mean · per request	1 × RX 9060 XTSingle GPU · 16 GB VRAM/GPU Configuration Memory 16 GB VRAM/GPU OS CachyOS / kernel 7.1.3-2-cachyos Engine llama.cpp Backend ROCm / HIP Harness llama-bench Prompt / output 0 / 128 tokens Context Not reported Concurrency Not reported Date Not reported Full record →
View Reportllama-bench	Qwen2.5-Coder-14B-InstructQ4_K_MModel ref. ↗	Token speed	—	1,210.29 tok/sPrefill · mean · per request	—	1 × RX 9060 XTSingle GPU · 16 GB VRAM/GPU Configuration Memory 16 GB VRAM/GPU OS CachyOS / kernel 7.1.3-2-cachyos Engine llama.cpp Backend Vulkan Harness llama-bench Prompt / output 512 / 0 tokens Context Not reported Concurrency Not reported Date Not reported Full record →
View Reportllama-bench	Qwen2.5-Coder-14B-InstructQ4_K_MModel ref. ↗	Token speed	—	—	33.51 tok/sGeneration · mean · per request	1 × RX 9060 XTSingle GPU · 16 GB VRAM/GPU Configuration Memory 16 GB VRAM/GPU OS CachyOS / kernel 7.1.3-2-cachyos Engine llama.cpp Backend Vulkan Harness llama-bench Prompt / output 0 / 128 tokens Context Not reported Concurrency Not reported Date Not reported Full record →

Quantizations and software

Quantizations: Q4_0, Q4_K_M, Q5_K_M, Q8_0
Engines: llama.cpp

Explore all 18 results →

This is a selection across sources, not a ranking or a matched experiment. Reading benchmark reports

GPU benchmark pages: RX 9060 XT · RX 7700 XT