llama 8B on AMD GPUs
6 results · 2 sources · 6 measurements
Grouped by reported model identity. Exact weights, quantizations and software can differ. How results are reviewed
Documented results
6 selected tests | | | | | | |
|---|
View
Reportllama-bench | llama 8BQ4_0Repository unresolved | Token speed512 input tokens · 0 output tokens · 8,192 existing KV tokens | — | 763.53 tok/sPrefill · mean · per request | — | 1 × RX 7800 XTSingle GPU · 16 GB VRAM/GPUConfiguration- Memory
- 16 GB VRAM/GPU
- OS
- Windows11 Pro10.0.26200
- Engine
- llama.cpp
- Backend
- Vulkan
- Harness
- RigRoute standard-ai-v0.1 / llama-bench
- Prompt / output
- 512 / 0 tokens
- Context
- Not reported
- Concurrency
- 1
- Date
- 2026-09-28
Full record → |
|---|
View
Reportllama-bench | llama 8BQ8_0Repository unresolved | Token speed | — | 3,696.8 tok/sPrefill · per request | — | 1 × RX 9070 XTSingle GPU · 16 GB VRAM/GPUConfiguration- Memory
- 16 GB VRAM/GPU
- OS
- Windows
- Engine
- LLAMA-DX / llama.cpp fork
- Backend
- Vulkan
- Harness
- llama-bench
- Prompt / output
- 512 / 0 tokens
- Context
- Not reported
- Concurrency
- Not reported
- Date
- 2026-07-20
Full record → |
|---|
View
Reportllama-bench | llama 8BQ4_0Repository unresolved | Token speed0 input tokens · 128 output tokens · 8,192 existing KV tokens | — | — | 74.81 tok/sGeneration · mean · per request | 1 × RX 7800 XTSingle GPU · 16 GB VRAM/GPUConfiguration- Memory
- 16 GB VRAM/GPU
- OS
- Windows11 Pro10.0.26200
- Engine
- llama.cpp
- Backend
- Vulkan
- Harness
- RigRoute standard-ai-v0.1 / llama-bench
- Prompt / output
- 0 / 128 tokens
- Context
- Not reported
- Concurrency
- 1
- Date
- 2026-09-28
Full record → |
|---|
View
Reportllama-bench | llama 8BQ8_0Repository unresolved | Token speed | — | — | 71.71 tok/sGeneration · per request | 1 × RX 9070 XTSingle GPU · 16 GB VRAM/GPUConfiguration- Memory
- 16 GB VRAM/GPU
- OS
- Windows
- Engine
- LLAMA-DX / llama.cpp fork
- Backend
- Vulkan
- Harness
- llama-bench
- Prompt / output
- 0 / 128 tokens
- Context
- Not reported
- Concurrency
- Not reported
- Date
- 2026-07-20
Full record → |
|---|
View
Reportllama-bench | llama 8BQ8_0Repository unresolved | Token speed | — | 513.08 tok/sPrefill · per request | — | 1 × RX 9070 XTSingle GPU · 16 GB VRAM/GPUConfiguration- Memory
- 16 GB VRAM/GPU
- OS
- Windows
- Engine
- LLAMA-DX / llama.cpp fork
- Backend
- DirectX 12
- Harness
- llama-bench
- Prompt / output
- 512 / 0 tokens
- Context
- Not reported
- Concurrency
- Not reported
- Date
- 2026-07-20
Full record → |
|---|
View
Reportllama-bench | llama 8BQ8_0Repository unresolved | Token speed | — | — | 49.65 tok/sGeneration · per request | 1 × RX 9070 XTSingle GPU · 16 GB VRAM/GPUConfiguration- Memory
- 16 GB VRAM/GPU
- OS
- Windows
- Engine
- LLAMA-DX / llama.cpp fork
- Backend
- DirectX 12
- Harness
- llama-bench
- Prompt / output
- 0 / 128 tokens
- Context
- Not reported
- Concurrency
- Not reported
- Date
- 2026-07-20
Full record → |
|---|
Quantizations and software
Quantizations: Q4_0, Q8_0
Engines: LLAMA-DX / llama.cpp fork, llama.cpp
This is a selection across sources, not a ranking or a matched experiment. Reading benchmark reports
GPU benchmark pages: RX 9070 XT · RX 7800 XT