Grouped by reported model identity. Exact weights, quantizations and software can differ. How results are reviewed
Documented results
24 selected tests| View ReportServing benchmark | DeepSeek-R1-Distill-Llama-8BConflicting evidence | Token speed | 34.5 tok/sThroughput · per request | — | — | 1 × R9700Single GPU · 32 GB VRAM/GPUConfiguration
|
|---|---|---|---|---|---|---|
| View ReportGeneric LLM | DeepSeek-R1-Distill-Llama-8B | Token speed | — | — | 70.35 tok/sGeneration · mean · per request | 1 × R9700Single GPU · 32 GB VRAM/GPUConfiguration
|
| View Reportllama-bench | DeepSeek-R1-Distill-Llama-8B | Token speed | — | — | 71.31 tok/sGeneration · mean · per request | 1 × RX 9070 XTSingle GPU · 16 GB VRAM/GPUConfiguration
|
| View Reportllama-bench | DeepSeek-R1-Distill-Llama-8B | Token speed | — | 2,970.26 tok/sPrefill · mean · per request | — | 1 × RX 7900 XTXSingle GPU · 24 GB VRAM/GPUConfiguration
|
| View ReportGeneric LLM | DeepSeek-R1-Distill-Llama-8B | Token speed | 7,558.36 tok/sTotal throughput · mean · aggregate | — | — | 2 × R9700Multi-GPU · split unknown · 32 GB VRAM/GPUConfiguration
|
| View ReportGeneric LLM | DeepSeek-R1-Distill-Llama-8B | Token speed | 138 tok/sThroughput · mean · unknown | — | — | 2 × R9700Tensor parallel · 32 GB VRAM/GPUConfiguration
|
| View ReportGeneric LLM | DeepSeek-R1-Distill-Llama-8B | Token speed | 77 tok/sThroughput · unknown | — | — | 1 × R9700Single GPU · 32 GB VRAM/GPUConfiguration
|
| View ReportGeneric LLM | DeepSeek-R1-Distill-Llama-8B | Relative performance | 1.58 x vs RTX 4500 BlackwellRelative performance per dollar · Whole system | — | — | 1 × R9700Single GPU · 32 GB VRAM/GPUConfiguration
|
| View ReportServing benchmark | DeepSeek-R1-Distill-Llama-8BConflicting evidence | Token speed | 129 tok/sThroughput · aggregate | — | — | 1 × R9700Single GPU · 32 GB VRAM/GPUConfiguration
|
| View ReportGeneric LLM | DeepSeek-R1-Distill-Llama-8B | Token speed | — | — | 64.72 tok/sGeneration · mean · per request | 1 × R9700Single GPU · 32 GB VRAM/GPUConfiguration
|
| View Reportllama-bench | DeepSeek-R1-Distill-Llama-8B | Token speed | — | — | 70.65 tok/sGeneration · mean · per request | 1 × RX 9070Single GPU · 16 GB VRAM/GPUConfiguration
|
| View Reportllama-bench | DeepSeek-R1-Distill-Llama-8B | Token speed | — | 2,671.84 tok/sPrefill · mean · per request | — | 1 × RX 7900 XTSingle GPU · 20 GB VRAM/GPUConfiguration
|
| View ReportGeneric LLM | DeepSeek-R1-Distill-Llama-8B | Token speed | 5,548.9 tok/sTotal throughput · mean · aggregate | — | — | 1 × R9700Single GPU · 32 GB VRAM/GPUConfiguration
|
| View ReportGeneric LLM | DeepSeek-R1-Distill-Llama-8B | Token speed | 56 tok/sThroughput · unknown | — | — | 1 × R9700Single GPU · 32 GB VRAM/GPUConfiguration
|
| View ReportGeneric LLM | DeepSeek-R1-Distill-Llama-8B | Relative performance | 1.77 x vs RTX 4500 BlackwellRelative performance per dollar · Whole system | — | — | 1 × R9700Single GPU · 32 GB VRAM/GPUConfiguration
|
| View ReportServing benchmark | DeepSeek-R1-Distill-Llama-8BConflicting evidence | Token speed | 174 tok/sThroughput · aggregate | — | — | 1 × R9700Single GPU · 32 GB VRAM/GPUConfiguration
|
| View ReportGeneric LLM | DeepSeek-R1-Distill-Llama-8B | Token speed | — | 3,466.2 tok/sPrefill · mean · per request | — | 1 × R9700Single GPU · 32 GB VRAM/GPUConfiguration
|
| View Reportllama-bench | DeepSeek-R1-Distill-Llama-8B | Token speed | — | — | 49.33 tok/sGeneration · mean · per request | 1 × RX 9070 GRESingle GPU · 12 GB VRAM/GPUConfiguration
|
| View Reportllama-bench | DeepSeek-R1-Distill-Llama-8B | Token speed | — | 2,234.19 tok/sPrefill · mean · per request | — | 1 × RX 7900 GRESingle GPU · 16 GB VRAM/GPUConfiguration
|
| View ReportGeneric LLM | DeepSeek-R1-Distill-Llama-8B | Token speed | 858.58 tok/sThroughput · mean · aggregate | — | — | 2 × R9700Multi-GPU · split unknown · 32 GB VRAM/GPUConfiguration
|
| View ReportServing benchmark | DeepSeek-R1-Distill-Llama-8BConflicting evidence | Latency1 concurrent request | 111 msTime to first token · Per request | — | — | 1 × R9700Single GPU · 32 GB VRAM/GPUConfiguration
|
| View ReportGeneric LLM | DeepSeek-R1-Distill-Llama-8B | Token speed | — | 4,048.83 tok/sPrefill · mean · per request | — | 1 × R9700Single GPU · 32 GB VRAM/GPUConfiguration
|
| View Reportllama-bench | DeepSeek-R1-Distill-Llama-8B | Token speed | — | 4,287.95 tok/sPrefill · mean · per request | — | 1 × RX 9070 XTSingle GPU · 16 GB VRAM/GPUConfiguration
|
| View Reportllama-bench | DeepSeek-R1-Distill-Llama-8B | Token speed | — | 1,811.3 tok/sPrefill · mean · per request | — | 1 × RX 7800 XTSingle GPU · 16 GB VRAM/GPUConfiguration
|
Quantizations and software
Quantizations: FP8, FP8 dynamic, FP8-dynamic, FP16, Q8_0
Engines: llama.cpp, vLLM
This is a selection across sources, not a ranking or a matched experiment. Reading benchmark reports
GPU benchmark pages: W7900 · R9700 · RX 9070 XT · RX 9070 · RX 9070 GRE · RX 7900 XTX · RX 7900 XT · RX 7900 GRE · RX 7800 XT