Llama-2-13b-chat on AMD GPUs
8 results · 3 sources · 20 measurements
Grouped by reported model identity. Exact weights, quantizations and software can differ. How results are reviewed
Documented results
8 selected tests | | | | | | |
|---|
View
ReportGeneric LLM | Llama-2-13b-chatQuant not reportedModel ref. ↗ | Procyon | — | — | 34.65 tok/sGeneration · per request | 1 × RX 9060 XTSingle GPU · 16 GB VRAM/GPUConfiguration- Memory
- 16 GB VRAM/GPU
- OS
- Windows 11 Pro for Workstations
- Engine
- ONNX Runtime
- Backend
- DirectML
- Harness
- Procyon
- Prompt / output
- ? / ? tokens
- Context
- Not reported
- Concurrency
- Not reported
- Date
- 2025-06-04
Full record → |
|---|
View
ReportGeneric LLM | Llama-2-13b-chatQuant not reportedModel ref. ↗ | Procyon | — | — | 25.58 tok/sGeneration · per request | 1 × RX 9070 GRESingle GPU · 12 GB VRAM/GPUConfiguration- Memory
- 12 GB VRAM/GPU
- OS
- Windows 11 Pro for Workstations
- Engine
- ONNX Runtime
- Backend
- DirectML
- Harness
- Procyon
- Prompt / output
- ? / ? tokens
- Context
- Not reported
- Concurrency
- Not reported
- Date
- 2026-06-01
Full record → |
|---|
View
ReportGeneric LLM | Llama-2-13b-chatQuant not reportedModel ref. ↗ | Procyon1.0.191 | — | — | 61 tok/sGeneration · mean · per request | 1 × R9700Single GPU · 32 GB VRAM/GPUConfiguration- Memory
- 32 GB VRAM/GPU
- OS
- Windows (inferred; version unreported) (inferred)
- Engine
- Procyon AI Text Generation / ONNXRuntime-DirectML
- Backend
- DirectML
- Harness
- Procyon
- Prompt / output
- ? / ? tokens
- Context
- Not reported
- Concurrency
- Not reported
- Date
- 2026-06-26
Full record → |
|---|
View
ReportGeneric LLM | Llama-2-13b-chatQuant not reportedModel ref. ↗ | Procyon | — | — | 59.67 tok/sGeneration · per request | 1 × RX 9070Single GPU · 16 GB VRAM/GPUConfiguration- Memory
- 16 GB VRAM/GPU
- OS
- Windows 11 Pro for Workstations
- Engine
- ONNX Runtime
- Backend
- DirectML
- Harness
- Procyon
- Prompt / output
- ? / ? tokens
- Context
- Not reported
- Concurrency
- Not reported
- Date
- 2025-06-04
Full record → |
|---|
View
ReportGeneric LLM | Llama-2-13b-chatQuant not reportedModel ref. ↗ | Procyon1.0.191 | 2,356 pointsBenchmark score · Per request | — | — | 1 × R9700Single GPU · 32 GB VRAM/GPUConfiguration- Memory
- 32 GB VRAM/GPU
- OS
- Windows (inferred; version unreported) (inferred)
- Engine
- Procyon AI Text Generation / ONNXRuntime-DirectML
- Backend
- DirectML
- Harness
- Procyon
- Prompt / output
- ? / ? tokens
- Context
- Not reported
- Concurrency
- Not reported
- Date
- 2026-06-26
Full record → |
|---|
View
ReportGeneric LLM | Llama-2-13b-chatQuant not reportedModel ref. ↗ | Procyon | — | — | 61.13 tok/sGeneration · per request | 1 × RX 9070 XTSingle GPU · 16 GB VRAM/GPUConfiguration- Memory
- 16 GB VRAM/GPU
- OS
- Windows 11 Pro for Workstations
- Engine
- ONNX Runtime
- Backend
- DirectML
- Harness
- Procyon
- Prompt / output
- ? / ? tokens
- Context
- Not reported
- Concurrency
- Not reported
- Date
- 2025-06-04
Full record → |
|---|
View
ReportGeneric LLM | Llama-2-13b-chatQuant not reportedModel ref. ↗ | Procyon1.0.191 | 1,490 msTime to first token · Per request | — | — | 1 × R9700Single GPU · 32 GB VRAM/GPUConfiguration- Memory
- 32 GB VRAM/GPU
- OS
- Windows (inferred; version unreported) (inferred)
- Engine
- Procyon AI Text Generation / ONNXRuntime-DirectML
- Backend
- DirectML
- Harness
- Procyon
- Prompt / output
- ? / ? tokens
- Context
- Not reported
- Concurrency
- Not reported
- Date
- 2026-06-26
Full record → |
|---|
View
ReportGeneric LLM | Llama-2-13b-chatQuant not reportedModel ref. ↗ | Procyon1.0.191 | 2,700 msModel load time · Per request | — | — | 1 × R9700Single GPU · 32 GB VRAM/GPUConfiguration- Memory
- 32 GB VRAM/GPU
- OS
- Windows (inferred; version unreported) (inferred)
- Engine
- Procyon AI Text Generation / ONNXRuntime-DirectML
- Backend
- DirectML
- Harness
- Procyon
- Prompt / output
- ? / ? tokens
- Context
- Not reported
- Concurrency
- Not reported
- Date
- 2026-06-26
Full record → |
|---|
Quantizations and software
Quantizations: Not reported
Engines: ONNX Runtime, Procyon AI Text Generation / ONNXRuntime-DirectML
This is a selection across sources, not a ranking or a matched experiment. Reading benchmark reports
GPU benchmark pages: R9700 · RX 9070 XT · RX 9070 · RX 9070 GRE · RX 9060 XT