View ReportGeneric LLM | Llama-3.1-Tulu-3-8BQ8_0Model ref. ↗ | Token speed | — | — | 70.36 tok/sGeneration · mean · per request | 1 × R9700Single GPU · 32 GB VRAM/GPUConfiguration- Memory
- 32 GB VRAM/GPU
- OS
- Ubuntu 24.04
- Engine
- llama.cpp
- Backend
- Vulkan / Mesa RADV
- Harness
- Not reported
- Prompt / output
- ? / 128 tokens
- Context
- Not reported
- Concurrency
- Not reported
- Date
- 2025-11-18
Full record → |
|---|
View ReportGeneric LLM | Llama-3.1-Tulu-3-8BQ8_0Model ref. ↗ | Token speed | — | 4,453.54 tok/sPrefill · mean · per request | — | 1 × R9700Single GPU · 32 GB VRAM/GPUConfiguration- Memory
- 32 GB VRAM/GPU
- OS
- Ubuntu 24.04
- Engine
- llama.cpp
- Backend
- ROCm 7.0.0
- Harness
- Not reported
- Prompt / output
- 2048 / ? tokens
- Context
- Not reported
- Concurrency
- Not reported
- Date
- 2026-05-14
Full record → |
|---|
View Reportllama-bench | Llama-3.1-Tulu-3-8BQ8_0Model ref. ↗ | Token speed | — | — | 71.3 tok/sGeneration · mean · per request | 1 × RX 9070 XTSingle GPU · 16 GB VRAM/GPUConfiguration- Memory
- 16 GB VRAM/GPU
- OS
- Ubuntu 26.04 LTS / Linux 7.0
- Engine
- llama.cpp
- Backend
- Vulkan
- Harness
- Phoronix Test Suite / llama-bench
- Prompt / output
- 0 / 128 tokens
- Context
- Not reported
- Concurrency
- Not reported
- Date
- 2026-06-01
Full record → |
|---|
View Reportllama-bench | Llama-3.1-Tulu-3-8BQ8_0Model ref. ↗ | Token speed | — | 2,969.08 tok/sPrefill · mean · per request | — | 1 × RX 7900 XTXSingle GPU · 24 GB VRAM/GPUConfiguration- Memory
- 24 GB VRAM/GPU
- OS
- Ubuntu 26.04 / Linux7.0
- Engine
- llama.cpp
- Backend
- Vulkan
- Harness
- Phoronix Test Suite / llama-bench
- Prompt / output
- 2048 / 0 tokens
- Context
- Not reported
- Concurrency
- 1
- Date
- Not reported
Full record → |
|---|
View ReportGeneric LLM | Llama-3.1-Tulu-3-8BQ8_0Model ref. ↗ | Token speed | — | — | 64.6 tok/sGeneration · mean · per request | 1 × R9700Single GPU · 32 GB VRAM/GPUConfiguration- Memory
- 32 GB VRAM/GPU
- OS
- Ubuntu 24.04
- Engine
- llama.cpp
- Backend
- HIP / ROCm 7.1
- Harness
- Not reported
- Prompt / output
- ? / 128 tokens
- Context
- Not reported
- Concurrency
- Not reported
- Date
- 2025-11-18
Full record → |
|---|
View ReportGeneric LLM | Llama-3.1-Tulu-3-8BQ8_0Model ref. ↗ | Token speed | — | 4,448.64 tok/sPrefill · mean · per request | — | 1 × R9700Single GPU · 32 GB VRAM/GPUConfiguration- Memory
- 32 GB VRAM/GPU
- OS
- Ubuntu 24.04
- Engine
- llama.cpp
- Backend
- ROCm 7.2.3
- Harness
- Not reported
- Prompt / output
- 2048 / ? tokens
- Context
- Not reported
- Concurrency
- Not reported
- Date
- 2026-05-14
Full record → |
|---|
View Reportllama-bench | Llama-3.1-Tulu-3-8BQ8_0Model ref. ↗ | Token speed | — | — | 70.6 tok/sGeneration · mean · per request | 1 × RX 9070Single GPU · 16 GB VRAM/GPUConfiguration- Memory
- 16 GB VRAM/GPU
- OS
- Ubuntu 26.04 LTS / Linux 7.0
- Engine
- llama.cpp
- Backend
- Vulkan
- Harness
- Phoronix Test Suite / llama-bench
- Prompt / output
- 0 / 128 tokens
- Context
- Not reported
- Concurrency
- Not reported
- Date
- 2026-06-01
Full record → |
|---|
View Reportllama-bench | Llama-3.1-Tulu-3-8BQ8_0Model ref. ↗ | Token speed | — | 2,671.96 tok/sPrefill · mean · per request | — | 1 × RX 7900 XTSingle GPU · 20 GB VRAM/GPUConfiguration- Memory
- 20 GB VRAM/GPU
- OS
- Ubuntu 26.04 / Linux7.0
- Engine
- llama.cpp
- Backend
- Vulkan
- Harness
- Phoronix Test Suite / llama-bench
- Prompt / output
- 2048 / 0 tokens
- Context
- Not reported
- Concurrency
- 1
- Date
- Not reported
Full record → |
|---|
View ReportGeneric LLM | Llama-3.1-Tulu-3-8BQ8_0Model ref. ↗ | Token speed | — | 3,472.28 tok/sPrefill · mean · per request | — | 1 × R9700Single GPU · 32 GB VRAM/GPUConfiguration- Memory
- 32 GB VRAM/GPU
- OS
- Ubuntu 24.04
- Engine
- llama.cpp
- Backend
- Vulkan / Mesa RADV
- Harness
- Not reported
- Prompt / output
- 512 / ? tokens
- Context
- Not reported
- Concurrency
- Not reported
- Date
- 2025-11-18
Full record → |
|---|
View Reportllama-bench | Llama-3.1-Tulu-3-8BQ8_0Model ref. ↗ | Token speed | — | — | 49.34 tok/sGeneration · mean · per request | 1 × RX 9070 GRESingle GPU · 12 GB VRAM/GPUConfiguration- Memory
- 12 GB VRAM/GPU
- OS
- Ubuntu 26.04 LTS / Linux 7.0
- Engine
- llama.cpp
- Backend
- Vulkan
- Harness
- Phoronix Test Suite / llama-bench
- Prompt / output
- 0 / 128 tokens
- Context
- Not reported
- Concurrency
- Not reported
- Date
- 2026-06-01
Full record → |
|---|
View Reportllama-bench | Llama-3.1-Tulu-3-8BQ8_0Model ref. ↗ | Token speed | — | 2,230.33 tok/sPrefill · mean · per request | — | 1 × RX 7900 GRESingle GPU · 16 GB VRAM/GPUConfiguration- Memory
- 16 GB VRAM/GPU
- OS
- Ubuntu 26.04 / Linux7.0
- Engine
- llama.cpp
- Backend
- Vulkan
- Harness
- Phoronix Test Suite / llama-bench
- Prompt / output
- 2048 / 0 tokens
- Context
- Not reported
- Concurrency
- 1
- Date
- Not reported
Full record → |
|---|
View ReportGeneric LLM | Llama-3.1-Tulu-3-8BQ8_0Model ref. ↗ | Token speed | — | 4,074.41 tok/sPrefill · mean · per request | — | 1 × R9700Single GPU · 32 GB VRAM/GPUConfiguration- Memory
- 32 GB VRAM/GPU
- OS
- Ubuntu 24.04
- Engine
- llama.cpp
- Backend
- HIP / ROCm 7.1
- Harness
- Not reported
- Prompt / output
- 512 / ? tokens
- Context
- Not reported
- Concurrency
- Not reported
- Date
- 2025-11-18
Full record → |
|---|
View Reportllama-bench | Llama-3.1-Tulu-3-8BQ8_0Model ref. ↗ | Token speed | — | 4,289.08 tok/sPrefill · mean · per request | — | 1 × RX 9070 XTSingle GPU · 16 GB VRAM/GPUConfiguration- Memory
- 16 GB VRAM/GPU
- OS
- Ubuntu 26.04 LTS / Linux 7.0
- Engine
- llama.cpp
- Backend
- Vulkan
- Harness
- Phoronix Test Suite / llama-bench
- Prompt / output
- 2048 / 0 tokens
- Context
- Not reported
- Concurrency
- Not reported
- Date
- 2026-06-01
Full record → |
|---|
View Reportllama-bench | Llama-3.1-Tulu-3-8BQ8_0Model ref. ↗ | Token speed | — | 1,813.28 tok/sPrefill · mean · per request | — | 1 × RX 7800 XTSingle GPU · 16 GB VRAM/GPUConfiguration- Memory
- 16 GB VRAM/GPU
- OS
- Ubuntu 26.04 / Linux7.0
- Engine
- llama.cpp
- Backend
- Vulkan
- Harness
- Phoronix Test Suite / llama-bench
- Prompt / output
- 2048 / 0 tokens
- Context
- Not reported
- Concurrency
- 1
- Date
- Not reported
Full record → |
|---|
View ReportGeneric LLM | Llama-3.1-Tulu-3-8BQ8_0Model ref. ↗ | Token speed | — | 3,311.71 tok/sPrefill · mean · per request | — | 1 × R9700Single GPU · 32 GB VRAM/GPUConfiguration- Memory
- 32 GB VRAM/GPU
- OS
- Ubuntu 24.04
- Engine
- llama.cpp
- Backend
- Vulkan / Mesa RADV
- Harness
- Not reported
- Prompt / output
- 1024 / ? tokens
- Context
- Not reported
- Concurrency
- Not reported
- Date
- 2025-11-18
Full record → |
|---|
View Reportllama-bench | Llama-3.1-Tulu-3-8BQ8_0Model ref. ↗ | Token speed | — | 3,479.01 tok/sPrefill · mean · per request | — | 1 × RX 9070Single GPU · 16 GB VRAM/GPUConfiguration- Memory
- 16 GB VRAM/GPU
- OS
- Ubuntu 26.04 LTS / Linux 7.0
- Engine
- llama.cpp
- Backend
- Vulkan
- Harness
- Phoronix Test Suite / llama-bench
- Prompt / output
- 2048 / 0 tokens
- Context
- Not reported
- Concurrency
- Not reported
- Date
- 2026-06-01
Full record → |
|---|
View Reportllama-bench | Llama-3.1-Tulu-3-8BQ8_0Model ref. ↗ | Token speed | — | — | 93.35 tok/sGeneration · mean · per request | 1 × RX 7900 XTXSingle GPU · 24 GB VRAM/GPUConfiguration- Memory
- 24 GB VRAM/GPU
- OS
- Ubuntu 26.04 / Linux7.0
- Engine
- llama.cpp
- Backend
- Vulkan
- Harness
- Phoronix Test Suite / llama-bench
- Prompt / output
- 0 / 128 tokens
- Context
- Not reported
- Concurrency
- 1
- Date
- Not reported
Full record → |
|---|
View ReportGeneric LLM | Llama-3.1-Tulu-3-8BQ8_0Model ref. ↗ | Token speed | — | 3,921.43 tok/sPrefill · mean · per request | — | 1 × R9700Single GPU · 32 GB VRAM/GPUConfiguration- Memory
- 32 GB VRAM/GPU
- OS
- Ubuntu 24.04
- Engine
- llama.cpp
- Backend
- HIP / ROCm 7.1
- Harness
- Not reported
- Prompt / output
- 1024 / ? tokens
- Context
- Not reported
- Concurrency
- Not reported
- Date
- 2025-11-18
Full record → |
|---|
View Reportllama-bench | Llama-3.1-Tulu-3-8BQ8_0Model ref. ↗ | Token speed | — | 2,961.98 tok/sPrefill · mean · per request | — | 1 × RX 9070 GRESingle GPU · 12 GB VRAM/GPUConfiguration- Memory
- 12 GB VRAM/GPU
- OS
- Ubuntu 26.04 LTS / Linux 7.0
- Engine
- llama.cpp
- Backend
- Vulkan
- Harness
- Phoronix Test Suite / llama-bench
- Prompt / output
- 2048 / 0 tokens
- Context
- Not reported
- Concurrency
- Not reported
- Date
- 2026-06-01
Full record → |
|---|
View Reportllama-bench | Llama-3.1-Tulu-3-8BQ8_0Model ref. ↗ | Token speed | — | — | 80.9 tok/sGeneration · mean · per request | 1 × RX 7900 XTSingle GPU · 20 GB VRAM/GPUConfiguration- Memory
- 20 GB VRAM/GPU
- OS
- Ubuntu 26.04 / Linux7.0
- Engine
- llama.cpp
- Backend
- Vulkan
- Harness
- Phoronix Test Suite / llama-bench
- Prompt / output
- 0 / 128 tokens
- Context
- Not reported
- Concurrency
- 1
- Date
- Not reported
Full record → |
|---|
View ReportGeneric LLM | Llama-3.1-Tulu-3-8BQ8_0Model ref. ↗ | Token speed | — | 3,047.51 tok/sPrefill · mean · per request | — | 1 × R9700Single GPU · 32 GB VRAM/GPUConfiguration- Memory
- 32 GB VRAM/GPU
- OS
- Ubuntu 24.04
- Engine
- llama.cpp
- Backend
- Vulkan / Mesa RADV
- Harness
- Not reported
- Prompt / output
- 2048 / ? tokens
- Context
- Not reported
- Concurrency
- Not reported
- Date
- 2025-11-18
Full record → |
|---|
View Reportllama-bench | Llama-3.1-Tulu-3-8BQ8_0Model ref. ↗ | Power & energy2K input · 0 output | 36 WPower draw · Per GPU | — | — | 1 × RX 9070 GRESingle GPU · 12 GB VRAM/GPUConfiguration- Memory
- 12 GB VRAM/GPU
- OS
- Ubuntu 26.04 LTS / Linux 7.0
- Engine
- llama.cpp
- Backend
- Vulkan
- Harness
- Phoronix Test Suite / llama-bench
- Prompt / output
- 2048 / 0 tokens
- Context
- Not reported
- Concurrency
- Not reported
- Date
- 2026-06-01
Full record → |
|---|
View Reportllama-bench | Llama-3.1-Tulu-3-8BQ8_0Model ref. ↗ | Token speed | — | — | 65.95 tok/sGeneration · mean · per request | 1 × RX 7800 XTSingle GPU · 16 GB VRAM/GPUConfiguration- Memory
- 16 GB VRAM/GPU
- OS
- Ubuntu 26.04 / Linux7.0
- Engine
- llama.cpp
- Backend
- Vulkan
- Harness
- Phoronix Test Suite / llama-bench
- Prompt / output
- 0 / 128 tokens
- Context
- Not reported
- Concurrency
- 1
- Date
- Not reported
Full record → |
|---|
View ReportGeneric LLM | Llama-3.1-Tulu-3-8BQ8_0Model ref. ↗ | Token speed | — | 3,597.95 tok/sPrefill · mean · per request | — | 1 × R9700Single GPU · 32 GB VRAM/GPUConfiguration- Memory
- 32 GB VRAM/GPU
- OS
- Ubuntu 24.04
- Engine
- llama.cpp
- Backend
- HIP / ROCm 7.1
- Harness
- Not reported
- Prompt / output
- 2048 / ? tokens
- Context
- Not reported
- Concurrency
- Not reported
- Date
- 2025-11-18
Full record → |
|---|