Mistral-7B (Procyon) (checkpoint unspecified) on AMD GPUs
4 results · 2 sources · 16 measurements
Grouped by reported model identity. Exact weights, quantizations and software can differ. How results are reviewed
Documented results
4 selected tests| View ReportGeneric LLM | Mistral-7B (Procyon) (checkpoint unspecified) | Procyon | — | — | 65.12 tok/sGeneration · per request | 1 × RX 9060 XTSingle GPU · 16 GB VRAM/GPUConfiguration
|
|---|---|---|---|---|---|---|
| View ReportGeneric LLM | Mistral-7B (Procyon) (checkpoint unspecified) | Procyon | — | — | 76.04 tok/sGeneration · per request | 1 × RX 9070 GRESingle GPU · 12 GB VRAM/GPUConfiguration
|
| View ReportGeneric LLM | Mistral-7B (Procyon) (checkpoint unspecified) | Procyon | — | — | 101.3 tok/sGeneration · per request | 1 × RX 9070Single GPU · 16 GB VRAM/GPUConfiguration
|
| View ReportGeneric LLM | Mistral-7B (Procyon) (checkpoint unspecified) | Procyon | — | — | 103.35 tok/sGeneration · per request | 1 × RX 9070 XTSingle GPU · 16 GB VRAM/GPUConfiguration
|
Quantizations and software
Quantizations: Not reported
Engines: ONNX Runtime
This is a selection across sources, not a ranking or a matched experiment. Reading benchmark reports
GPU benchmark pages: RX 9070 XT · RX 9070 · RX 9070 GRE · RX 9060 XT