2025-11-30 08:06:04 +00:00
|
|
|
|
<!doctype html>
|
|
|
|
|
|
<html lang="en">
|
|
|
|
|
|
|
|
|
|
|
|
<head>
|
|
|
|
|
|
<meta charset="utf-8">
|
|
|
|
|
|
<meta name="viewport" content="width=device-width, initial-scale=1">
|
|
|
|
|
|
<title>AMD Radeon AI PRO R9700 — Backend Benchmarks (Grid View)</title>
|
|
|
|
|
|
<link rel="stylesheet" href="assets/index2.css">
|
|
|
|
|
|
</head>
|
|
|
|
|
|
|
|
|
|
|
|
<body>
|
|
|
|
|
|
<header>
|
|
|
|
|
|
<h1>AMD Radeon AI PRO R9700 — Benchmark Grid</h1>
|
|
|
|
|
|
<p>AMD Radeon AI PRO R9700 · 32GB vRAM</p>
|
|
|
|
|
|
<p>Fedora 43 · Linux 6.17.8-300.fc43.x86_64 · llama.cpp build 1c398dc9e (7034)</p>
|
2025-11-30 12:01:37 +00:00
|
|
|
|
<p>Benchmarks captured 14 Nov 2025 · Repo: <a href="https://github.com/kyuz0/amd-r9700-ai-toolboxes"
|
2025-11-30 08:06:04 +00:00
|
|
|
|
target="_blank" rel="noreferrer">kyuz0/amd-r9700-toolboxes</a></p>
|
|
|
|
|
|
<div class="legend">
|
|
|
|
|
|
<label>Legend</label>
|
|
|
|
|
|
<div class="legend-pills">
|
|
|
|
|
|
<button id="hipblas-modal-open" type="button" class="chip small legend-pill legend-pill-default">
|
|
|
|
|
|
hipBLASLt vs hblt0
|
|
|
|
|
|
</button>
|
2025-11-30 08:20:12 +00:00
|
|
|
|
<button id="dual-modal-open" type="button" class="chip small legend-pill legend-pill-dual">
|
|
|
|
|
|
Dual GPU
|
2025-11-30 08:06:04 +00:00
|
|
|
|
</button>
|
|
|
|
|
|
<button id="rocwmma-modal-open" type="button" class="chip small legend-pill legend-pill-rocwmma">
|
|
|
|
|
|
rocWMMA
|
|
|
|
|
|
</button>
|
|
|
|
|
|
|
|
|
|
|
|
</div>
|
|
|
|
|
|
</div>
|
|
|
|
|
|
</header>
|
|
|
|
|
|
|
|
|
|
|
|
<section class="controls">
|
|
|
|
|
|
<div class="control">
|
|
|
|
|
|
<label for="filter-search">Search models</label>
|
|
|
|
|
|
<input id="filter-search" type="text" placeholder="e.g. llama, qwen, 30B…">
|
|
|
|
|
|
</div>
|
|
|
|
|
|
<div class="control">
|
|
|
|
|
|
<label for="filter-quant">Quant</label>
|
|
|
|
|
|
<select id="filter-quant">
|
|
|
|
|
|
<option value="">Any</option>
|
|
|
|
|
|
</select>
|
|
|
|
|
|
</div>
|
|
|
|
|
|
<div class="control grow slider-block">
|
|
|
|
|
|
<label>Context windows</label>
|
|
|
|
|
|
<div id="context-chips" class="chip-row tight"></div>
|
|
|
|
|
|
</div>
|
|
|
|
|
|
<div class="control grow slider-block">
|
|
|
|
|
|
<label>Model params (B)</label>
|
|
|
|
|
|
<div class="range-wrap">
|
|
|
|
|
|
<input type="range" id="sizeLo" step="1">
|
|
|
|
|
|
<input type="range" id="sizeHi" step="1">
|
|
|
|
|
|
<div class="range-track" id="sizeTrack"></div>
|
|
|
|
|
|
</div>
|
|
|
|
|
|
<div class="range-values">
|
|
|
|
|
|
<span id="sizeLoVal">0B</span> – <span id="sizeHiVal">0B</span>
|
|
|
|
|
|
</div>
|
|
|
|
|
|
</div>
|
|
|
|
|
|
</section>
|
|
|
|
|
|
|
|
|
|
|
|
<section class="panel compact">
|
|
|
|
|
|
<div class="panel-split">
|
|
|
|
|
|
<div class="backend-header">
|
|
|
|
|
|
<div class="backend-label">
|
|
|
|
|
|
<label>Backends</label>
|
|
|
|
|
|
<div class="backend-actions">
|
|
|
|
|
|
<button type="button" id="backend-all" class="chip small">All</button>
|
|
|
|
|
|
<button type="button" id="backend-none" class="chip small">None</button>
|
|
|
|
|
|
</div>
|
|
|
|
|
|
</div>
|
|
|
|
|
|
<div id="backend-list" class="backend-list"></div>
|
|
|
|
|
|
</div>
|
|
|
|
|
|
<div class="stats-box">
|
|
|
|
|
|
<div class="stat-line" id="stats-line">Loading…</div>
|
|
|
|
|
|
<button id="reset-layout" type="button" class="chip small">Reset filters</button>
|
|
|
|
|
|
</div>
|
|
|
|
|
|
</div>
|
|
|
|
|
|
</section>
|
|
|
|
|
|
|
|
|
|
|
|
<section class="panel compact" id="tables-panel">
|
|
|
|
|
|
<div id="tables"></div>
|
|
|
|
|
|
</section>
|
|
|
|
|
|
|
|
|
|
|
|
<div id="hipblas-modal" class="modal hidden" role="dialog" aria-modal="true" aria-labelledby="hipblas-title">
|
|
|
|
|
|
<div class="modal-content">
|
|
|
|
|
|
<button id="hipblas-modal-close" class="modal-close" aria-label="Close dialog">×</button>
|
|
|
|
|
|
<h2 id="hipblas-title">hipBLASLt & hblt0 explained</h2>
|
|
|
|
|
|
<p>The ROCm toolboxes ship with <code>ROCBLAS_USE_HIPBLASLT=1</code> by default. This forces rocBLAS to
|
|
|
|
|
|
prefer
|
|
|
|
|
|
the hipBLASLt kernel library, which historically delivered the best throughput on gfx1201 (R9700).</p>
|
|
|
|
|
|
<p>Rows tagged with <code>__hblt0</code> were re-run with <code>ROCBLAS_USE_HIPBLASLT=0</code>, letting
|
|
|
|
|
|
rocBLAS
|
|
|
|
|
|
auto-select between hipBLASLt, Tensile, or other kernel providers. These runs show how performance
|
|
|
|
|
|
shifts when
|
|
|
|
|
|
the tuned hipBLASLt path is disabled.</p>
|
|
|
|
|
|
<p>hipBLASLt is AMD's LT (low-level tuned) matmul backend, optimized for transformer workloads. Disabling it
|
|
|
|
|
|
can
|
|
|
|
|
|
expose regressions or improvements depending on driver versions, so both configurations are published
|
|
|
|
|
|
for
|
|
|
|
|
|
comparison.</p>
|
|
|
|
|
|
</div>
|
|
|
|
|
|
</div>
|
|
|
|
|
|
|
2025-11-30 08:20:12 +00:00
|
|
|
|
<div id="dual-modal" class="modal hidden" role="dialog" aria-modal="true" aria-labelledby="dual-title">
|
2025-11-30 08:06:04 +00:00
|
|
|
|
<div class="modal-content">
|
2025-11-30 08:20:12 +00:00
|
|
|
|
<button id="dual-modal-close" class="modal-close" aria-label="Close dialog">×</button>
|
|
|
|
|
|
<h2 id="dual-title">Dual GPU (2x R9700)</h2>
|
|
|
|
|
|
<p>These results were produced using two AMD Radeon AI PRO R9700 GPUs (32GB each, 64GB total).</p>
|
|
|
|
|
|
<p>Models larger than ~30GB are automatically distributed across both GPUs using
|
|
|
|
|
|
<code>HIP_VISIBLE_DEVICES=0,1</code>. Smaller models run on a single GPU
|
2025-11-30 12:01:37 +00:00
|
|
|
|
(<code>HIP_VISIBLE_DEVICES=0</code>).
|
|
|
|
|
|
</p>
|
2025-11-30 08:06:04 +00:00
|
|
|
|
</div>
|
|
|
|
|
|
</div>
|
|
|
|
|
|
|
|
|
|
|
|
<div id="rocwmma-modal" class="modal hidden" role="dialog" aria-modal="true" aria-labelledby="rocwmma-title">
|
|
|
|
|
|
<div class="modal-content">
|
|
|
|
|
|
<button id="rocwmma-modal-close" class="modal-close" aria-label="Close dialog">×</button>
|
|
|
|
|
|
<h2 id="rocwmma-title">rocWMMA variants</h2>
|
|
|
|
|
|
<p>Backends labeled <code>-rocwmma</code> are rebuilt with AMD's rocWMMA library, which unlocks matrix
|
|
|
|
|
|
multiply
|
|
|
|
|
|
pipelines accelerated via wave matrix multiply-accumulate (WMMA) instructions.</p>
|
|
|
|
|
|
<p>rocWMMA kernels can significantly accelerate BF16/F16 workloads on RDNA3 but may trade stability or
|
|
|
|
|
|
memory
|
|
|
|
|
|
usage; comparing plain toolboxes against <code>-rocwmma</code> ones highlights the benefit or cost.</p>
|
|
|
|
|
|
</div>
|
|
|
|
|
|
</div>
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
<script src="assets/index2.js" type="module"></script>
|
|
|
|
|
|
</body>
|
|
|
|
|
|
|
|
|
|
|
|
</html>
|
