Files
amd-r9700-ai-toolboxes/benchmark/results/Qwen3-Next-80B-A3B-Instruct-UD-Q4_K_XL__rocm7.1.1__fa1__longctx16384__dual.log
T
Donato Capitella 99d8dbe914 more banchmarks
2025-12-07 16:57:56 +00:00

26 lines
2.0 KiB
Plaintext

ggml_cuda_init: GGML_CUDA_FORCE_MMQ: no
ggml_cuda_init: GGML_CUDA_FORCE_CUBLAS: no
ggml_cuda_init: found 2 ROCm devices:
Device 0: AMD Radeon AI PRO R9700, gfx1201 (0x1201), VMM: no, Wave Size: 32
Device 1: AMD Radeon AI PRO R9700, gfx1201 (0x1201), VMM: no, Wave Size: 32
| model | size | params | backend | ngl | n_ubatch | fa | test | t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | -------: | -: | --------------: | -------------------: |
/opt/llama.cpp/ggml/src/ggml.c:1679: GGML_ASSERT(obj_new) failed
/usr/local/lib64/libggml-base.so.0(+0x3565) [0x7f565baf1565]
/usr/local/lib64/libggml-base.so.0(ggml_print_backtrace+0x1eb) [0x7f565baf192b]
/usr/local/lib64/libggml-base.so.0(ggml_abort+0x11f) [0x7f565baf1aaf]
/usr/local/lib64/libggml-base.so.0(+0x4921) [0x7f565baf2921]
/usr/local/lib64/libggml-base.so.0(ggml_view_4d+0x2e) [0x7f565baf80ce]
/usr/local/lib64/libllama.so.0(_ZN19llm_build_qwen3next24build_delta_net_chunkingEP11ggml_tensorS1_S1_S1_S1_S1_S1_S1_i+0xf16) [0x7f565f3835a6]
/usr/local/lib64/libllama.so.0(_ZN19llm_build_qwen3next23build_layer_attn_linearEP18llm_graph_input_rsP11ggml_tensorS3_S3_i+0xff8) [0x7f565f386228]
/usr/local/lib64/libllama.so.0(_ZN19llm_build_qwen3nextC1ERK11llama_modelRK16llm_graph_params+0x16e) [0x7f565f3866ce]
/usr/local/lib64/libllama.so.0(_ZNK11llama_model11build_graphERK16llm_graph_params+0x90b) [0x7f565f2be04b]
/usr/local/lib64/libllama.so.0(_ZN13llama_context13graph_reserveEjjjPK22llama_memory_context_ib+0xfa) [0x7f565f25097a]
/usr/local/lib64/libllama.so.0(_ZN13llama_contextC2ERK11llama_model20llama_context_params+0x103e) [0x7f565f25372e]
/usr/local/lib64/libllama.so.0(llama_init_from_model+0x100) [0x7f565f2541d0]
/usr/local/bin/llama-bench() [0x4077bb]
/lib64/libc.so.6(+0x35b5) [0x7f565b4875b5]
/lib64/libc.so.6(__libc_start_main+0x88) [0x7f565b487668]
/usr/local/bin/llama-bench() [0x409b65]
✖ ! [rocm7.1.1] Qwen3-Next-80B-A3B-Instruct-UD-Q4_K_XL__fa1 __longctx16384 failed (exit 0)