86 lines
9.2 KiB
Plaintext
86 lines
9.2 KiB
Plaintext
|
Ë
|
|||
|
|
ðÉ+j‘ ã óp — d Z ddlZddlZddlZddlZddlZdZdZd„ Zd„ Z d„ Z
|
|||
|
|
d„ Z d „ Z e
|
|||
|
|
d
|
|||
|
|
k( r e « yy) uÐ vllm å¹³å�°æ£€æµ‹è¡¥ä¸�
|
|||
|
|
|
|||
|
|
问题 1：amdsmi ��用时 platform 回退到 torch.version.hip
|
|||
|
|
问题 2：rocm.py ä¸ logger.warning_once() 导致循环导入（默认ä¸�å†�改写；仅ä¿�留为显å¼�开关）
|
|||
|
|
é Nz/opt/vllm/vllmz /opt/vllmc ó — t j j t dd« } t | « j « }d}d}|j
|
|||
|
|
||« }||k7 r't | d« j |« t d« yt d« y) u@ è¡¥ä¸� 6：platforms/__init__.py —— torch.version.hip å…œåº•Ú platformsz __init__.pyzB return 'vllm.platforms.rocm.RocmPlatform' if is_rocm else Nonea( # amdsmi fallback: also check torch.version.hip
|
|||
|
|
if not is_rocm:
|
|||
|
|
try:
|
|||
|
|
import torch
|
|||
|
|
if torch.version.hip is not None:
|
|||
|
|
is_rocm = True
|
|||
|
|
except Exception:
|
|||
|
|
pass
|
|||
|
|
return 'vllm.platforms.rocm.RocmPlatform' if is_rocm else NoneÚwz/Patch 6: __init__.py platform fallback applied.z.Patch 6: already applied or pattern not found.N) ÚosÚpathÚjoinÚVLLM_DIRÚopenÚreadÚreplaceÚwriteÚprint)ÚfÚcÚoldÚnewÚc2s ú<D:\Project\mineru-rocm\docker\scripts\patch_vllm_platform.pyÚ patch6_init_platform_fallbackr ss € ä
|
|||
|
|
�‰� ‰ ”X˜{¨MÓ:€AÜ ˆQ‹� ‰ ‹€AØ
|
|||
|
|
N€Cð P€Cð
|
|||
|
|
�‰�3˜Ó €BØ ˆQ‚wÜ ˆQ�‹ ×ј2Ô Ü
|
|||
|
|
Ð?Õ@ä
|
|||
|
|
Ð>Õ?ó c óæ — t j j d« dk( r t d« yt j j t dd« } t | « j « }d|v r t d« yt j d t j « }d
|
|||
|
|
„ }|j ||d ¬ « \ }}||k7 r't | d
|
|||
|
|
« j |« t d« yt d« y)uI è¡¥ä¸� 7：platforms/rocm.py —— logger.warning_once → sys.stderr.write
|
|||
|
|
|
|||
|
|
默认�用安全的“整段 except ��替�，�� logger.warning_once() 在平�检测
|
|||
|
|
期间触�循环导入，导致 current_platform �到 UnspecifiedPlatform。
|
|||
|
|
如需�用，设置 VLLM_PATCH_ROCM_WARNING_ONCE=0。
|
|||
|
|
Ú VLLM_PATCH_ROCM_WARNING_ONCEÚ0z2Patch 7: skipped (VLLM_PATCH_ROCM_WARNING_ONCE=0).Nr zrocm.pyz-amdsmi unavailable, using torch.cuda fallbackzPatch 7: already applied.z’(\n\s*except Exception as e:\n\s*logger\.debug\("Failed to get GCN arch via amdsmi: %s", e\)\n\s*logger\.warning_once\(\n(?:\s*"[^"]*"\n)+\s*\)\n)c óŒ — t j d| j d« « j d« }|dz }d|› d|› d|› d�S )Nz \n(\s*)except Exception as e:é z Ú
|
|||
|
|
zexcept Exception as e:
|
|||
|
|
zimport sys as _sys
|
|||
|
|
zb_sys.stderr.write("vLLM ROCm: amdsmi unavailable, using torch.cuda fallback for GPU detection\n")
|
|||
|
|
)ÚreÚsearchÚgroup)ÚmatchÚindentÚ body_indents r Úreplz,patch7_rocm_break_import_cycle.<locals>.repl@ sX € Ü—‘Ð;¸U¿[¹[È»^ÓL×RÑRÐSTÓUˆØ ˜v‘oˆ à��Ð0؈mÐ/؈mð að
|
|||
|
|
að
|
|||
|
|
r r )Úcountr zCPatch 7: rocm.py logger.warning_once circular import patch applied.z.Patch 7: already applied or pattern not found.)r ÚenvironÚgetr r r r r
|
|||
|
|
r r ÚcompileÚ MULTILINEÚsubnr
|
|||
|
|
)r r Úpatternr# r Úns r Ú patch7_rocm_break_import_cycler, ( sÇ € ô
|
|||
|
|
‡z�z‡~�~Ð4Ó5¸Ò<Ü
|
|||
|
|
ÐBÔCØÜ
|
|||
|
|
�‰� ‰ ”X˜{¨IÓ6€AÜ ˆQ‹� ‰ ‹€AØ6¸!Ñ;Ü
|
|||
|
|
Ð)Ô*ØÜ�j‰jð ô
|
|||
|
|
� ‰ ó
|
|||
|
|
€Gò
|
|||
|
|
ð
|
|||
|
|
�L‰L˜˜q¨ˆLÓ *�E€BˆØ ˆQ‚wÜ ˆQ�‹ ×ј2Ô Ü
|
|||
|
|
ÐSÕTä
|
|||
|
|
Ð>Õ?r c óš — ddl } t | dd« xs d}t j « j d« }|syt j j |d|› d�« }t
|
|||
|
|
j |d¬ « t j j |d
|
|||
|
|
« }t j j |« s*t |d « 5 }|j d |› d
|
|||
|
|
�« ddd« t t j j |d« d « 5 }|j d« ddd« t t j j |d« d « 5 }|j d« ddd« t t j j |d« d « 5 }|j d« ddd« t t j j |d« d « 5 }|j d« ddd« t d|› �« y# t $ r Y yw xY w# 1 sw Y �Œ8xY w# 1 sw Y �ŒxY w# 1 sw Y ŒÉxY w# 1 sw Y Œ‘xY w# 1 sw Y ŒYxY w)u6 为 /opt/vllm æº�ç �导入创建最å°� dist-info。
|
|||
|
|
|
|||
|
|
vLLM 平�检测会通过 importlib.metadata 查询 vllm 分�元数�/entry points。
|
|||
|
|
如果å�ªé� PYTHONPATH 导入æº�ç �，没有 dist-info，就会出现：
|
|||
|
|
"The vLLM package was not found..."，并�能得到 UnspecifiedPlatform。
|
|||
|
|
r NÚ __version__z0.1.dev1Úpurelibzvllm-z
|
|||
|
|
.dist-infoT)Úexist_okÚMETADATAr z*Metadata-Version: 2.1
|
|||
|
|
Name: vllm
|
|||
|
|
Version: z0
|
|||
|
|
Summary: vLLM source tree mounted at /opt/vllm
|
|||
|
|
z
|
|||
|
|
top_level.txtzvllm
|
|||
|
|
Ú INSTALLERzmineru-rocm-runtime
|
|||
|
|
zentry_points.txtzH[vllm.platform_plugins]
|
|||
|
|
rocm = vllm.platforms.rocm:rocm_platform_plugin
|
|||
|
|
ÚRECORDÚ zvllm dist-info ensured: )ÚvllmÚ ExceptionÚgetattrÚ sysconfigÚ get_pathsr& r r r ÚmakedirsÚexistsr
|
|||
|
|
r
|
|||
|
|
r )r5 ÚversionÚ
|
|||
|
|
site_packagesÚ dist_infoÚmetadataÚfps r Úensure_vllm_dist_inforA R sÉ € ðÛô �d˜M¨:Ó6ÒD¸*€GÜ ×'Ñ'Ó)×-Ñ-¨iÓ8€MÙ ØÜ—‘— ‘ ˜]¨e°G°9¸JÐ,GÓH€I܇K�K� DÕ)ä�w‰w�|‰|˜I zÓ2€HÜ
|
|||
|
|
�7‰7�>‰>˜(Ô #Ü
|
|||
|
|
�(˜CÔ
|
|||
|
|
BØ �H‰Hð à #˜9ð %CðCô
|
|||
|
|
÷ !ô
|
|||
|
|
Œb�g‰g�l‰l˜9 oÓ6¸Ô <ÀØ
|
|||
|
|
�‰�Ô÷
|
|||
|
|
=ä
|
|||
|
|
Œb�g‰g�l‰l˜9 kÓ2°CÔ 8¸BØ
|
|||
|
|
�‰Ð(Ô)÷
|
|||
|
|
9ä
|
|||
|
|
Œb�g‰g�l‰l˜9Ð&8Ó9¸3Ô ?À2Ø
|
|||
|
|
�‰ð
|
|||
|
|
@ô
|
|||
|
|
÷
|
|||
|
|
@ô
|
|||
|
|
|
|||
|
|
Œb�g‰g�l‰l˜9 hÓ/°Ô 5¸Ø
|