帮助（FAQ）
libmusa.so.4报错
libmusa.so.4报错情况：
docker exec -it s5000_workshow_vllm bash /data/sanity-check/SETS/infer/vllm-musa/run-vllm-musa.sh /data/models/DeepSeek-R1-Distill-Qwen-7B 4docker exec -it s5000_workshow_vllm bash /data/sanity-check/SETS/infer/vllm-musa/run-vllm-musa.sh /data/models/DeepSeek-R1-Distill-Qwen-7B 4
+ VLLM_USE_V1=0
+ vllm serve /data/models/DeepSeek-R1-Distill-Qwen-7B --trust-remote-code --gpu-memory-utilization 0.7 --served-model-name deepseek-r1-distill-qwen-7b --block-size 64 --tensor-parallel-size 4 --pipeline-parallel-size 1 --compilation-config '{"cudagraph_capture_sizes": [1,2,3,4,5,6,7,8,10,12,14,16,18,20,24,28,30,32,50,64,100,128,256], "simple_cuda_graph": true}'
Traceback (most recent call last):
File "/usr/local/bin/vllm", line 3, in <module>
from vllm.entrypoints.cli.main import main
File "/home/vllm/vllm/__init__.py", line 14, in <module>
import vllm.env_override # noqa: F401
File "/home/vllm/vllm/env_override.py", line 5, in <module>
import torch
File "/usr/local/lib/python3.10/dist-packages/torch/__init__.py", line 368, in <module>
from torch._C import * # noqa: F403
ImportError: /usr/lib/x86_64-linux-gnu/libmusa.so.4: file too short
+ set +x
docker 镜像存在问题没有libmusa.so.4，需手动拷贝至镜像内
docker cp /usr/lib/x86_64-linux-gnu/libmusa.so.4 s5000_workshow_vllm:/usr/lib/x86_64-linux-gnu/
按照流程启动推理服务DeepSeek-R1-Distill-Qwen-7B
-1.png)
/data/models/DeepSeek-R1-Distill-Qwen-7B]# mthreads-gmi
Fri Jan 30 17:18:43 2026
---------------------------------------------------------------------
mthreads-gmi:2.2.0 Driver Version:3.3.3-server
---------------------------------------------------------------------
ID Name |PCIe |%GPU Mem
Device Type Perf |Pcie Lane Width |Temp MPC Capable
| ECC Mode
+-------------------------------------------------------------------+
0 MTT S5000 |00000000:23:00.0 |0% 57992MiB(81920MiB)
Physical N/A |16x(16x) |45C YES
| OFF
+-------------------------------------------------------------------+
1 MTT S5000 |00000000:26:00.0 |0% 57957MiB(81920MiB)
Physical N/A |16x(16x) |39C YES
| OFF
+-------------------------------------------------------------------+
2 MTT S5000 |00000000:63:00.0 |0% 57957MiB(81920MiB)
Physical N/A |16x(16x) |42C YES
| OFF
+-------------------------------------------------------------------+
3 MTT S5000 |00000000:66:00.0 |0% 57951MiB(81920MiB)
Physical N/A |16x(16x) |45C YES
| OFF
+-------------------------------------------------------------------+
4 MTT S5000 |00000000:a3:00.0 |0% 65MiB(81920MiB)
Physical N/A |16x(16x) |42C YES
| OFF
+-------------------------------------------------------------------+
5 MTT S5000 |00000000:a4:00.0 |0% 65MiB(81920MiB)
Physical N/A |16x(16x) |39C YES
| OFF
+-------------------------------------------------------------------+
6 MTT S5000 |00000000:e3:00.0 |0% 65MiB(81920MiB)
Physical N/A |16x(16x) |39C YES
| OFF
+-------------------------------------------------------------------+
7 MTT S5000 |00000000:e4:00.0 |0% 65MiB(81920MiB)
Physical N/A |16x(16x) |42C YES
| OFF
---------------------------------------------------------------------
---------------------------------------------------------------------
Processes:
ID PID Process name GPU Memory
Usage
+-------------------------------------------------------------------+
0 2135056 /usr/bin/python 40MiB
0 2136126 /usr/bin/python 57786MiB
0 2136751 /usr/bin/python 56MiB
0 2136752 /usr/bin/python 55MiB
0 2136753 /usr/bin/python 55MiB
+-------------------------------------------------------------------+
1 2135056 /usr/bin/python 1MiB
1 2136126 /usr/bin/python 55MiB
1 2136751 /usr/bin/python 57787MiB
1 2136752 /usr/bin/python 55MiB
1 2136753 /usr/bin/python 55MiB
+-------------------------------------------------------------------+
2 2135056 /usr/bin/python 1MiB
2 2136126 /usr/bin/python 55MiB
2 2136751 /usr/bin/python 55MiB
2 2136752 /usr/bin/python 57791MiB
2 2136753 /usr/bin/python 55MiB
+-------------------------------------------------------------------+
3 2135056 /usr/bin/python 1MiB
3 2136126 /usr/bin/python 55MiB
3 2136751 /usr/bin/python 55MiB
3 2136752 /usr/bin/python 55MiB
3 2136753 /usr/bin/python 57785MiB
+-------------------------------------------------------------------+
4 2135056 /usr/bin/python 1MiB
4 2136126 /usr/bin/python 16MiB
4 2136751 /usr/bin/python 16MiB
4 2136752 /usr/bin/python 15MiB
4 2136753 /usr/bin/python 16MiB
+-------------------------------------------------------------------+
5 2135056 /usr/bin/python 1MiB
5 2136126 /usr/bin/python 16MiB
5 2136751 /usr/bin/python 16MiB
5 2136752 /usr/bin/python 16MiB
5 2136753 /usr/bin/python 15MiB
+-------------------------------------------------------------------+
6 2135056 /usr/bin/python 1MiB
6 2136126 /usr/bin/python 16MiB
6 2136751 /usr/bin/python 16MiB
6 2136752 /usr/bin/python 16MiB
6 2136753 /usr/bin/python 16MiB
+-------------------------------------------------------------------+
7 2135056 /usr/bin/python 1MiB
7 2136126 /usr/bin/python 16MiB
7 2136751 /usr/bin/python 16MiB
7 2136752 /usr/bin/python 16MiB
7 2136753 /usr/bin/python 16MiB
---------------------------------------------------------------------
Qwen3-32b-fp8
-2.png)
Fri Jan 30 17:27:11 2026
---------------------------------------------------------------------
mthreads-gmi:2.2.0 Driver Version:3.3.3-server
---------------------------------------------------------------------
ID Name |PCIe |%GPU Mem
Device Type Perf |Pcie Lane Width |Temp MPC Capable
| ECC Mode
+-------------------------------------------------------------------+
0 MTT S5000 |00000000:23:00.0 |0% 57914MiB(81920MiB)
Physical N/A |16x(16x) |45C YES
| OFF
+-------------------------------------------------------------------+
1 MTT S5000 |00000000:26:00.0 |0% 57798MiB(81920MiB)
Physical N/A |16x(16x) |39C YES
| OFF
+-------------------------------------------------------------------+
2 MTT S5000 |00000000:63:00.0 |0% 57798MiB(81920MiB)
Physical N/A |16x(16x) |42C YES
| OFF
+-------------------------------------------------------------------+
3 MTT S5000 |00000000:66:00.0 |0% 57793MiB(81920MiB)
Physical N/A |16x(16x) |45C YES
| OFF
+-------------------------------------------------------------------+
4 MTT S5000 |00000000:a3:00.0 |0% 57771MiB(81920MiB)
Physical N/A |16x(16x) |45C YES
| OFF
+-------------------------------------------------------------------+
5 MTT S5000 |00000000:a4:00.0 |0% 57793MiB(81920MiB)
Physical N/A |16x(16x) |40C YES
| OFF
+-------------------------------------------------------------------+
6 MTT S5000 |00000000:e3:00.0 |0% 57776MiB(81920MiB)
Physical N/A |16x(16x) |40C YES
| OFF
+-------------------------------------------------------------------+
7 MTT S5000 |00000000:e4:00.0 |0% 57798MiB(81920MiB)
Physical N/A |16x(16x) |44C YES
| OFF
---------------------------------------------------------------------
---------------------------------------------------------------------
Processes:
ID PID Process name GPU Memory
Usage
+-------------------------------------------------------------------+
0 2158678 /usr/bin/python 40MiB
0 2159726 /usr/bin/python 57521MiB
0 2160218 /usr/bin/python 50MiB
0 2160219 /usr/bin/python 50MiB
0 2160220 /usr/bin/python 50MiB
0 2160221 /usr/bin/python 50MiB
0 2160222 /usr/bin/python 50MiB
0 2160223 /usr/bin/python 50MiB
0 2160224 /usr/bin/python 50MiB
+-------------------------------------------------------------------+
1 2158678 /usr/bin/python 1MiB
1 2159726 /usr/bin/python 51MiB
1 2160218 /usr/bin/python 57443MiB
1 2160219 /usr/bin/python 50MiB
1 2160220 /usr/bin/python 50MiB
1 2160221 /usr/bin/python 50MiB
1 2160222 /usr/bin/python 50MiB
1 2160223 /usr/bin/python 50MiB
1 2160224 /usr/bin/python 50MiB
+-------------------------------------------------------------------+
2 2158678 /usr/bin/python 1MiB
2 2159726 /usr/bin/python 51MiB
2 2160218 /usr/bin/python 50MiB
2 2160219 /usr/bin/python 57443MiB
2 2160220 /usr/bin/python 50MiB
2 2160221 /usr/bin/python 50MiB
2 2160222 /usr/bin/python 50MiB
2 2160223 /usr/bin/python 50MiB
2 2160224 /usr/bin/python 50MiB
+-------------------------------------------------------------------+
3 2158678 /usr/bin/python 1MiB
3 2159726 /usr/bin/python 51MiB
3 2160218 /usr/bin/python 50MiB
3 2160219 /usr/bin/python 50MiB
3 2160220 /usr/bin/python 57437MiB
3 2160221 /usr/bin/python 50MiB
3 2160222 /usr/bin/python 50MiB
3 2160223 /usr/bin/python 50MiB
3 2160224 /usr/bin/python 50MiB
+-------------------------------------------------------------------+
4 2158678 /usr/bin/python 1MiB
4 2159726 /usr/bin/python 51MiB
4 2160218 /usr/bin/python 50MiB
4 2160219 /usr/bin/python 50MiB
4 2160220 /usr/bin/python 50MiB
4 2160221 /usr/bin/python 57416MiB
4 2160222 /usr/bin/python 50MiB
4 2160223 /usr/bin/python 50MiB
4 2160224 /usr/bin/python 50MiB
+-------------------------------------------------------------------+
5 2158678 /usr/bin/python 1MiB
5 2159726 /usr/bin/python 51MiB
5 2160218 /usr/bin/python 50MiB
5 2160219 /usr/bin/python 50MiB
5 2160220 /usr/bin/python 50MiB
5 2160221 /usr/bin/python 50MiB
5 2160222 /usr/bin/python 57438MiB
5 2160223 /usr/bin/python 50MiB
5 2160224 /usr/bin/python 50MiB
+-------------------------------------------------------------------+
6 2158678 /usr/bin/python 1MiB
6 2159726 /usr/bin/python 51MiB
6 2160218 /usr/bin/python 50MiB
6 2160219 /usr/bin/python 50MiB
6 2160220 /usr/bin/python 50MiB
6 2160221 /usr/bin/python 50MiB
6 2160222 /usr/bin/python 50MiB
6 2160223 /usr/bin/python 57422MiB
6 2160224 /usr/bin/python 50MiB
+-------------------------------------------------------------------+
7 2158678 /usr/bin/python 1MiB
7 2159726 /usr/bin/python 51MiB
7 2160218 /usr/bin/python 50MiB
7 2160219 /usr/bin/python 50MiB
7 2160220 /usr/bin/python 50MiB
7 2160221 /usr/bin/python 50MiB
7 2160222 /usr/bin/python 50MiB
7 2160223 /usr/bin/python 50MiB
7 2160224 /usr/bin/python 57442MiB
---------------------------------------------------------------------
执行性能测试
vllm-perf-test.sh 请求端截图
-3.png)
run-vllm-musa.sh 处理端截图
-4.png)
生成的csv与json文件目录
-5.png)
其他
本指南中 musa-deploy 提供的版本比对示例通常为 Ubuntu 系统。在海光服务器上执行时，请确认比对版本。
文档中的docker镜像均为内网sh-harbor.mthreads.com
