You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/source/tutorials/multi_node_ray.md
+3-5Lines changed: 3 additions & 5 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,6 +1,6 @@
1
1
# Multi-Node-Ray (Qwen/Qwen3-235B-A22B)
2
2
3
-
Multi-node inference is suitable for scenarios where the model cannot be deployed on a single NPU. In such cases, the model can be distributed using tensor parallelism and pipeline parallelism. The specific parallelism strategies will be covered in the following sections. To successfully deploy multi-node inference, the following three steps need to be completed:
3
+
Multi-node inference is suitable for the scenarios that the model cannot be deployed on a single machine. In such cases, the model can be distributed using tensor parallelism or pipeline parallelism. The specific parallelism strategies will be covered in the following sections. To successfully deploy multi-node inference, the following three steps need to be completed:
4
4
5
5
***Verify Multi-Node Communication Environment**
6
6
***Set Up and Start the Ray Cluster**
@@ -10,7 +10,7 @@ Multi-node inference is suitable for scenarios where the model cannot be deploye
10
10
11
11
### Physical Layer Requirements:
12
12
13
-
* The physical machines must be located on the same WLAN, with network connectivity.
13
+
* The physical machines must be located on the same LAN, with network connectivity.
14
14
* All NPUs are connected with optical modules, and the connection status must be normal.
0 commit comments