Skip to content

[Refactor] [SP]The sequence parallelism characteristics in the MoE and Dense models are integrated into a single solution. #9844

[Refactor] [SP]The sequence parallelism characteristics in the MoE and Dense models are integrated into a single solution.

[Refactor] [SP]The sequence parallelism characteristics in the MoE and Dense models are integrated into a single solution. #9844