Skip to content

[Refactor] [SP]The sequence parallelism characteristics in the MoE and Dense models are integrated into a single solution. #9868

[Refactor] [SP]The sequence parallelism characteristics in the MoE and Dense models are integrated into a single solution.

[Refactor] [SP]The sequence parallelism characteristics in the MoE and Dense models are integrated into a single solution. #9868