Skip to content

[Refactor] [SP]The sequence parallelism characteristics in the MoE and Dense models are integrated into a single solution. #842

[Refactor] [SP]The sequence parallelism characteristics in the MoE and Dense models are integrated into a single solution.

[Refactor] [SP]The sequence parallelism characteristics in the MoE and Dense models are integrated into a single solution. #842