Skip to content

[Refactor][SP]The sequence parallelism characteristics in the MoE and Dense models are integrated into a single solution. #693

[Refactor][SP]The sequence parallelism characteristics in the MoE and Dense models are integrated into a single solution.

[Refactor][SP]The sequence parallelism characteristics in the MoE and Dense models are integrated into a single solution. #693