[feat]: oproj tensor parallelism in pure DP and graph-mode scenarios. #10558
Job | Run time |
---|---|
7s | |
5m 14s | |
47m 33s | |
9m 13s | |
47m 21s | |
9m 19s | |
1h 35m 26s | |
1h 36m 14s | |
5h 10m 27s |
Job | Run time |
---|---|
7s | |
5m 14s | |
47m 33s | |
9m 13s | |
47m 21s | |
9m 19s | |
1h 35m 26s | |
1h 36m 14s | |
5h 10m 27s |