[main] Fuse GroupedMatmul, Swiglu and DynamicQuant in W8A8_DYNAMIC
quantized MoE layers
#9275
Job | Run time |
---|---|
4s | |
5m 25s | |
17m 1s | |
9m 44s | |
17m 51s | |
9m 38s | |
0s | |
59m 43s |
W8A8_DYNAMIC
quantized MoE layers
#9275
Job | Run time |
---|---|
4s | |
5m 25s | |
17m 1s | |
9m 44s | |
17m 51s | |
9m 38s | |
0s | |
59m 43s |