[main] Fuse GroupedMatmul, Swiglu and DynamicQuant in W8A8_DYNAMIC
quantized MoE layers
#9280
Job | Run time |
---|---|
7s | |
5m 9s | |
0s | |
0s | |
0s | |
5m 16s |
W8A8_DYNAMIC
quantized MoE layers
#9280
Job | Run time |
---|---|
7s | |
5m 9s | |
0s | |
0s | |
0s | |
5m 16s |