[main] Fuse GroupedMatmul, Swiglu and DynamicQuant in W8A8_DYNAMIC
quantized MoE layers
#9341
Job | Run time |
---|---|
4s | |
5m 18s | |
0s | |
0s | |
0s | |
5m 22s |
W8A8_DYNAMIC
quantized MoE layers
#9341
Job | Run time |
---|---|
4s | |
5m 18s | |
0s | |
0s | |
0s | |
5m 22s |