[main] Fuse GroupedMatmul, Swiglu and DynamicQuant in W8A8_DYNAMIC
quantized MoE layers
#6548
Job | Run time |
---|---|
5m 41s | |
4m 59s | |
10m 40s |
W8A8_DYNAMIC
quantized MoE layers
#6548
Job | Run time |
---|---|
5m 41s | |
4m 59s | |
10m 40s |