[main] Fuse GroupedMatmul, Swiglu and DynamicQuant in W8A8_DYNAMIC
quantized MoE layers
#6567
Job | Run time |
---|---|
6m 10s | |
5m 20s | |
11m 30s |
W8A8_DYNAMIC
quantized MoE layers
#6567
Job | Run time |
---|---|
6m 10s | |
5m 20s | |
11m 30s |