[main] Fuse GroupedMatmul, Swiglu and DynamicQuant in W8A8_DYNAMIC
quantized MoE layers
#9292
Job | Run time |
---|---|
4s | |
5m 2s | |
42m 57s | |
14m 12s | |
1h 32m 46s | |
2h 35m 1s |
W8A8_DYNAMIC
quantized MoE layers
#9292
Job | Run time |
---|---|
4s | |
5m 2s | |
42m 57s | |
14m 12s | |
1h 32m 46s | |
2h 35m 1s |