Skip to content

Commit 3ff52f0

Browse files
committed
Fix comment
1 parent 13d4924 commit 3ff52f0

File tree

1 file changed

+5
-1
lines changed

1 file changed

+5
-1
lines changed

slm/model_zoo/gpt-3/external_ops/fused_quanted_ops/fused_transpose_split_quant.cu

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -175,8 +175,12 @@ __global__ void __launch_bounds__(1024, 2) FusedTransposeSplitQuantKernel(
175175
*
176176
* Inputs:
177177
* X : [SUM(M_1...M_N), K], bfloat16
178+
*
179+
* Attrs:
178180
* tokens_per_expert
179-
* : python list of value [M_1, M_2, ..., M_N]
181+
* : list of value [M_1, M_2, ..., M_N]
182+
* pow_2_scales
183+
* : bool that indicates whether to use power-of-2 scaling
180184
*
181185
* Outputs:
182186
* out : [K * M_1 + K * M_2 + ... + K * M_N]

0 commit comments

Comments
 (0)