Skip to content

Commit 0e56159

Browse files
committed
close fuse linear
1 parent f83d88e commit 0e56159

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

tests/test_tipc/static/auto_parallel/llama2/pretrain_config_llama2_13b/pretrain-llama2_13b_dynamic_auto.json

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -21,8 +21,8 @@
2121
"fuse_attention_ffn": true,
2222
"fuse_attention_qkv": true,
2323
"use_fused_rope": true,
24-
"fused_linear_param_grad_add": true,
25-
"enable_linear_fused_grad_add": true,
24+
"fused_linear_param_grad_add": 0,
25+
"enable_linear_fused_grad_add": 0,
2626
"max_seq_length": 4096,
2727
"learning_rate": 3e-05,
2828
"min_learning_rate": 3e-06,

0 commit comments

Comments
 (0)