Skip to content

Commit 9d9bd67

Browse files
authored
Add use_faster to faster_gpt sample. (#1443)
1 parent 0720afe commit 9d9bd67

File tree

1 file changed

+2
-1
lines changed
  • examples/language_model/gpt/faster_gpt

1 file changed

+2
-1
lines changed

examples/language_model/gpt/faster_gpt/infer.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -118,7 +118,8 @@ def do_predict(args):
118118
bos_token_id=bos_id,
119119
eos_token_id=eos_id,
120120
decode_strategy="sampling",
121-
use_fp16_decoding=args.use_fp16_decoding)
121+
use_fp16_decoding=args.use_fp16_decoding,
122+
use_faster=True)
122123
output_sequence = out_seq.numpy()
123124

124125
paddle.fluid.core._cuda_synchronize(place)

0 commit comments

Comments
 (0)