File tree Expand file tree Collapse file tree 1 file changed +4
-9
lines changed
Expand file tree Collapse file tree 1 file changed +4
-9
lines changed Original file line number Diff line number Diff line change @@ -108,16 +108,11 @@ print(tokenizer.batch_decode(generated_tokens, skip_special_tokens=True))
108108
109109 article_ar = " الأمين العام للأمم المتحدة يقول إنه لا يوجد حل عسكري في سوريا."
110110 tokenizer.src_lang = " ar_AR"
111- ```
112-
113- # # Documentation resources
114111
115- - [Text classification task guide](../ tasks/ sequence_classification)
116- - [Question answering task guide](../ tasks/ question_answering)
117- - [Causal language modeling task guide](../ tasks/ language_modeling)
118- - [Masked language modeling task guide](../ tasks/ masked_language_modeling)
119- - [Translation task guide](../ tasks/ translation)
120- - [Summarization task guide](../ tasks/ summarization)
112+ encoded_ar = tokenizer(article_ar, return_tensors = " pt" )
113+ generated_tokens = model.generate(** encoded_ar, forced_bos_token_id = tokenizer.lang_code_to_id[" en_XX" ])
114+ tokenizer.batch_decode(generated_tokens, skip_special_tokens = True )
115+ ```
121116
122117# # MBartConfig
123118
You can’t perform that action at this time.
0 commit comments