Make pretokenizer optional in hf tokenizer#81

jackzhxng wants to merge 1 commit intomainmeta-pytorch/tokenizers:mainfrom

jz/optional-pretokenizermeta-pytorch/tokenizers:jz/optional-pretokenizerCopy head branch name to clipboard