Make pretokenizer optional in hf tokenizer#81

jackzhxng wants to merge 1 commit intomainpytorch-labs/tokenizers:mainfrom

jz/optional-pretokenizerpytorch-labs/tokenizers:jz/optional-pretokenizerCopy head branch name to clipboard