No EOS when prompt "exit"? #111
Description
Not sure if this is original llama3 issue or a issue caused by INT4 AWQ.
When I type in "exit", it keeps generating without ending the sentence:
{{ message }}
Not sure if this is original llama3 issue or a issue caused by INT4 AWQ.
When I type in "exit", it keeps generating without ending the sentence: