Skip to content

Is there a recommended way to convert a Prompt Format from Huggingface into the format KoboldCPP is expecting? #1523

Answered by jabberjabberjabber
TFWol asked this question in Q&A
Discussion options

You must be logged in to vote

The thing is that there is no rule based parser that works for everything, otherwise it would be easy. Each team seems to want to create new rules about templates every time they release a new model for some reason, so a lot of the time it is just shoving whatever they want into whatever scheme you are dealing with and hoping it will work properly. Hence the comment "that should be more or less accurate to your example" (emphasis added).

Replies: 1 comment 3 replies

Comment options

You must be logged in to vote
3 replies
@TFWol
Comment options

@jabberjabberjabber
Comment options

Answer selected by LostRuins
@TFWol
Comment options

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
3 participants