Is there a recommended way to convert a Prompt Format from Huggingface into the format KoboldCPP is expecting? #1523
-
I'm unclear on the exact process for taking something like this:
Is there a parser that let's me just paste in the block? |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 3 replies
-
Set it to Phi 3 preset, and then paste this as the system prompt in the box
Set "System tag" to That should be more or less accurate to your example. |
Beta Was this translation helpful? Give feedback.
The thing is that there is no rule based parser that works for everything, otherwise it would be easy. Each team seems to want to create new rules about templates every time they release a new model for some reason, so a lot of the time it is just shoving whatever they want into whatever scheme you are dealing with and hoping it will work properly. Hence the comment "that should be more or less accurate to your example" (emphasis added).