Token streaming option?

[dreemur99]

It would be cool to have token streaming in this version of Kobold as well. Unless it is there and I just don't see it.

[LostRuins]

It's there, not exactly the same but it simulates it by splitting the request up into smaller ones.

Please add ?streaming=1 to your URL, e.g. http://localhost:5001?streaming=1