How do i enable streaming in chat mode (aesthetic chat ui)

[x-legion]

[LostRuins]

put streaming in the url, e.g. http://localhost:5001?streaming=1 and it should work.

[henk717]

In addition it only shows streaming text when you are not using the Aestethic Text UI.

[x-legion]

In addition it only shows streaming text when you are not using the Aestethic Text UI.

exactly.

[x-legion]

put streaming in the url, e.g. http://localhost:5001?streaming=1 and it should work.

but it doesnt work on aesthetic chat ui

[LostRuins]

Yes, currently streaming does not work in the aesthetic chat UI... it may be added in future but is not a high priority for now.

[Enferlain]

@LostRuins By the way, I haven't checked since last time, but do you know if streaming is possible through sillytavern? I think oobabooga works with streaming, not sure about koboldcpp though.

[LostRuins]

It depends on how they implemented streaming. The Kobold API emulates it by breaking it up into small requests - this is not true streaming which is not implemented.

[LostRuins]

True streaming is now available in newest versions.