Commit Graph

2 Commits

Author SHA1 Message Date
Diego Rodrigues de Sa e Souza
d5f2586513 fix(sse): emit reasoning/content as separate SSE deltas to avoid duplication (#3089 follow-up) (#3112)
synthesizeOpenAiSseFromJson combined role+content+reasoning_content in one delta, which the openai→openai translator re-split, duplicating reasoning_content across chunks. Now emits role, reasoning_content, content and tool_calls as separate sequential deltas (reasoning before content) — the shape a real reasoning model streams — so the translator passes them through with no duplication. Tests assert each field appears exactly once and reasoning precedes content.
2026-06-03 12:08:43 -03:00
Diego Rodrigues de Sa e Souza
b57afb5bbe fix(sse): handle non-SSE JSON upstream body on streaming path + SSE-wrap cache hits (#3089, #2952) (#3108)
#3089: reasoning openai-compatible upstreams that ignore stream:true and return application/json produced STREAM_EARLY_EOF because readiness only scans SSE data: frames. chatCore now detects a non-SSE JSON upstream body on the streaming path and synthesizes an equivalent OpenAI SSE stream (new synthesizeOpenAiSseFromJson util), preserving content + reasoning_content. #2952: semantic-cache hits returned application/json regardless of stream flag, so streaming clients lost reasoning_content; stream requests now SSE-wrap the cached completion via the same helper. Unit tests for the converter (4).
2026-06-03 10:23:00 -03:00