Omni.Dialects.OllamaChat (Omni v2.0.0)

Copy Markdown View Source

Dialect implementation for the Ollama native chat API wire format.

See Omni.Dialect.Text for the behaviour specification and delta types.

Notable differences

  • Streams NDJSON, not SSE: each line is a complete JSON object
  • Tool use arguments arrive complete, as a map, not as streamed JSON fragments (as with Gemini)
  • Thinking arrives in a message.thinking field beside message.content
  • Options such as max_tokens and temperature are nested under "options" in the request body

Compat flags

None yet: providers speaking this dialect get its home API's behaviour. Flags are added as built-in providers need them.