A model source reading the optional llm_db package.
llm_db is a separately maintained
model catalog. Select it globally or per provider:
config :omni, :models, source: Omni.Sources.LLMDB
# keep one provider on the bundled snapshot
config :omni, :providers, openai: [source: Omni.Sources.ModelsDev]llm_db must be in your deps. Selecting this source without the package raises at boot.
Models are read from llm_db's catalog store and transformed at load time.
A model loads for text when llm_db says it chats, supports tool use and
takes and produces text, and for decisions when it has an
execution.evaluate entry; a model may qualify for both (OpenAI's
gpt-6-luna). Retired models are left out, as are those llm_db marks
catalog_only (described, but not callable). Deprecated models are kept,
since they can still be called. Aliases are expanded so friendly ids keep
resolving (canonical records win when ids collide), and negative cost
sentinels are clamped to zero. Models that still fail to build are
skipped with a warning.
Which models llm_db holds and how fresh its data is are llm_db's own
concerns, and Omni doesn't wrap them. See llm_db's allow:, deny: and
sources: configuration.
Provider ids are llm_db's own ids, which are models.dev keys in snake
case, so none is translated. llm_db's provider record supplies the provider's
name and API key environment variable (when exactly one is listed). Each
dialect's endpoint takes its models' URL: a model's own base_url when it
has one, otherwise the provider's. Templated URLs ({region}) are kept
for host: to fill.
Dialect resolution
Catalog data is the source of truth, resolved per model and capability.
For text: the wire protocol, then npm package metadata. For decisions:
execution.evaluate.family, where typesafe_systemone and
openrouter_decisions (OpenRouter's alpha route for the same wire) are
System One and openai_decisions is OpenAI Decisions; other families are
skipped. A model whose npm package maps to no dialect is skipped with a
warning, as is one with no signal at all, and one served from a different
URL than the first model of its dialect.