Skip to manual
gluon

CLI reference

gluon gateway-config

Generate the LiteLLM gateway config from a package's approved Models.

Model author or developer

Usage

Run it as gluon gateway-config (in the repository, cargo run -p gluon-cli -- gateway-config).

Console / text
The LiteLLM gateway config generated from a package's approved Models, so nothing else can be routed

Usage: gluon gateway-config [OPTIONS] <PATH>

Arguments:
  <PATH>

Options:
  -o <OUT>    Write the config here
  -h, --help  Print help

What it reads and writes

It prints the LiteLLM config to stdout, or writes it to -o. Every route comes from the package's approved Model resources, so the gateway can reach no other model. Credentials appear as environment references, and the file holds no keys. LiteLLM gets no retries, fallbacks or logging of its own: Gluon orders the fallbacks itself. To change a route, change the Model through a proposal and generate the file again.

gluon gateway-config printing the routes for Contoso's approved Models.
gluon gateway-config printing the routes for Contoso's approved Models.