Usage
Run it as gluon eval (in the repository, cargo run -p gluon-cli -- eval).
Console / text
Run `answers` cases against a pinned provider, score them (E704) and write an immutable run
Usage: gluon eval [OPTIONS] <PATH>
Arguments:
<PATH>
Options:
--provider <PROVIDER> Pinned provider; 'fixed' is the CI provider [default: fixed]
--runs <RUNS> Directory for the immutable evaluation run [default: runs]
-h, --help Print help
What it reads and writes
It answers each answers case with the provider you name in --provider and scores the result. Only fixed, the offline provider CI uses, runs today: any other name stops with an error. The run goes to run-<digest>.json in the --runs folder (default runs/). The same inputs and results give the same file, and an existing run is never overwritten. A failing case exits 1.
