Check an experiment's variant against a bar, for CI
PreviewCheck an experiment’s variant against a bar, for CI. Answers 409 while runs are going and 422 when the variant misses the bar, so the command exits non-zero.
GET
/v1/evals/{eval_id}/experiments/{experiment_id}/gateSee authentication for credentials and permissions.
Parameters
Section titled “Parameters”Path Parameters
Section titled “Path Parameters”eval_id
required
string
Prefixed public identifier
experiment_id
required
string
Prefixed public identifier
Responses
200Success
Success
Media typeapplication/json
Result of an experiment gate that passed.
object
Example
{ "pass_rate": 0.93, "passed_every_trial": 0.9, "variant": "candidate", "verdict": "improvement"}404Experiment not found
Experiment not found
409Some variant's run is still going
Some variant’s run is still going
422The variant missed the bar
The variant missed the bar