# everruns observers

> Online scoring of live traces. CLI reference for everruns observers.

Source: <https://everruns.com/docs/reference/cli/observers/>

Online scoring of live traces.

| Command                                           | What it does                               |
| ------------------------------------------------- | ------------------------------------------ |
| [`observers create`](#observers-create)           | Create an observer (online scoring).       |
| [`observers delete`](#observers-delete)           | Archive an observer.                       |
| [`observers get`](#observers-get)                 | Get a single observer.                     |
| [`observers list`](#observers-list)               | List observers.                            |
| [`observers update`](#observers-update)           | Update an observer.                        |
| [`observers scores list`](#observers-scores-list) | List trace scores produced by an observer. |

## observers create

Create an observer (online scoring).

```bash
everruns observers create [OPTIONS] --name <name> --scorers <scorers>
```

| Flag                              | Description                                    |
| --------------------------------- | ---------------------------------------------- |
| `--description <DESCRIPTION>`     | Human-readable description.                    |
| `--match <MATCH>`                 |                                                |
| `--name <NAME>`                   | Required. Human-readable name.                 |
| `--sampling-rate <SAMPLING_RATE>` | Fraction of matching turns to score (0.0–1.0). |
| `--scorers <SCORERS>`             | Required. Scoring rules.                       |

Example:

```bash
# Score a sample of production turns automatically
everruns observers create --name helpfulness --sampling-rate 0.1 --scorers '[{"key":"mentions_docs","method":"rule","rule":{"type":"contains","text":"docs"}}]' --reason 'Track answer quality'
```

## observers delete

Archive an observer.

```bash
everruns observers delete [OPTIONS] --observer-id <observer_id>
```

| Flag                          | Description                                      |
| ----------------------------- | ------------------------------------------------ |
| `--observer-id <OBSERVER_ID>` | Required. Observer’s prefixed public identifier. |

Example:

```bash
# Archive an observer you no longer want scoring turns
everruns observers delete --observer-id observer_01h9 --reason 'Replaced by a stricter observer'
```

## observers get

Get a single observer.

```bash
everruns observers get [OPTIONS] [OBSERVER_ID]
```

| Flag                          | Description                            |
| ----------------------------- | -------------------------------------- |
| `--observer-id <OBSERVER_ID>` | Observer’s prefixed public identifier. |

Example:

```bash
# Check an observer's scorers, match rules and sampling rate
everruns observers get observer_01h9
```

## observers list

List observers.

```bash
everruns observers list [OPTIONS]
```

| Flag                 | Description                 |
| -------------------- | --------------------------- |
| `--include-archived` | Include archived observers. |

Example:

```bash
# See which observers are scoring production sessions
everruns observers list
```

## observers update

Update an observer.

```bash
everruns observers update [OPTIONS] --observer-id <observer_id>
```

| Flag                              | Description                                      |
| --------------------------------- | ------------------------------------------------ |
| `--description <DESCRIPTION>`     | Human-readable description.                      |
| `--match <MATCH>`                 |                                                  |
| `--name <NAME>`                   | Human-readable name.                             |
| `--observer-id <OBSERVER_ID>`     | Required. Observer’s prefixed public identifier. |
| `--sampling-rate <SAMPLING_RATE>` | Fraction of matching turns to score (0.0–1.0).   |
| `--scorers <SCORERS>`             |                                                  |
| `--status <STATUS>`               |                                                  |

Example:

```bash
# Score fewer turns to cut judge cost
everruns observers update --observer-id observer_01h9 --sampling-rate 0.05 --reason 'Reduce scoring volume'
```

## observers scores list

List trace scores produced by an observer.

```bash
everruns observers scores list [OPTIONS] --observer-id <observer_id>
```

| Flag                          | Description                                      |
| ----------------------------- | ------------------------------------------------ |
| `--limit <LIMIT>`             |                                                  |
| `--observer-id <OBSERVER_ID>` | Required. Observer’s prefixed public identifier. |
| `--offset <OFFSET>`           |                                                  |
| `--session-id <SESSION_ID>`   | Session’s prefixed public identifier.            |

Example:

```bash
# Look at the scores an observer gave one session
everruns observers scores list --observer-id observer_01h9 --session-id session_01h9
```