wren node: calibration setting, passed to wren's training as the installation's calibration records
This commit is contained in:
@@ -379,6 +379,7 @@ name of its own, in the node panel's port name field or as
|
||||
| `targets` | empty | by target port, what the model is told of it and how far it is trusted (below) |
|
||||
| `aliases` | empty | map your own names to the model's target names, such as `{"desk lamp": "office light"}` |
|
||||
| `examples` | empty | for training only, commands to learn beyond the ones wren generates (below) |
|
||||
| `calibration` | empty | for training only, commands in your own words a new model's threshold is chosen on (below) |
|
||||
| `tests` | empty | for training only, commands a new model is scored on (below) |
|
||||
|
||||
Every field of a `targets` entry is optional:
|
||||
@@ -432,9 +433,11 @@ the store with `PUT /artifacts` (see the [API](../code/api.md#artifacts)).
|
||||
|
||||
**Train** in the node panel trains a new model for the node as a run of wren's
|
||||
training flow, `wren_train`. It learns the targets wired to the node, as the
|
||||
panel shows them with unpublished edits included, and its `examples`, and it
|
||||
scores the new model on its `tests`. Both are lists in wren's installation
|
||||
format, with targets named by port:
|
||||
panel shows them with unpublished edits included, and its `examples`. It
|
||||
chooses the new model's confidence threshold on generated commands and on the
|
||||
node's `calibration`, which it never trains on, and scores the model on its
|
||||
`tests`. All three are lists in wren's installation format, with targets named
|
||||
by port, and no command may be in two of them:
|
||||
|
||||
```json
|
||||
{"state": {"user_location": "kitchen"}, "command": "lights on please",
|
||||
@@ -443,7 +446,7 @@ format, with targets named by port:
|
||||
|
||||
A call is `[target, value]`, `[target, value, delay_s]` or, for a read,
|
||||
`[target]`. A test with `"calls": []` is a command the model must pass on. The
|
||||
node never reads either setting when it runs, and wren refuses an example its
|
||||
node never reads these settings when it runs, and wren refuses an example its
|
||||
targets cannot answer before training starts. The panel follows the run and
|
||||
shows the model's exact match, coverage and threshold, and its exact match on
|
||||
the tests, once it ends. **Use this model** sets the new model as `model` in
|
||||
|
||||
Reference in New Issue
Block a user