Voice nodes (openpanel V4): stt, tts, wren reply/unhandled, socket publish
- `stt`: one realtime transcription session per utterance on the speech
server's url, opened at `listening` true or the first chunk, committed at
false; a whole clip goes to /v1/audio/transcriptions. Returns at once and
publishes `partial` and `text` when the server answers.
- `tts`: one /v1/audio/speech call per sentence, cached by voice and text in
node state; a reference is marked `append` while earlier ones still play.
- wren: `reply` says what was applied, `unhandled` carries the prompt when
nothing was. The install hint names the git pin (PyPI's `wren` is another
package).
- ai/client: transcribe, speak and transcribe_stream beside stream_completion.
- A device socket publishes scalar `in` ports as {"type": "publish"} text,
in order with its binary frames.
- Pipeline.publish walks only what its values reach: a node downstream of a
consumer that published nothing no longer runs again (wren re-acted on
every microphone chunk).
This commit is contained in:
@@ -57,7 +57,9 @@ from fluksio.flow.nodes import (
|
||||
NtfyNode,
|
||||
RbeNode,
|
||||
ServiceNode,
|
||||
SttNode,
|
||||
SwitchNode,
|
||||
TtsNode,
|
||||
WebSocketNode,
|
||||
WrenNode,
|
||||
)
|
||||
@@ -383,6 +385,18 @@ NODE_TYPES: dict[str, NodeType] = {
|
||||
cls=WrenNode,
|
||||
params_schema=_schema_of(WrenNode),
|
||||
),
|
||||
"stt": NodeType(
|
||||
title="Speech to text",
|
||||
description="Turn a microphone's audio into text, through a speech server.",
|
||||
cls=SttNode,
|
||||
params_schema=_schema_of(SttNode),
|
||||
),
|
||||
"tts": NodeType(
|
||||
title="Text to speech",
|
||||
description="Speak text as audio for a speaker, through a speech server.",
|
||||
cls=TtsNode,
|
||||
params_schema=_schema_of(TtsNode),
|
||||
),
|
||||
"inject": NodeType(
|
||||
title="Inject",
|
||||
description="Emit a value on request, on a timer, or when the flow starts.",
|
||||
|
||||
Reference in New Issue
Block a user