add console, simulate, and agent dev commands by theomonnom · Pull Request #810 · livekit/livekit-cli

theomonnom · 2026-04-02T05:44:23Z

No description provided.

- Add friendly error when no agent project is detected (start/dev/console) - Print detected language and directory to stderr for start/dev/console - Deduplicate console detection logic to use shared detectProject() - Add nil guard in BytesToSamples for empty data

- Detect project root from entrypoint directory when --entrypoint is set - Better entrypoint-not-found error showing checked paths - Print detected language and directory to stderr for start/dev/console - Render CLI errors in red at the call site - Add maxMessageSize check to IPC WriteProto

…cally

Switch to the server-sdk-go branch that exports CreateSourceTarball, MultipartUpload, and AgentSimulationClient. Fix spinnerFrames reference across build tags.

…ecified

rektdeckard

Approving for expediency, and I am in fact able to build and test (mostly) successfully against agents on theo/1.6.0 branch -- but there are some rough edges particularly around console project/entrypoint detection, text mode, and ergonomics that need some attention. I have not had success testing simulations, as I assume there is still outstanding backend work for that?

rektdeckard · 2026-05-07T23:53:14Z

+	Action: runConsole,
+}
+
+func runConsole(ctx context.Context, cmd *cli.Command) error {


I'm seeing weird behavior when switching between audio and text modes in the console:

In text mode, messages are printed out-of-order (agent responses appearing before user)

Switching to text mode mid-call does not seem to work; responses continue to arrive in audio modality and text responses don't get printed

rektdeckard · 2026-05-08T01:49:45Z

+	&cli.StringFlag{
+		Name:    "url",
+		Usage:   "LiveKit server `URL`",
+		Sources: cli.EnvVars("LIVEKIT_URL"),
+	},
+	&cli.StringFlag{
+		Name:    "api-key",
+		Usage:   "LiveKit API `KEY`",
+		Sources: cli.EnvVars("LIVEKIT_API_KEY"),
+	},
+	&cli.StringFlag{
+		Name:    "api-secret",
+		Usage:   "LiveKit API `SECRET`",
+		Sources: cli.EnvVars("LIVEKIT_API_SECRET"),
+	},


These flags are already available globally; no need to redefine or even declare them on this command. But FYI, the precedence of resolution is:

project specified in livekit.toml (actually this is probably too high, should probably be after flags but separate issue)

explicit flags (--api-key, --api-secret, --url)

explicit project (--project)

environment variables

default project

rektdeckard · 2026-05-08T02:30:02Z

 make install
 ```

+### Building with console support


let's maybe comment this out until we feel the feature is stable

rektdeckard · 2026-05-08T02:32:15Z

+# This formula is meant for a custom Homebrew tap (e.g. livekit/homebrew-livekit).
+# It installs a prebuilt binary with console support (PortAudio + WebRTC AEC).
+# Usage: brew install livekit/livekit/lk
+class Lk < Formula


Are we sure we are unable to distribute prebuilt binaries through homebrew's core package repository?

yeah homebrew has to build it from source.. and sign it with apple distribution keys

rektdeckard · 2026-05-08T02:41:17Z

@claude review

…d row highlight

CLI architecture: - Non-interactive CI mode auto-detected (no TTY or CI env var) - Shared lifecycle functions in simulate.go (no bubbletea dependency) - simulate_ci.go: sequential runner with ::group:: output for GHA TUI improvements: - Detail view: unified scrollable content (instructions, transcript, logs) - Log filtering by room name prefix (latest retry only) - Compact chat transcript rendering - Removed filter tabs, simplified matrix rain - Mouse capture removed (text selection works) - Summary unavailable message, summarizing spinner Agent subprocess: - Debug logging enabled, room-indexed log storage - Per-room log filtering by prefix with latest-room tracking Bug fix: - Send CodeEntrypoint in ConfirmSourceUpload so the generator analyzes the correct file instead of the entire workspace

- Remove --url, --api-key, --api-secret flags from agent run commands (already available as global flags) - Fix console text mode: suppress UserInputTranscribed events in text mode to prevent duplicate/out-of-order user messages - Clear partial transcript when switching to text mode mid-call

theomonnom · 2026-05-11T05:26:01Z

For the text mode issue, I'll handle that in a separate PR. This requires some protocol changes inside our new RemoteSession

…anges - All agent subprocess commands (start, dev, console, simulate) require -tags console to build. Without the tag, they don't appear in lk agent. - Revert .github/workflows/release.yaml and banner to main - Remove .goreleaser.yaml (not on main) - Move noAgentError to agent.go (non-tagged) - Add init() registration for simulate command

…audio (#810) (#809) * add vendored WebRTC APM and PortAudio native sources * add console, simulate, and agent dev commands (#810) * add console, simulate, agent dev commands with TUI and protobuf IPC * improve agent detection error messages and consistency - Add friendly error when no agent project is detected (start/dev/console) - Print detected language and directory to stderr for start/dev/console - Deduplicate console detection logic to use shared detectProject() - Add nil guard in BytesToSamples for empty data * improve error messages, entrypoint detection, and IPC safety - Detect project root from entrypoint directory when --entrypoint is set - Better entrypoint-not-found error showing checked paths - Print detected language and directory to stderr for start/dev/console - Render CLI errors in red at the call site - Add maxMessageSize check to IPC WriteProto * add console build docs and PortAudio submodule check * add blank line after user/agent messages in console TUI * remove duplicate -lc++ linker flags, cgo handles C++ linking automatically * fix console TUI rendering, add startup spinner and handoff support * remove local replace directives, use published server-sdk-go Switch to the server-sdk-go branch that exports CreateSourceTarball, MultipartUpload, and AgentSimulationClient. Fix spinnerFrames reference across build tags. * update server-sdk-go to include complete AgentSimulationClient * update server-sdk-go to merged main with SimulationAdmin grant * Fix agent watcher exitCh race on restart * Remove default num-simulations, let server decide * Show 'Generating scenarios' without count when num-simulations not specified * Improve agent simulate TUI setup and log display * Read NumSimulations from server response * Use larger circle icon (⏺) in TUI * Integrate save scenario overlay, show labels in job list, fix selected row highlight * Softer yellow, use ⏺ for pending icons * Pad selected row to max label width for consistent highlight * Remove q to quit, only ctrl+c exits * CI mode, TUI improvements, log filtering, and entrypoint fix CLI architecture: - Non-interactive CI mode auto-detected (no TTY or CI env var) - Shared lifecycle functions in simulate.go (no bubbletea dependency) - simulate_ci.go: sequential runner with ::group:: output for GHA TUI improvements: - Detail view: unified scrollable content (instructions, transcript, logs) - Log filtering by room name prefix (latest retry only) - Compact chat transcript rendering - Removed filter tabs, simplified matrix rain - Mouse capture removed (text selection works) - Summary unavailable message, summarizing spinner Agent subprocess: - Debug logging enabled, room-indexed log storage - Per-room log filtering by prefix with latest-room tracking Bug fix: - Send CodeEntrypoint in ConfirmSourceUpload so the generator analyzes the correct file instead of the entire workspace * Use positional arg for entrypoint instead of --entrypoint flag * Address PR review: remove redundant flags, fix console text mode - Remove --url, --api-key, --api-secret flags from agent run commands (already available as global flags) - Fix console text mode: suppress UserInputTranscribed events in text mode to prevent duplicate/out-of-order user messages - Clear partial transcript when switching to text mode mid-call * Put start/dev/console/simulate behind console build tag, revert CI changes - All agent subprocess commands (start, dev, console, simulate) require -tags console to build. Without the tag, they don't appear in lk agent. - Revert .github/workflows/release.yaml and banner to main - Remove .goreleaser.yaml (not on main) - Move noAgentError to agent.go (non-tagged) - Add init() registration for simulate command * Add CI job for no-console, no-CGO build verification * Remove build-binaries.yaml workflow * Remove Homebrew formula * Restore .goreleaser.yml * Rename .goreleaser.yml to .goreleaser.yaml * Remove console build section from README * Add CI job for no-console, no-CGO build verification * Read Go version from go.mod instead of hardcoding in CI * Remove windows_arm from build matrix (no CGO, redundant with no-console job) * Fix staticcheck: tag agent_reload, move console-only vars to agent_run * Fix Windows build: extract platform-specific process management * Clean up unused RoomLogCount and stale entrypoint error message * Pin GitHub Actions to SHA references in build.yaml

theomonnom requested review from davidzhao and rektdeckard and removed request for davidzhao April 2, 2026 21:56

theomonnom force-pushed the theo/console-webrtc branch from b977661 to 734ede1 Compare April 2, 2026 22:50

theomonnom added 5 commits April 2, 2026 15:53

add console, simulate, agent dev commands with TUI and protobuf IPC

ad4ce38

add console build docs and PortAudio submodule check

f2a132f

add blank line after user/agent messages in console TUI

78a6094

theomonnom force-pushed the theo/console-v2 branch from 1bb7b41 to 78a6094 Compare April 2, 2026 22:54

remove duplicate -lc++ linker flags, cgo handles C++ linking automati…

8be6798

…cally

theomonnom force-pushed the theo/console-v2 branch 9 times, most recently from a63b57e to 23148aa Compare April 3, 2026 00:16

fix console TUI rendering, add startup spinner and handoff support

3df43a6

theomonnom force-pushed the theo/console-v2 branch from 23148aa to 3df43a6 Compare April 3, 2026 01:08

theomonnom added 7 commits April 2, 2026 20:59

remove local replace directives, use published server-sdk-go

61a5803

Switch to the server-sdk-go branch that exports CreateSourceTarball, MultipartUpload, and AgentSimulationClient. Fix spinnerFrames reference across build tags.

update server-sdk-go to include complete AgentSimulationClient

d10d751

update server-sdk-go to merged main with SimulationAdmin grant

e90f904

Fix agent watcher exitCh race on restart

661d54a

Remove default num-simulations, let server decide

b69df70

Show 'Generating scenarios' without count when num-simulations not sp…

3637354

…ecified

Improve agent simulate TUI setup and log display

d98d896

rektdeckard approved these changes May 8, 2026

View reviewed changes

theomonnom added 3 commits May 8, 2026 13:46

Read NumSimulations from server response

ef2393d

Use larger circle icon (⏺) in TUI

6f6edb4

Integrate save scenario overlay, show labels in job list, fix selecte…

74c34fd

…d row highlight

theomonnom force-pushed the theo/console-v2 branch from d7789e8 to 74c34fd Compare May 8, 2026 22:01

theomonnom added 3 commits May 8, 2026 15:04

Softer yellow, use ⏺ for pending icons

f9763a6

Pad selected row to max label width for consistent highlight

ff16c48

Remove q to quit, only ctrl+c exits

3a994d9

theomonnom force-pushed the theo/console-v2 branch from f78423f to 3a994d9 Compare May 8, 2026 22:13

theomonnom force-pushed the theo/console-v2 branch from 5c3ab69 to c9fbc7f Compare May 11, 2026 05:15

Use positional arg for entrypoint instead of --entrypoint flag

6cf8fe0

theomonnom force-pushed the theo/console-v2 branch from c9fbc7f to 6cf8fe0 Compare May 11, 2026 05:16

theomonnom added 7 commits May 10, 2026 22:34

Add CI job for no-console, no-CGO build verification

4746a54

Remove build-binaries.yaml workflow

08618d4

Remove Homebrew formula

5b998c5

Restore .goreleaser.yml

220f67b

Rename .goreleaser.yml to .goreleaser.yaml

22e399f

Remove console build section from README

feef68f

theomonnom merged commit 1e7fa57 into theo/console-webrtc May 11, 2026
1 check passed

theomonnom deleted the theo/console-v2 branch May 11, 2026 05:41

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

add console, simulate, and agent dev commands#810

add console, simulate, and agent dev commands#810
theomonnom merged 30 commits into
theo/console-webrtcfrom
theo/console-v2

theomonnom commented Apr 2, 2026

Uh oh!

rektdeckard left a comment

Uh oh!

rektdeckard May 7, 2026

Uh oh!

rektdeckard May 8, 2026

Uh oh!

rektdeckard May 8, 2026

Uh oh!

rektdeckard May 8, 2026

Uh oh!

davidzhao May 8, 2026

Uh oh!

rektdeckard commented May 8, 2026

Uh oh!

theomonnom commented May 11, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Conversation

theomonnom commented Apr 2, 2026

Uh oh!

rektdeckard left a comment

Choose a reason for hiding this comment

Uh oh!

rektdeckard May 7, 2026

Choose a reason for hiding this comment

Uh oh!

rektdeckard May 8, 2026

Choose a reason for hiding this comment

Uh oh!

rektdeckard May 8, 2026

Choose a reason for hiding this comment

Uh oh!

rektdeckard May 8, 2026

Choose a reason for hiding this comment

Uh oh!

davidzhao May 8, 2026

Choose a reason for hiding this comment

Uh oh!

rektdeckard commented May 8, 2026

Uh oh!

theomonnom commented May 11, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants