Skip to content

feat(examples): add LemonSlice avatar actions#1688

Open
rosetta-livekit-bot[bot] wants to merge 1 commit into
mainfrom
stipples-tenacity-unique
Open

feat(examples): add LemonSlice avatar actions#1688
rosetta-livekit-bot[bot] wants to merge 1 commit into
mainfrom
stipples-tenacity-unique

Conversation

@rosetta-livekit-bot
Copy link
Copy Markdown
Contributor

@rosetta-livekit-bot rosetta-livekit-bot Bot commented Jun 2, 2026

Summary

  • Add wave/dance/turn tools for Leila, Jess, and Mr Fox via LemonSlice pose triggers (actions.py)
  • Auto-wave on session start and after switching to a motion-capable persona
  • Trim persona list from 15 to 9; add Leila and Jess, remove underperforming personas; default to Leila
  • Update playground dropdown and README

@changeset-bot
Copy link
Copy Markdown

changeset-bot Bot commented Jun 2, 2026

⚠️ No Changeset found

Latest commit: dfd89e2

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

Copy link
Copy Markdown
Contributor

@devin-ai-integration devin-ai-integration Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Devin Review found 1 potential issue.

View 5 additional findings in Devin Review.

Open in Devin Review

Comment on lines +89 to +100
const avatar = makeAvatar(initial);
const sessionId = await avatar.start(session, ctx.room);
const state: State = { persona: initial, avatar, sessionId };

if (supportsActions(initial.id)) {
actions.setSession(state.sessionId, initial.id);
}

await session.start({
agent: makeAgent(initial, actions),
room: ctx.room,
});
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🔴 Avatar started before AgentSession.start() causes RoomIO to overwrite avatar audio output

The avatar is started at line 90 (await avatar.start(session, ctx.room)) BEFORE session.start() at line 97. The lemonslice AvatarSession.start() sets agentSession.output.audio = new DataStreamAudioOutput(...) (plugins/lemonslice/src/avatar.ts:255). Then when session.start() runs, it creates a RoomIO which unconditionally overwrites agentSession.output.audio with its own ParticipantAudioOutput (agents/src/voice/room_io/room_io.ts:578-580). The _startImpl warning at agents/src/voice/agent_session.ts:497-501 says "ignoring" but doesn't actually prevent the overwrite.

This means the avatar will never receive audio and won't animate on initial startup. All other avatar examples (trugen_avatar.ts, bey_avatar.ts, lemonslice_realtime_avatar.ts) start the avatar AFTER session.start(), so the avatar's start() correctly overrides RoomIO's output. The persona-switch path (lines 137-138) is unaffected since the session is already started and RoomIO doesn't re-run.

Suggested change
const avatar = makeAvatar(initial);
const sessionId = await avatar.start(session, ctx.room);
const state: State = { persona: initial, avatar, sessionId };
if (supportsActions(initial.id)) {
actions.setSession(state.sessionId, initial.id);
}
await session.start({
agent: makeAgent(initial, actions),
room: ctx.room,
});
await session.start({
agent: makeAgent(initial, actions),
room: ctx.room,
});
const avatar = makeAvatar(initial);
const sessionId = await avatar.start(session, ctx.room);
const state: State = { persona: initial, avatar, sessionId };
if (supportsActions(initial.id)) {
actions.setSession(state.sessionId, initial.id);
}
Open in Devin Review

Was this helpful? React with 👍 or 👎 to provide feedback.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants