Library-mode telemetry: Mongo-backed agent registry + SDK hooks + Bedrock + dashboard + matrix tests

[shreyas-lyzr]

Five commits, 32 files, +3420 / -16. Adds library-mode telemetry: a Mongo-backed agent registry, SDK telemetry hooks the customer's existing workers call into without needing a new HTTP service, Bedrock env passthrough through the harness subprocess, dashboard treatment of git URLs as canonical agent identity, and the test coverage that makes all of the above safe to change.

Drives this PoC shape (a customer's Temporal worker imports the SDK, no new pods):

await using agent = new ComputerAgent({
  source: { type: "git", url: "github.com/org/agent" },
  harness: "claude-agent-sdk",
  runtime: new LocalSubstrate(),
  envs: { CLAUDE_CODE_USE_BEDROCK: "1", AWS_REGION, AWS_BEDROCK_MODEL_ID },
  telemetry: new MongoTelemetry({ url, database: "agentos", agent: { name, source, harness } }),
});

Commits

abb8573	feat(sdk,agent-registry-mongo): library-mode telemetry hooks
5589a23	feat(agentos,scripts): Mongo-backed registry — dashboard + CRUD + SPA + seed
d782cf1	feat(engine,agentos): Bedrock env passthrough (2a) + git URL as agent identity (2b)
2545e9e	test(sdk): Phase 2c — telemetry-hook + claude-sdk × substrate × source matrix
981a4f9	test: TDD backfill — agent-registry-mongo + agentos CRUD + displaySource

What's new

AgentTelemetry interface + MongoTelemetry impl

• packages/sdk/src/telemetry.ts — AgentTelemetry contract: optional onAgentConstructed / onChatStart / onChatEnd / onClose hooks. Fire-and-forget — exceptions never propagate to chat.
• packages/sdk/src/computer-agent.ts — wires the hooks. Constructor fires onAgentConstructed; chat() wraps onChatStart / onChatEnd around the handle via Promise.resolve(handle as PromiseLike<ChatResult>).then(...); dispose() fires onClose. safeFireTelemetry swallows errors per hook.
• packages/agent-registry-mongo/ — new package. AgentRegistry (upsert by name with idempotent registeredAt), AgentLogStore (QUERY_MAX=8000, REPLY_MAX=16000, truncates with …), MongoTelemetry (writes to agent_registry + agent_logs).

Bedrock env passthrough

• packages/engine-claude-agent-sdk/src/engine.ts — inheritEssentialHostEnv now forwards CLAUDE_CODE_USE_BEDROCK, AWS_REGION, AWS_DEFAULT_REGION, AWS_BEDROCK_MODEL_ID, AWS_ROLE_ARN, AWS_WEB_IDENTITY_TOKEN_FILE, AWS_PROFILE, AWS_SHARED_CREDENTIALS_FILE, AWS_CONFIG_FILE into the harness subprocess. IRSA chain reaches the model client.

Dashboard + agent registry

• examples/agentos-api.ts — unions in-memory agents (server config) with agent_registry rows; in-memory wins on collision. New endpoints: POST /agents/register, PATCH /agents/:name, DELETE /agents/:name, GET /agents/by-source?url=.
• agentos/src/components/RegisterAgentForm.tsx — UI to register.
• agentos/src/components/SourceBadge.tsx — renders git URLs as clickable owner/repo; e.stopPropagation so the link doesn't fire the parent row click.
• agentos/src/api.ts — displaySource() helper parses https://, git@, scheme-less host/owner/repo, and bare owner/repo (defaults host to github.com); URL-encodes refs.
• scripts/seed-agent-registry.ts — idempotent one-shot to migrate the hardcoded in-memory list into the registry.

Tests

67 new tests across 5 files, 1163 LOC. Live-Mongo tests follow the existing session-store-mongo convention — gated by describeMongo = url ? describe : describe.skip on MONGO_URL, unique DB per run, drop on teardown.

File	Tests	Notes
packages/agent-registry-mongo/src/registry.test.ts	9	upsert shape, idempotent registeredAt, list ordering, get null, unregister idempotency, shared MongoClient
packages/agent-registry-mongo/src/audit-log.test.ts	8	append shape, QUERY_MAX/REPLY_MAX truncation, ordering, limit clamping [1, 500], filter combos, count() vs list()
packages/agent-registry-mongo/src/telemetry.test.ts	12	onAgentConstructed via SDK info + fallback path, onChatStart context threading, onChatEnd success + failure + duration-derived-from-ctx, configurable source tag, onError on Mongo failure without throwing, shared client lifecycle
examples/agentos-api.test.ts	18	drives createAgentOSApp via app.fetch(Request). CRUD: 400/200/idempotency/409/404 paths. GET /by-source: in-memory + registry match, dual-match (dedup detection), empty 200. GET /agents: union, origin tagging, in-memory wins on collision
packages/sdk/src/telemetry-hook.test.ts	7	MockEngine + in-process Hono harness. Verifies all 4 hooks fire, context threads onChatStart → onChatEnd, throwing telemetry doesn't break chat, async-rejecting telemetry doesn't break, no-telemetry path
packages/sdk/src/substrate-matrix.test.ts	10 (8 env-gated)	claude-agent-sdk × {Local, Bwrap, E2B} × {inline, local, git}. Per-row skipIf for Linux+bwrap and E2B_API_KEY and SDK_MATRIX_GIT_FIXTURE_URL
agentos/src/api.test.ts	20	pure displaySource tests: null/undefined sentinels, local + inline structured, git URL parsing (https, ssh git@, with ref, ref URL-encoded), gitlab/bitbucket hosts, scheme-less + bare owner/repo, legacy string source, fallbacks
packages/engine-claude-agent-sdk/src/engine.test.ts	+3	Bedrock + POSIX passthrough block

Test totals after this PR

	Passing	Skipped (env-gated)
pnpm -r test	349	57
agentos/ (standalone)	20	0
total	369	57

Offline run is fully green. Live-Mongo + ANTHROPIC + E2B paths auto-skip without their respective env vars.

What is NOT in this PR

• Helm charts / Terraform modules / production Dockerfiles — the customer owns their deploy stack.
• Tracing — a separate engineer is shipping an LLM proxy gateway; ComputerAgent picks it up via ANTHROPIC_BASE_URL when it lands.
• K8s pod-per-session substrate — not needed at PoC concurrency.

Verification

• pnpm -r typecheck clean
• pnpm -r test — 349 passing / 57 skipped / 0 failing
• pnpm --filter agentos test — 20 passing
• pnpm --filter agentos build — Vite build clean
• Manual: registered an agent via POST /agents/register, verified it shows on the dashboard with origin: "registry" + clickable git URL; in-memory collision keeps the server-configured wiring authoritative.

Migration

• Existing deployments: nothing to do — the dashboard now unions in-memory + registry; in-memory wins on collision so the current hardcoded list keeps behaving identically.
• To migrate the in-memory list into Mongo so it's editable via the CRUD endpoints: MONGO_URL=... pnpm tsx scripts/seed-agent-registry.ts. Safe to re-run.