Skip to content

Comments

feat: add Claude Code Git-linked Agent Tracing automation#3

Draft
jannikmaierhoefer wants to merge 14 commits intomainfrom
codex/git-linked-agent-tracing-claude-code
Draft

feat: add Claude Code Git-linked Agent Tracing automation#3
jannikmaierhoefer wants to merge 14 commits intomainfrom
codex/git-linked-agent-tracing-claude-code

Conversation

@jannikmaierhoefer
Copy link

@jannikmaierhoefer jannikmaierhoefer commented Feb 20, 2026

Summary

Adds Phase 2 Claude Code automation commands to langfuse-cli:

  • langfuse enable
  • langfuse disable
  • langfuse status
  • langfuse traces

This automates Claude hook setup, per-repo tracing config, and git-linked trace manifests while keeping existing langfuse api ... and langfuse get-skill behavior intact.

What Changed

  • Added command routing in src/cli.ts for enable, disable, status, and traces.
  • Implemented new command modules:
    • src/commands/enable.ts
    • src/commands/disable.ts
    • src/commands/status.ts
    • src/commands/traces.ts
  • Added shared utilities for:
    • repo root detection and git metadata
    • safe JSON read/merge/atomic write
    • Claude hook add/remove/idempotency
    • script install/backup/replace behavior (--force)
    • manifest parsing/listing
  • Added hook script templates:
    • ~/.claude/hooks/langfuse_hook.py (Stop hook)
    • ~/.claude/hooks/langfuse_git_commit_hook.py (PostToolUse Bash hook)
  • Hook behavior now supports:
    • session handoff file: .langfuse/current-session.json
    • git-commit observation span linked via trace_context.trace_id
    • compact manifest writes to .langfuse/traces/<session-id>.json
  • Added docs in README.md for new commands, setup model, and manifest schema.

Behavioral Notes

  • enable is idempotent and avoids duplicate hook entries.
  • Existing hook scripts are not overwritten unless --force; differing files emit a warning.
  • disable removes only exact Langfuse hook command entries and preserves unrelated settings.
  • traces --json always returns a JSON array (empty array when no manifests are present).

Validation

bun is not available in this execution environment, so bun run build could not be executed here.

Smoke checks were run via deno eval --unstable-sloppy-imports against src/cli.ts:

  • langfuse --help shows new commands.
  • langfuse enable --dry-run --non-interactive --public-key ... --secret-key ... shows planned changes and warnings.
  • langfuse status --json returns expected shape/fields.
  • langfuse traces --json returns [] when manifests are absent.
  • langfuse disable --dry-run --remove-scripts shows planned removals.

Commits

  • feat: add Claude Code tracing automation commands
  • docs: document Claude Code tracing automation workflow

jannikmaierhoefer and others added 14 commits February 20, 2026 16:01
@jannikmaierhoefer
feat: add Claude Code tracing automation commands
6640d31
@jannikmaierhoefer
docs: document Claude Code tracing automation workflow
f63e2f7
@jannikmaierhoefer @claude
refactor: nest Claude Code commands under `langfuse integration claud…
3a2cad0 
…ecode`

Introduces a two-level command hierarchy (`integration` → `claudecode`)
so commands are now invoked as `langfuse integration claudecode enable`
instead of `langfuse enable`. This structure supports future integrations.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@jannikmaierhoefer @claude
feat: update hook scripts to match langfuse docs and installed versions
c071337 
Replace the embedded STOP_HOOK_SCRIPT with the advanced version from the
Langfuse documentation featuring incremental transcript reading, file
locking, proper turn assembly with nested spans/generations/tool
observations, and state stored in ~/.claude/state/.

Update GIT_COMMIT_HOOK_SCRIPT with _build_release_tag() and
_update_env_release() functions from the installed version.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@jannikmaierhoefer @claude
feat: add prepare-commit-msg git hook for Langfuse trace trailers
b86186a 
Automatically appends a `Langfuse-Trace: <url>` trailer to commit
messages made during Claude Code sessions, linking commits to their
Langfuse traces.

- Stop hook now persists trace info to ~/.claude/state/langfuse_last_trace.json
- New prepare-commit-msg Python script reads trace state and appends trailer
- Shell wrapper in .git/hooks/ chains pre-existing hooks via .pre-langfuse backup
- enable/disable/status commands updated for the new hook lifecycle
- GIT_COMMIT_HOOK_SCRIPT fixed to read from new state file with legacy fallback

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@jannikmaierhoefer @claude
test: verify Langfuse tracing integration
5f3a6ce 
Add test comment to .gitignore to trigger prepare-commit-msg hook
and verify Langfuse trace trailers are appended correctly.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@jannikmaierhoefer @claude
test: verify Langfuse trace trailer in commit
522d962 
Update test comment to confirm prepare-commit-msg hook appends
Langfuse-Trace trailer when TRACE_TO_LANGFUSE is exported.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Langfuse-Trace: https://cloud.langfuse.com/trace/5621f51aff823caa37a049eda480e811
@jannikmaierhoefer @claude
test: add comment to README for tracing integration verification
92854db 
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Langfuse-Trace: https://cloud.langfuse.com/trace/cd9d4bfc05c99cc8b5ad5a8d876e6308
@jannikmaierhoefer @claude
feat: pre-generate trace ID at session start for accurate commit linking
d1c5d32 
Add a PreToolUse hook (langfuse_session_init_hook.py) that generates a
deterministic Langfuse trace ID from the session_id on the first tool
use, using langfuse.create_trace_id(seed=session_id) per Langfuse docs.
This ensures prepare-commit-msg references the current session's trace
rather than a stale one from a previous session.

The Stop hook now reads the pre-generated trace_id and passes it via
trace_context so emitted turns land under the same deterministic trace.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Langfuse-Trace: https://cloud.langfuse.com/trace/bc1555cd04ce2bc585d9d24fa2e0cf3a
@jannikmaierhoefer @claude
test: verify tracing with web search and commit flow
7d14bc3 
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Langfuse-Trace: https://cloud.langfuse.com/trace/e1dc11168ab4dce48277f991752c20a8
@jannikmaierhoefer @claude
test: verify tracing with web search and commit flow (#2)
bb6feb9 
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@jannikmaierhoefer @claude
test: verify tracing with web search and commit flow
1c8ae1b 
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Langfuse-Trace: https://cloud.langfuse.com/trace/4545f39af1f0169318412c58a790207d
@jannikmaierhoefer @claude
fix: disable command now removes all hook variants and PreToolUse hook
9731628 
The `||` short-circuit caused pattern-based removal to be skipped when
the exact-match removal succeeded, leaving behind .venv/bin/python3
variant hooks. Switched to `|` (bitwise OR) so both passes always run.
Also added missing PreToolUse hook removal and session init script
cleanup that were not present in the original disable command.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@jannikmaierhoefer
Audit traces script env prompting
b206ef8
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@jannikmaierhoefer