-
Notifications
You must be signed in to change notification settings - Fork 297
Closed as not planned
Labels
Description
Summary
Smoke test run for Claude engine — §23180654460
Overall Status: PARTIAL (2 skipped, rest passed)
PR used for review testing: #21342 (fix: add write-sink guard policies for non-GitHub MCP servers on auto-lockdown)
Timestamp: 2026-03-17T06:04:00Z
Core Tests (#1–10)
| # | Test | Result |
|---|---|---|
| 1 | GitHub MCP Testing (last 2 merged PRs) | ✅ #21339, #21336 via mcpscripts-gh fallback |
| 2 | MCP Scripts GH CLI Testing | ✅ #21342, #21082 |
| 3 | Serena MCP Testing (activate + find 3 symbols) | ✅ 3 symbols found (which test fn, compileCmd, compileWorkflow) |
| 4 | Make Build Testing | ✅ Build succeeded |
| 5 | Playwright Testing (github.com title) | ✅ Title: "GitHub · Change is constant." |
| 6 | Tavily Web Search Testing | ✅ 5 results returned |
| 7 | File Writing Testing | ✅ /tmp/gh-aw/agent/smoke-test-claude-23180654460.txt created |
| 8 | Bash Tool Testing | ✅ File read back successfully |
| 9 | Discussion Interaction Testing | ✅ Discussion #21344 found, comic-book comment added |
| 10 | Agentic Workflows MCP Testing | ✅ smoke-claude active, compiled, schedule every 12h |
PR Review Tests (#11–17)
| # | Test | Result |
|---|---|---|
| 11 | Update PR Testing | ✅ Body appended successfully |
| 12 | PR Review Comment Testing | ✅ 2 review comments on cloclo.lock.yml lines 764 & 803 |
| 13 | Submit PR Review Testing | ✅ COMMENT review submitted |
| 14 | Resolve Review Thread Testing | |
| 15 | Add Reviewer Testing | ✅ copilot reviewer added |
| 16 | Push to PR Branch Testing | ✅ apm.lock.yaml pushed to branch |
| 17 | Close PR Testing |
Notes
- Test rejig docs #1:
list_pull_requestsGitHub MCP exceeded token limit (67,859 chars); usedmcpscripts-ghas fallback — 2 merged PRs verified. - Test codex naming #14:
get_review_commentsGitHub MCP returns empty for this PR;gh pr viewdoes not exposereviewThreadsfield. Marked as skipped. - Test Enhance timestamp and token usage extraction for Codex format in logs #17: Triggering PR (fix: add write-sink guard policies for non-GitHub MCP servers on auto-lockdown #21342) is active work; no disposable test PR available. Safely skipped.
References:
💥 [THE END] — Illustrated by Smoke Claude · ◷
- expires on Mar 17, 2026, 8:06 AM UTC
Reactions are currently unavailable