Skip to content

Trim Build macOS plugin prompts#263

Open
dimillian-oai wants to merge 1 commit into
mainfrom
dimillian/build-macos-plugin-prompt-budget
Open

Trim Build macOS plugin prompts#263
dimillian-oai wants to merge 1 commit into
mainfrom
dimillian/build-macos-plugin-prompt-budget

Conversation

@dimillian-oai
Copy link
Copy Markdown
Contributor

Summary

  • normalize the Build macOS Apps plugin starter prompt to the current plugin prompt-array contract
  • shorten the plugin-level prompt and all macOS skill trigger descriptions so discovery metadata stays compact
  • defer detailed sidebar/split-view and window modifier examples into references while keeping skill entrypoints focused

Why

build-macos-apps could not be scored by plugin-eval while its manifest starter prompt was still a string. After that prompt shape was normalized, the static report showed both trigger and invocation budget failures driven by long skill trigger metadata and detailed examples in always-loaded SKILL.md entrypoints.

This PR keeps the same macOS skill inventory and routing terms, but moves detailed examples out of the entrypoint path where they can be loaded only when the task needs them.

Impact

Build macOS Apps keeps its existing workflows while its starter prompt metadata matches the current plugin contract, trigger descriptions are smaller, and high-detail SwiftUI/window examples live in references instead of always-loaded skill bodies.

plugin-eval report progression

The same local report command was used throughout:

cd plugins/plugin-eval
node ./scripts/plugin-eval.js analyze ../build-macos-apps --format markdown

Before the manifest prompt was normalized, plugin-eval could not emit a scored report because the string-shaped defaultPrompt hit:

((intermediate value) || []).join is not a function
State Score Risk Checks Trigger Invoke Deferred Active Total
First scored report after starter-prompt shape normalization 67 / D high 2 fail, 1 warn, 2 info 899 15529 7722 16428 24150
After compacting all Build macOS skill descriptions 77 / C high 1 fail, 2 warn, 2 info 464 15092 7722 15556 23278
Final after deferring sidebar/split and window API examples 86 / B medium 0 fail, 3 warn, 2 info 464 14291 8507 14755 23262

The final report clears the trigger and invocation budget failures. Remaining warnings are static budget warnings for trigger, invoke, and deferred text.

Validation

  • node ./scripts/plugin-eval.js analyze ../build-macos-apps --format markdown
  • git diff --check

@dimillian-oai dimillian-oai changed the title [codex] Trim Build macOS plugin prompts Trim Build macOS plugin prompts May 21, 2026
@dimillian-oai dimillian-oai marked this pull request as ready for review May 21, 2026 09:05
@dimillian-oai dimillian-oai requested review from a team, cching-openai and vb-openai May 21, 2026 09:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant