Skip to content

QA to E2E: hydrogen#7048

Draft
phyllis-sy-wu wants to merge 2 commits intomainfrom
psyw-0319-QAtoE2E-hydrogen
Draft

QA to E2E: hydrogen#7048
phyllis-sy-wu wants to merge 2 commits intomainfrom
psyw-0319-QAtoE2E-hydrogen

Conversation

@phyllis-sy-wu
Copy link
Contributor

@phyllis-sy-wu phyllis-sy-wu commented Mar 19, 2026

WHY are these changes introduced?

To replace manual CLI QA with automated end-to-end tests that validate the complete app development workflow in a real environment. This is a part of Vault project #gsd:49408.

WHAT is this pull request doing?

Adds packages/e2e/tests/hydrogen.spec.ts — an e2e test for the Hydrogen basic flow using mock.shop:

  1. hydrogen init --install-deps --mock-shop — scaffolds the storefront and installs dependencies via npm (forced via npm_config_user_agent to avoid pnpm being detected from the monorepo environment). Asserts on "Storefront setup complete!"
    • Previously blocked: hydrogen init normally requires selecting a connected Shopify store with Hydrogen channel access. The--mock-shop flag bypasses this by routing all Storefront API calls to mock.shop, so no real store or Hydrogen channel is needed.
  2. hydrogen build — builds the storefront for production
  3. hydrogen dev — starts the MiniOxygen dev server and makes an HTTP request to verify it returns 200

How to test your changes?

Run the e2e test suite to verify the new Hydrogen test passes:

  DEBUG=1 pnpm --filter e2e exec playwright test hydrogen

The test should complete successfully, demonstrating that all three Hydrogen CLI commands work as expected.

Measuring impact

How do we know this change was effective? Please choose one:

  • n/a - this doesn't need measurement, e.g. a linting rule or a bug-fix
  • Existing analytics will cater for this addition
  • PR includes analytics changes to measure impact

Checklist

  • I've considered possible cross-platform impacts (Mac, Linux, Windows)
  • I've considered possible documentation changes

Copy link
Contributor Author

This stack of pull requests is managed by Graphite. Learn more about stacking.

@phyllis-sy-wu phyllis-sy-wu added the #gsd:49408 Agentic app validation label Mar 19, 2026 — with Graphite App
@github-actions
Copy link
Contributor

github-actions bot commented Mar 19, 2026

Coverage report

St.
Category Percentage Covered / Total
🟢 Statements 82.21% 14927/18157
🟡 Branches 74.64% 7392/9904
🟢 Functions 81.36% 3767/4630
🟢 Lines 82.61% 14114/17086

Test suite run success

3910 tests passing in 1502 suites.

Report generated by 🧪jest coverage report action from d519470

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

#gsd:49408 Agentic app validation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant