Migrate Performance Metrics to Buildkite pipeline#2310
Conversation
📊 Performance Test ResultsComparing 716b93a vs trunk site-editor
site-startup
Results are median values from multiple test runs. Legend: 🟢 Improvement (faster) | 🔴 Regression (slower) | ⚪ No change |
| echo "--- :information_source: Skipping metrics for non-trunk branch" | ||
| exit 0 | ||
| fi |
There was a problem hiding this comment.
Have you considered running this check at the start of the script? This way, if the "skip" branch of the conditional should run, we can avoid installing dependencies and the rest of the setup and save some time.
There was a problem hiding this comment.
Would it make sense to run this condition as part of pipeline logic, as we do in other steps? For example:
if: build.branch == 'trunk' || build.pull_request.base_branch == 'trunk'
| key: metrics | ||
| agents: | ||
| queue: mac | ||
| command: bash .buildkite/commands/run-metrics-tests.sh |
There was a problem hiding this comment.
Nitpick: I think calling bash is redundant here because the script already has !#/usr/bin/env bash. Most of the .sh scripts we use as the command steps in other projects are invoked that way.
| command: bash .buildkite/commands/run-metrics-tests.sh | |
| command: .buildkite/commands/run-metrics-tests.sh |
Update: After looking at the pipeline while working on #2327, I noticed that calling the script via bash is the standard in the pipeline, so it'd be out of place to change it in this PR.
There was a problem hiding this comment.
Thanks for confirming that.
Related issues
Proposed Changes
Testing Instructions
Pre-merge Checklist