Skip to content

ci: Remove dev realm indexing from realm server tests#5039

Merged
backspace merged 4 commits into
mainfrom
ci-realm-server-tests-no-catalog-cs-11305
Jun 1, 2026
Merged

ci: Remove dev realm indexing from realm server tests#5039
backspace merged 4 commits into
mainfrom
ci-realm-server-tests-no-catalog-cs-11305

Conversation

@backspace

@backspace backspace commented May 29, 2026

Copy link
Copy Markdown
Contributor

#5008 aims to move some CI jobs to use environment mode to prevent regressions, but I noticed that the realm server shards were running roughly 30% more quickly. It turned out to be that tests were proceeding without realms having fully indexed. This adds an option to skip indexing when a realm starts, which most tests don’t need.

An example set of shards with this change:

CleanShot 2026-06-01 at 12 56 39@2x

The same set in #5029:

CleanShot 2026-06-01 at 12 58 59@2x

@github-actions

github-actions Bot commented May 29, 2026

Copy link
Copy Markdown
Contributor

Host Test Results

    1 files      1 suites   1h 49m 21s ⏱️
2 861 tests 2 846 ✅ 15 💤 0 ❌
2 880 runs  2 865 ✅ 15 💤 0 ❌

Results for commit a94670c.

Realm Server Test Results

    1 files  ±0      1 suites  ±0   10m 45s ⏱️ -40s
1 527 tests ±0  1 526 ✅ ±0  1 💤 ±0  0 ❌ ±0 
1 618 runs  ±0  1 617 ✅ ±0  1 💤 ±0  0 ❌ ±0 

Results for commit a94670c. ± Comparison against earlier commit 1fc2aaf.

@backspace backspace force-pushed the ci-realm-server-tests-no-catalog-cs-11305 branch from b4eac61 to b2045c6 Compare May 29, 2026 18:11
…gate

Replaces the mount-only readiness gate with a cleaner fix for the same goal.
The realm-server suite runs its own in-process realms + test Postgres and only
needs the boot dev realms (base/skills/openrouter/software-factory) to serve
*source* — definitions resolve lazily via the prerenderer, so those realms
don't need a populated index. CI uses a fresh Postgres every run, so each boot
realm would otherwise run a from-scratch index (~minutes) that both delayed
`_readiness-check` and competed with the tests' own renders for the prerender
page pool, intermittently starving render-heavy tests into timeouts.

New `REALM_SERVER_SKIP_BOOT_INDEX` env (Realm `skipBootIndex` option) makes a
realm mount and serve source without the boot index, even on a new index. It's
set only on the phase-1 dev realm server in the test launcher — the phase-2
node-test realm, whose indexed content the suite reads, still indexes. With no
boot index to await, `_readiness-check` resolves at mount, so the readiness
gate reverts to `_readiness-check`.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@backspace backspace force-pushed the ci-realm-server-tests-no-catalog-cs-11305 branch from b2045c6 to 1cdac15 Compare May 29, 2026 19:57
@backspace backspace changed the title ci: Remove catalog from realm server tests ci: Remove dev realm indexing from realm server tests Jun 1, 2026
backspace and others added 2 commits June 1, 2026 13:46
Reference start:development / start:test-realms directly instead of
positional phase labels that aren't grounded in this file.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@backspace backspace marked this pull request as ready for review June 1, 2026 20:27
@backspace backspace requested a review from a team June 1, 2026 21:40
@backspace backspace merged commit f4f1ed9 into main Jun 1, 2026
93 of 94 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants