Skip to content

acceptance: skip ruff prerequisite on DBR#5699

Draft
shreyas-goenka wants to merge 1 commit into
mainfrom
dbr-ruff-fix
Draft

acceptance: skip ruff prerequisite on DBR#5699
shreyas-goenka wants to merge 1 commit into
mainfrom
dbr-ruff-fix

Conversation

@shreyas-goenka

Copy link
Copy Markdown
Contributor

Why

Every DBR acceptance test run (./task dbr-testTestDbrAcceptance) was failing immediately, before any test ran.

The acceptance harness calls requirePrerequisites unconditionally, which calls RequireRuff. But the DBR test archive (internal/testarchive) bundles only go, uv and jq — ruff is neither bundled nor present on the serverless image, so the run fails fast with:

ruff not found on PATH (acceptance tests require ruff >= 0.9.1)

No RunsOnDbr=true test actually uses ruff — only the local-only check-formatting test does. So the requirement is dead weight in DBR mode.

What

Skip the ruff prerequisite when running in DBR mode (WorkspaceTmpDir), mirroring the existing terraform-setup skip a few lines below. The local path is unchanged — ruff is still required there.

if !WorkspaceTmpDir {
    internal.RequireRuff(t, "0.9.1")
}

The DBR test archive bundles only go, uv and jq (see internal/testarchive);
ruff is neither bundled nor present on the serverless image. requirePrerequisites
called RequireRuff unconditionally, so every DBR run failed fast before any test
ran. No RunsOnDbr test exercises ruff (only the local-only check-formatting test
does), so skip the check in DBR mode, mirroring the existing terraform skip.

Co-authored-by: Isaac
@eng-dev-ecosystem-bot

Copy link
Copy Markdown
Collaborator

Integration test report

Commit: 9a81e9f

Run: 28094167722

Env ❌​FAIL 🟨​KNOWN 🔄​flaky 💚​RECOVERED 🙈​SKIP ✅​pass 🙈​skip Time
🟨​ aws linux 7 13 244 1024 6:50
🟨​ aws windows 7 13 246 1022 7:43
💚​ aws-ucws linux 7 13 334 940 5:07
💚​ aws-ucws windows 7 13 336 938 6:31
💚​ azure linux 1 15 247 1022 6:04
💚​ azure windows 1 15 249 1020 5:15
❌​ azure-ucws linux 2 1 1 15 336 936 8:40
💚​ azure-ucws windows 1 15 341 934 5:13
💚​ gcp linux 1 15 246 1024 5:17
💚​ gcp windows 1 15 248 1022 5:08
23 interesting tests: 13 SKIP, 7 KNOWN, 2 FAIL, 1 flaky
Test Name aws linux aws windows aws-ucws linux aws-ucws windows azure linux azure windows azure-ucws linux azure-ucws windows gcp linux gcp windows
🟨​ TestAccept 🟨​K 🟨​K 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
🙈​ TestAccept/bundle/invariant/no_drift 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🙈​ TestAccept/bundle/resources/permissions 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🟨​ TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions 🟨​K 🟨​K 💚​R 💚​R 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🟨​ TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions/DATABRICKS_BUNDLE_ENGINE=direct 🟨​K 🟨​K 💚​R 💚​R
🟨​ TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions/DATABRICKS_BUNDLE_ENGINE=terraform 🟨​K 🟨​K 💚​R 💚​R
🟨​ TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions 🟨​K 🟨​K 💚​R 💚​R 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🟨​ TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions/DATABRICKS_BUNDLE_ENGINE=direct 🟨​K 🟨​K 💚​R 💚​R
🟨​ TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions/DATABRICKS_BUNDLE_ENGINE=terraform 🟨​K 🟨​K 💚​R 💚​R
🙈​ TestAccept/bundle/resources/postgres_branches/basic 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🙈​ TestAccept/bundle/resources/postgres_branches/recreate 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🙈​ TestAccept/bundle/resources/postgres_branches/replace_existing 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🙈​ TestAccept/bundle/resources/postgres_branches/update_protected 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🙈​ TestAccept/bundle/resources/postgres_branches/without_branch_id 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🙈​ TestAccept/bundle/resources/postgres_endpoints/basic 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🙈​ TestAccept/bundle/resources/postgres_projects/update_display_name 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🙈​ TestAccept/bundle/resources/synced_database_tables/basic 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🙈​ TestAccept/bundle/resources/vector_search_endpoints/drift/recreated_same_name 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🙈​ TestAccept/bundle/resources/vector_search_indexes/recreate/embedding_dimension 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🙈​ TestAccept/ssh/connection 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
❌​ TestFetchRepositoryInfoAPI_FromRepo ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p ❌​F ✅​p ✅​p ✅​p
❌​ TestFetchRepositoryInfoAPI_FromRepo/root ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p ❌​F ✅​p ✅​p ✅​p
🔄​ TestFetchRepositoryInfoAPI_FromRepo/subdir ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p 🔄​f ✅​p ✅​p ✅​p
Top 7 slowest tests (at least 2 minutes):
duration env testname
3:23 gcp windows TestAccept
3:13 aws-ucws windows TestAccept
3:11 azure windows TestAccept
2:42 azure linux TestSecretsPutSecretStringValue
2:42 aws linux TestSecretsPutSecretStringValue
2:33 azure-ucws windows TestAccept
2:22 gcp linux TestSecretsPutSecretStringValue

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants