Skip to content

GH-49676: [Python][Packaging] Avoid rebuilding all base images by not pulling base images on docker build #49678

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
raulcd wants to merge 6 commits into
base: main
Choose a base branch
from
+14 −9
Draft

GH-49676: [Python][Packaging] Avoid rebuilding all base images by not pulling base images on docker build #49678

Changes from all commits
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
663e4a6
GH-49676: [Python][Packaging] Avoid rebuilding all base images by not…
raulcd Apr 7, 2026
a0edd40
Revert --no-pull and split vcpkg installation in two steps to try and…
raulcd Apr 7, 2026
b45c287
Add opentelemetry to its own Docker image layer
raulcd Apr 7, 2026
4b9fd9c
Investigate whether the problem is around path length instead of laye…
raulcd Apr 7, 2026
90df6a8
Revert "Investigate whether the problem is around path length instead…
raulcd Apr 7, 2026
5479a8d
Remove opentelemetry from Windows wheels dependencies base image
raulcd Apr 7, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
23 changes: 14 additions & 9 deletions ci/docker/python-wheel-windows-vs2022-base.dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -128,20 +128,25 @@ ENV CMAKE_BUILD_TYPE=${build_type} `
VCPKG_DEFAULT_TRIPLET=amd64-windows-static-md-${build_type} `
VCPKG_FEATURE_FLAGS="manifests"
COPY ci/vcpkg/vcpkg.json arrow/ci/vcpkg/
# cannot use the S3 feature here because while aws-sdk-cpp=1.9.160 contains
# ssl related fixes as well as we can patch the vcpkg portfile to support
# arm machines it hits ARROW-15141 where we would need to fall back to 1.8.186
# but we cannot patch those portfiles since vcpkg-tool handles the checkout of
# previous versions => use bundled S3 build

# We split the dependencies installation into two steps to reduce the size
# if the intermediate image layers.
# Install FS dependencies first to avoid hitting the image size limit of
# the Windows container. GH-49676
RUN vcpkg install `
--clean-after-build `
--x-install-root=%VCPKG_ROOT%\installed `
--x-manifest-root=arrow/ci/vcpkg `
--x-feature=azure `
--x-feature=flight `
--x-feature=gcs `
--x-feature=s3

# Install the rest of the dependencies.
RUN vcpkg install `
--clean-after-build `
--x-install-root=%VCPKG_ROOT%\installed `
--x-manifest-root=arrow/ci/vcpkg `
--x-feature=flight `
--x-feature=json `
--x-feature=opentelemetry `
--x-feature=orc `
--x-feature=parquet `
--x-feature=s3
--x-feature=parquet
Loading