CPBR-3030 | Upgrade python to 3.14 by abh1sh5k · Pull Request #1280 · confluentinc/common-docker

Abhishek Krishna (abh1sh5k) · 2026-02-26T06:32:26Z

Summary
This PR migrates the base image from Python 3.9 to Python 3.14 and changes confluent-docker-utils to use the replace-docker-compose-with-sdk branch instead of a tagged release.

Changes

Python 3.9 → 3.14 Migration
Property names updated:
ubi8-minimal.python39.version → ubi8-minimal.python314.version
ubi8-minimal.python39-pip.version → ubi8-minimal.python314-pip.version
Dockerfile updated (base/Dockerfile.ubi8):
Package names: python39 → python3.14
Package names: python39-pip → python3.14-pip
POM references updated in base/pom.xml (both spotify and fabric8 plugins)
confluent-docker-utils Branch Reference
Changed git-repo.confluent-docker-utils.tag from v0.0.162 to replace-docker-compose-with-sdk
Updated base/requirements.txt to reference the branch instead of the tag
Files Modified
pom.xml - Updated property definitions
base/pom.xml - Updated build arguments
base/Dockerfile.ubi8 - Updated Python package names
base/requirements.txt - Updated confluent-docker-utils reference

Testing details

Container is up and running. Python version shown is updated python 3.14

#### Ksql image testing details- - Image build passed for previous PR with base 7.9.x: https://semaphore.ci.confluent.io/jobs/6a0360b1-baaa-423e-97b0-052ce18a2dcb - Current Image build passed with ksql-image: https://semaphore.ci.confluent.io/workflows/83a39e73-82ce-4198-8bb8-9943adae6be6?pipeline_id=3996409b-1ecd-49f8-a56c-3da28d322656

More thorough testing will be done with dockerrake once the PR is merged and dockerrake test will be triggered on the latest nightly: https://semaphore.ci.confluent.io/projects/dockerrake/schedulers

Krish Vora (KrishVora01) · 2026-02-27T05:04:59Z

        <ubi8-minimal.wget.version>1.19.5-12.el8_10</ubi8-minimal.wget.version>
        <ubi8-minimal.nmap-ncat.version>7.92-2.el8_10</ubi8-minimal.nmap-ncat.version>
-        <ubi8-minimal.python39.version>3.9.25-2.module+el8.10.0+23718+1842ae33</ubi8-minimal.python39.version>
+        <python314.version>3.14.3</python314.version>


Can we rename it to python.python314.version . Whenever we add docker dependencies updation task, it requires properties in a similar format.

Krish Vora (KrishVora01) · 2026-02-27T05:05:16Z

Do we still need these python installations?

Thanks for pointing it out. Its removed

Krish Vora (KrishVora01) · 2026-02-27T05:21:31Z

-    && python3 -m pip install --upgrade "setuptools${PYTHON_SETUPTOOLS_VERSION}" \
    && python3 -m pip install --prefer-binary --prefix=/usr/local --upgrade "${PYTHON_CONFLUENT_DOCKER_UTILS_INSTALL_SPEC}" \
-    && yum remove -y git \
+    && yum remove -y git gcc gcc-c++ make perl-IPC-Cmd openssl-devel bzip2-devel findutils libffi-devel zlib-devel sqlite-devel \


Abhishek Krishna (@abh1sh5k) is there any way for us to be sure that these are only needed to compile python and not at runtime? Will things break if we remove these packages?

These packages are added for building python in the PR itself. It wont break if these are removed

- Fix build failure: Correct property reference from ${python314.version} to ${python.python314.version} This addresses the reviewer's comment about following the python.*.version naming convention - Reorganize Dockerfile into 4 clean layers with Python installed BEFORE Java: 1. Setup package manager and repositories 2. Install Python 3.14 from source (now before Java/system packages) 3. Install system packages and Java 4. Install Python packages and user setup - Fix pip installation concerns: - Remove unused PYTHON_PIP_VERSION ARG (pip now installed via --with-ensurepip) - Add pip verification steps to ensure pip3 and python3 -m pip work correctly - Add explanatory comment about pip installation method - Remove debug scripts (check-pip-versions.sh, check-python-versions.sh) This addresses all reviewer comments and ensures compatibility with downstream Confluent Platform components (kafka, schema-registry, connect, etc.) Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>

Krish Vora (KrishVora01) · 2026-03-02T13:33:59Z

Can we remove this ARG: PYTHON_PIP_VERSION ?

Krish Vora (KrishVora01) · 2026-03-02T13:34:55Z

+      - sem-version python 3.14
      - . vault-setup
      - . cache-maven restore
      - pip install tox==3.28.0


Can we also upgrade this to tox 4.x which is the latest version? Wdyt?

Tested with upgrading tox version to 4.0.0. The build is failing with tox 4.0.0. The error shows it's a compatibility issue with tox 4.x and the existing setup.py configuration:

AttributeError: 'NoneType' object has no attribute 'metadata'
Tox 4.x has breaking changes and requires updates to the build configuration (pyproject.toml or modern setup.py). We can pick this up as a new task to avoid expanding the scope

Krish Vora (KrishVora01) · 2026-03-02T13:47:04Z

+        zlib-devel \
+        sqlite-devel \
+        findutils \
+    && curl -O https://www.python.org/ftp/python/${PYTHON314_VERSION}/Python-${PYTHON314_VERSION}.tgz \


nit: Our jmxterm dockerfile uses curl with -s -L so I asked AI, and it mentioned that we should use -fSLO so that we error out immediately if the url we are trying to get doesnt return the tar.gz .

Also, does it make sense to add a small sha verficiation step since we are installing something from an external repo?

Oops, had to select Comments instead of approve, sorry!

Prince Raheja (rahejaprince) · 2026-03-02T06:11:14Z

+        gcc \
+        gcc-c++ \
+        make \
+        perl-IPC-Cmd \
+        openssl-devel \
+        openssl-libs \
+        ca-certificates \
+        bzip2-devel \
+        libffi-devel \
+        zlib-devel \
+        sqlite-devel \
+        findutils \


Let's install and remove packages required for installing python from source in a single docker image layer. This way they will not conflict with other dependencies getting installed.

Prince Raheja (rahejaprince) · 2026-03-03T08:06:13Z

        <ubi8-minimal.wget.version>1.19.5-12.el8_10</ubi8-minimal.wget.version>
        <ubi8-minimal.nmap-ncat.version>7.92-2.el8_10</ubi8-minimal.nmap-ncat.version>
-        <ubi8-minimal.python39.version>3.9.25-2.module+el8.10.0+23718+1842ae33</ubi8-minimal.python39.version>
+        <python.python314.version>3.14.3</python.python314.version>


please move it after ubi8 minimal properties, similar properties should be clubbed together

Krish Vora (KrishVora01) · 2026-03-03T10:01:29Z

+    && make altinstall \
+    && cd .. \
+    && rm -rf Python-${PYTHON314_VERSION}* \
+    && ln -sf /usr/local/bin/python3.14 /usr/bin/python3 \


Abhishek Krishna (@abh1sh5k) can we remove these ln -sf commands as we are using alternatives.

Python 3.14 works functionally (via symlinks) AND is properly registered with RHEL (via alternatives).

Without symlinks, /usr/bin/python3 wouldn't exist and alternatives commands would fail. Both are needed.

upgradubg the python version

55b5f4c

Abhishek Krishna (abh1sh5k) requested a review from a team as a code owner February 26, 2026 06:32

Abhishek Krishna (abh1sh5k) added 6 commits February 26, 2026 14:38

upgradubg the python version

a66c055

Fixing the dependency

a2cbbad

Fixing the dependency

f8540ab

Fixing the dependency

656b068

Fixing the slash

d544bc0

Fixing the confluent-docker-utils

e82c602

Krish Vora (KrishVora01) reviewed Feb 27, 2026

View reviewed changes

Comment thread base/Dockerfile.ubi8 Outdated

Abhishek Krishna (abh1sh5k) and others added 3 commits March 2, 2026 10:42

Removing python39 occurences

88a3a2c

Removing python39 occurences

458f57a

airlock-confluentinc Bot force-pushed the python-upgrade branch from bc73e52 to 7327b0b Compare March 2, 2026 07:23

Abhishek Krishna (abh1sh5k) added 9 commits March 2, 2026 13:03

Fixing tar version issue

25b4529

Fixing build issue

96ad6a8

Fixing build issue

b8fb18a

Fixing build issue python alternative

52cafa3

Fixing build issue python alternative

8fcdd05

Fixing build issue python alternative

7827796

Fixing the dnf issue

c289306

Fixing the dnf issue

e314fe3

Fixing the dnf issue

538b028

Krish Vora (KrishVora01) previously approved these changes Mar 2, 2026

View reviewed changes

Abhishek Krishna (abh1sh5k) added 3 commits March 3, 2026 11:07

Adding SHA validation and comment fix

81dc72e

updating tox version

686e64b

reverting tox version

62fcb59

Prince Raheja (rahejaprince) reviewed Mar 3, 2026

View reviewed changes

Abhishek Krishna (abh1sh5k) added 2 commits March 3, 2026 13:52

Adding alternative

fce458d

adding python version in service yml

0177a3f

Krish Vora (KrishVora01) reviewed Mar 3, 2026

View reviewed changes

Abhishek Krishna (abh1sh5k) added 15 commits March 3, 2026 16:23

testing with alternatives

3eaa190

testing with GPG key

18eb91e

Using sigstore

e46d7e7

Using sigstore

7f85ef6

fixing alternatives

8ff303b

Testing with python3.6

bac35c9

Testing with python3.6

cd47ad4

Testing with python3.11

15a2d1a

Testing with python3.11

b558c37

Testing update-alternatives

6db9454

Testing update-alternatives

a51f532

Testing update-alternatives

7c1acd6

Testing update-alternatives

9f2adbf

Removing which command

e2e8ed9

claenup stale pip

e3e79fc

Krish Vora (KrishVora01) approved these changes Mar 3, 2026

View reviewed changes

Prince Raheja (rahejaprince) approved these changes Mar 4, 2026

View reviewed changes

Abhishek Krishna (abh1sh5k) merged commit 2ffdb1e into 7.4.x Mar 5, 2026
2 checks passed

Abhishek Krishna (abh1sh5k) deleted the python-upgrade branch March 5, 2026 03:52

Conversation

Abhishek Krishna (abh1sh5k) commented Feb 26, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Testing details

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Abhishek Krishna (abh1sh5k) Mar 2, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Abhishek Krishna (abh1sh5k) commented Feb 26, 2026 •

edited

Loading

Abhishek Krishna (abh1sh5k) Mar 2, 2026 •

edited

Loading