[Bug]: Update Stager and Beam containers to allow for the new format of Apache Beam wheels.

[tvalentyn]

What happened?

We need to update stager.py and the entrypoints for Beam's container and Dataflow internal container to work with the new wheel format.

pointers:

https://github.com/apache/beam/blob/master/sdks/python/apache_beam/runners/portability/stager.py#L721

beam/sdks/python/container/boot.go

Line 336 in 4b96193

wheelName = fmt.Sprintf("cp%s-cp%sm-manylinux1_x86_64.whl", pyVersion, pyVersion)

Issue Priority

Priority: 1

Issue Component

Component: sdk-py-core

[tvalentyn]

see: https://pypi.org/project/apache-beam/2.42.0/#files versus https://pypi.org/project/apache-beam/2.43.0rc1/#files

[tvalentyn]

@AnandInguva would you have time to look into this?

[chamikaramj]

P0 since this is blocking the ongoing release.

[AnandInguva]

.take-issue