rules_python failing with Bazel@HEAD in Bazel Downstream pipeline

[meteorcloudy]

https://buildkite.com/bazel/bazel-at-head-plus-downstream/builds/2675#0183d0a7-84bd-4541-b543-01d162c313ed

======================================================================
FAIL: test_match_toolchain (__main__.TestPythonVersion)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/var/lib/buildkite-agent/.cache/bazel/_bazel_buildkite-agent/eb882ad14e6111536f596011b6d53a9e/sandbox/linux-sandbox/48/execroot/rules_python/bazel-out/k8-fastbuild/bin/python/tests/toolchains/run_test_3.8.13.sh.runfiles/rules_python/python/tests/toolchains/3.8.13/run_acceptance_test.py", line 52, in test_match_toolchain
    self.assertEqual(output, "Python 3.8.13")
AssertionError: '' != 'Python 3.8.13'
+ Python 3.8.13

==================== Test output for //:test_vendored:
4c4
< from //:requirements.txt
---
> from @//:requirements.txt
FAIL: files "requirements.bzl" and "requirements.clean.bzl" differ. Please run:  bazel run //:vendor_requirements

Possible culprits are: #855 and #851

[meteorcloudy]

/cc @alexeagle @f0rmiga

[meteorcloudy]

gently ping~

[f0rmiga]

Sorry, my son was born the next day you posted this, and I didn't have enough time to dig into it yet. From a first pass, the failure is coming from the fact that I expanded the CI jobs and we were restricting the Bazel versions we tested against in the integration tests.

I think we should fix this forward, as CI is more correct now.

[f0rmiga]

If this is blocking anything, we can at least disable them while the proper fix is not done.

[jvolkman]

congrats @f0rmiga!

[f0rmiga]

congrats @f0rmiga!

Thanks @jvolkman!

[meteorcloudy]

Oh, congratualtions! @f0rmiga

Maybe someone else can look into this in the meantime? /cc @rickeylev It's not block anything, but it's causing the Bazel downstream pipeline to be red and could shadow any other breakage we could detect for rules_python at Bazel@HEAD.

[fweikert]

Congratulations and a friendly ping :)

[f0rmiga]

Congratulations and a friendly ping :)

A friendly pong.

[rickeylev]

I think this is fixed, though I don't know what did so. Running the following succeeds:

USE_BAZEL_VERSION=last_green bazelisk test //python/tests/toolchains/...

I'll send a PR to re-enable our tests in the Bazel config