[python-client 2.6.0] ContextualVersionConflict grpcio dependency conflict

[lbenc135]

Describe the bug
When installing pulsar-client==2.6.0 there's a dependency conflict with grpcio library.

The dependency tree is (as I understand it):

• pulsar-client (2.6.0)
  • grpcio (any)
  • apache-bookkeeper-client (4.11.0)
    • grpcio >=1.8.2,<1.26.0

To Reproduce
Steps to reproduce the behavior:

1. pip install pulsar-client==2.6.0
2. grpcio==1.30.0 gets installed
3. If I try to build my own pip package with pulsar-client as dependency, and try to build it, I get the ContextualVersionConflict error

Expected behavior
I expect the correct version to be installed and/or the dependency tree to be fixed.

Screenshots

Desktop (please complete the following information):

• OS: Ubuntu 20.04

[sijie]

@lbenc135 Can you share your python code example so we can reproduce it?

[lbenc135]

@sijie It's a bit complicated because it involves having a python package which requires another python package.

Basically it seems the problem is that in version 4.11.0 of apache-bookkeeper-client there was an explicit requirement added: grpcio<1.26.0, while in 4.10.0 this was only >=1.8.2. Since pulsar-client itself requires grpcio, but does not specify a version, pip installs the newest (maybe the solution is removing this dependency?).

Setuptools verifies all the dependencies of my python package and throws this error.

I temporarily solved it by explicitly adding grpcio==1.25.0 in my requirements.txt.

[sijie]

Gotcha. Can you also raise an issue at https://github.com/apache/bookkeeper? So we can relax the requirement in bookkeeper side.

[lbenc135]

Sure: apache/bookkeeper#2377

[jbellis]

I ran into this today.

It looks like BookKeeper revved its requirement to include up to 1.28, but in the meantime grpcio released even more versions which are not compatible (1.35 is the latest now).

I think Pulsar client needs to specify a grpcio version that matches a version compatible with the appropriate BK release.

Until then the Python client is effectively uninstallable for the majority of people trying to follow the docs.