Reflections don't work (I may know why)

[BananaLoaf]

I use server reflection as defined in the documentation and I have a single service called helloworld.Greeter.

gRPC call list_services: "*" is processed fine and returns a single service helloworld.Greeter.

However, file_containing_symbol: "helloworld.Greeter" only returns an error not found

Throughout my own investigation I found that error can be traced to
grpclib/reflection/_deprecated.py:L79
Where self._pool does not have any descriptors for helloworld.Greeter or any of its methods

I suspect that THIS is how the descriptors should be added in order for reflections to work with betterproto

[BananaLoaf]

I have managed to fix reflections by using command poetry run python -m grpc_tools.protoc -I protos --python_out=package_name/grpc_python and importing everything that is in package_name/grpc_python to populate descriptors before starting the server.

However, paths in those files are broken and this solution is barely usable.

[DeoLeung]

I'm trying to do reflection via grpclib using better proto

is it working or any example I can follow?

[narma]

Have same issue

[sinwoobang]

Same issue here, is nobody working on it?

[Gobot1234]

AFAICT no @sinwoobang

[BananaLoaf]

@sinwoobang @narma @DeoLeung @Gobot1234

In order for reflections to work, server has to know what it itself is serving, and it can do that if you import (just import) all *_pb2.py files. They contain the code that would execute upon import and make server aware of itself.

So I came up with this:

import importlib
from pathlib import Path

def recursive_descriptor_import(relative_to: str):
    package = importlib.import_module(relative_to)
    package_depth = len(relative_to.split('.'))
    package_path = Path(package.__path__[0])

    for module_path in package_path.glob('**/*_pb2.py'):
        module_path = module_path.relative_to(
            package_path.parents[package_depth-1],
        )
        module_path = '.'.join(module_path.parts).rstrip('.py')
        importlib.import_module(module_path)

And you would use it like this:

recursive_descriptor_import('my_python_package.protobuf')

Where my_python_package.protobuf is the package you did --python_out=my_python_package/protobuf to

[BananaLoaf]

Forgot to mention, right after generating the code, I use https://github.com/cpcloud/protoletariat to fix all the broken paths

[mxrch]

Any news for this issue ? It's the only problem of using betterproto instead of protoc.. :(