[Format] Enhance C-Data API to support non-cpu use cases

[zeroshade]

Describe the enhancement requested

Currently the C-Data API assumes that all the buffers are CPU buffers and there is no way to pass device information through the ABI to allow using it for non-cpu memory allocations. We need to enhance the API to allow passing device and memory information without breaking the C-Data ABI, while also ensuring it is future-proofed for future developments with non-cpu devices.

Component(s)

Format

[ianmcook]

Also see this related discussion on the Arrow developer mailing list: https://lists.apache.org/thread/sntc3pp6msdvb94zhq2lvy70s1p6d1qg