GH-43589: [Python] Add bindings for Buffer copy() method to other device

[anjakefala]

WIP. Feel free to make any comments while this is under active development!

• Within Copy, in addition to accepting a MemoryManager as argument to the copy function, we could also accept a Device (see review comments here: GH-42222: [Python] Add bindings for CopyTo on RecordBatch and Array classes #42223)
• add a test in test_io.py where Buffer is being tested, so there is also coverage of this new function outside of the CUDA tests
• What is the difference between Copy and CopyNonOwned? Do we need both or should they be in the same method? (We decided to not add bindings for it.)

Rationale for this change

What changes are included in this PR?

Are these changes tested?

Are there any user-facing changes?

• GitHub Issue: [Python] Add bindings for additional Buffer class non-CPU methods #43589

[github-actions]

⚠️ GitHub issue #43589 has been automatically assigned in GitHub to PR creator.

[jorisvandenbossche]

Some small comments on the tests. I think it would also be fine for this PR to just focus on adding a copy method, and then this should be more or less ready?

[anjakefala]

@github-actions crossbow submit test-cuda-python

[github-actions]

Revision: a64d54d

Submitted crossbow builds: ursacomputing/crossbow @ actions-b9914c094c

Task	Status
test-cuda-python

[danepitkin]

Nice work!

[danepitkin]

Overall LGTM! Do you plan to add the other checkbox items to this PR? If not, then I give it approval 👍

[anjakefala]

@danepitkin We decided to move those to a separate PR!

[anjakefala]

@github-actions crossbow submit test-cuda-python

[anjakefala]

@github-actions crossbow submit test-cuda-python

[github-actions]

Unable to match any tasks for `test-cuda-python`
The Archery job run can be found at: https://github.com/apache/arrow/actions/runs/10947293941

[danepitkin]

@github-actions crossbow submit test-cuda-python

[github-actions]

Unable to match any tasks for `test-cuda-python`
The Archery job run can be found at: https://github.com/apache/arrow/actions/runs/10948481926

[pitrou]

@github-actions crossbow submit testcudapy*

[github-actions]

Revision: 9319543

Submitted crossbow builds: ursacomputing/crossbow @ actions-9f9dcb6f39

Task	Status
test-cuda-python-ubuntu-22.04-cuda-11.7.1

[jorisvandenbossche]

@anjakefala added a few more comments on the tests, but for the rest looks good!

[jorisvandenbossche]

@github-actions crossbow submit testcudapy*

[github-actions]

Revision: 230abf2

Submitted crossbow builds: ursacomputing/crossbow @ actions-b9e1188e21

Task	Status
test-cuda-python-ubuntu-22.04-cuda-11.7.1

[anjakefala]

Is anything else needed before merging? The failed CI seems unrelated.

[pitrou]

Not required, but it may be nice to also allow a MemoryPool here.

[jorisvandenbossche]

We don't have a way to map a given MemoryPool to a device manager (AFAIK), so in that case you mean to use a different API under the hood to copy to the memory pool? (Buffer::CopySlice seems to allow that, or first explicitly allocate a new Buffer of the correct size using the memory pool and then copying the data to it?)

[pitrou]

You can use

arrow/cpp/src/arrow/device.h

Lines 295 to 298 in c557fe5

	/// \brief Create a MemoryManager
	///
	/// The returned MemoryManager will use the given MemoryPool for allocations.
	static std::shared_ptr<MemoryManager> memory_manager(MemoryPool* pool);

[github-actions]

Thank you for your contribution. Unfortunately, this pull request has been marked as stale because it has had no activity in the past 365 days. Please remove the stale label or comment below, or this PR will be closed in 14 days. Feel free to re-open this if it has been closed in error. If you do not have repository permissions to reopen the PR, please tag a maintainer.