Skip to content

Conversation

@jiqing-feng
Copy link
Contributor

@jiqing-feng jiqing-feng commented Dec 16, 2024

We should enable the correct backend of ipex op based on the input data device.
Set default semver_tags to 1.0.0 because there are some version checks in transformers.

related discussion: 1338

@notsyncing
Copy link

This PR fixed my error NotImplementedError: Could not run 'torch_ipex::woq_linear.xpu' with arguments from the 'CPU' backend. when running a model on cpu with xpu-enabled ipex. Thanks!

Signed-off-by: jiqing-feng <jiqing.feng@intel.com>
@jiqing-feng
Copy link
Contributor Author

Hi @Titus-von-Koeller @matthewdouglas . Please review this PR, thanks.

@matthewdouglas matthewdouglas merged commit 7e6f865 into bitsandbytes-foundation:multi-backend-refactor Dec 17, 2024
rsshaik1 pushed a commit to bhargaveede/bitsandbytes that referenced this pull request Jan 10, 2025
Signed-off-by: jiqing-feng <jiqing.feng@intel.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants