Skip to content

fix dtype mismatch#1285

Merged
Titus-von-Koeller merged 1 commit intobitsandbytes-foundation:multi-backend-refactorfrom
jiqing-feng:matmul_dtype
Jul 27, 2024
Merged

fix dtype mismatch#1285
Titus-von-Koeller merged 1 commit intobitsandbytes-foundation:multi-backend-refactorfrom
jiqing-feng:matmul_dtype

Conversation

@jiqing-feng
Copy link
Contributor

@jiqing-feng jiqing-feng commented Jul 22, 2024

The A.dtype is compute_dtype, we should also convert the dequantized weight to compute_dtype

@Titus-von-Koeller Titus-von-Koeller merged commit c8b4b33 into bitsandbytes-foundation:multi-backend-refactor Jul 27, 2024
@jiqing-feng jiqing-feng deleted the matmul_dtype branch December 3, 2024 08:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants