sycl-exp : unify rope neox/norm#7919
Conversation
As per: #7634 Signed-off-by: Joe Todd <joe.todd@codeplay.com>
Rope is only supported for contiguous input data. Concat currently only supports dim=2 Signed-off-by: Joe Todd <joe.todd@codeplay.com>
Signed-off-by: Joe Todd <joe.todd@codeplay.com>
|
@ggerganov the target branch for this PR is We decided to open the branch here, rather than in a fork, so that there's more visibility on our work from other llama.cpp developers. However, I can see that this might cause some confusion relating to duplicate PRs etc. Would you prefer that we take our |
|
@joeatodd No problem at all - feel free to create the branches here for more visibility |
AidanBeltonS
left a comment
There was a problem hiding this comment.
One comment, otherwise changes seem fine
Signed-off-by: Joe Todd <joe.todd@codeplay.com>
This PR updates the SYCL backend as per #7634. It also updates
ggml_backend_sycl_supports_opto reflect the fact that: