Will Intel Arc be supported?

[nathanodle]

Just wondering if there's any plan to support Intel. The Arc 770 is 16GB for $349 which makes it pretty desirable for a lot of models out there. FLAN-T5-XXL should load in 8-bit I think if supported? Thanks!

[jackie1218]

I'd really like to see this at some point, since there's already ROCm support

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

[ElliottDyson]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Definitely hopeful for this being possible! Especially with the work intel have put into IPEX-LLM!

Any updates on this?

[Titus-von-Koeller]

Will Intel Arc be supported?

@jiqing-feng @jgong5 @jianan-gu @Xia-Weiwen @abhilash1910

Could one of you please comment if this would be covered by your ongoing/ planned work? Thanks 🤗

[Xia-Weiwen]

I think it will be supported. @jgong5 may comment more. Thanks.

[ElliottDyson]

I think it will be supported. @jgong5 may comment more. Thanks.

Would love this. Intel are already using your repo in their codebases for quantisation of models for their GPUs, it would be really neat if such quantisation could be done on-device. It is so slow on CPU!

[abhilash1910]

Will Intel Arc be supported?

@jiqing-feng @jgong5 @jianan-gu @Xia-Weiwen @abhilash1910

Could one of you please comment if this would be covered by your ongoing/ planned work? Thanks 🤗

Hi @Titus-von-Koeller , yes I think it will be supported by default . In any case the sycl-refactor should run on any device supporting sycl runtime.