Skip to content

Explore GPU/NPU support #556

@mkopcins

Description

@mkopcins

This task focuses on adding support for GPU / NPU in our exported models.

As a result of this task there will be models exported utilizing GPU/NPU supports and issues that blocked us from exporting:

Whisper:

YOLO all variants:

  • XNNPACK
  • CoreML
  • Vulkan

Selfie segmentation

  • XNNPACK
  • CoreML - This is probably not needed
  • Vulkan - This is probably not needed

RF-DETR

  • XNNPACK
  • CoreML Norbert exported, need to add it
  • Vulkan

LFM2.5 Instruct:

  • XNNPACK
  • CoreML
  • Vulkan

Style transfer models:

  • XNNPACK
  • CoreML
  • Vulkan

sddlite-320:

  • XNNPACK
  • CoreML
  • Vulkan

Image embedding (CLIP):

  • XNNPACK
  • CoreML
  • Vulkan

efficientnet-v2-s:

  • XNNPACK
  • CoreML
  • Vulkan

Interesting refs:

Metadata

Metadata

Assignees

Labels

performanceRelated to all issues and tasks focused on improving performance

Type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions