Skip to content

FP8 support on NPU#462

Merged
preetha-intel merged 2 commits intoovep-develop-lnl-1.2from
niharika/fp8
Oct 1, 2024
Merged

FP8 support on NPU#462
preetha-intel merged 2 commits intoovep-develop-lnl-1.2from
niharika/fp8

Conversation

@n1harika
Copy link

@n1harika n1harika commented Oct 1, 2024

Tested on PTL and LNL.
Added data types: FLOAT8E4M3FN and FLOAT8E4M3FNUZ.

supported_types_npu_.insert(
std::make_pair(V_2021_1, ONNX_NAMESPACE::TensorProto_DataType::TensorProto_DataType_FLOAT16));
supported_types_npu_.insert(
std::make_pair(V_2023_0, ONNX_NAMESPACE::TensorProto_DataType::TensorProto_DataType_FLOAT8E4M3FN));

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Change the version from V_2023_0 to V_2024_3 as its enabled only in latest OV.

@n1harika
Copy link
Author

n1harika commented Oct 1, 2024

I have changed the version

@preetha-intel
Copy link

LGTM

@preetha-intel preetha-intel merged commit 4db9fb0 into ovep-develop-lnl-1.2 Oct 1, 2024
@preetha-intel preetha-intel deleted the niharika/fp8 branch October 1, 2024 12:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants