Skip to content

OVEP: fix tensor regression#455

Merged
sfatimar merged 4 commits intoovep-develop-lnl-1.2from
saurabh/fix_regression
Sep 25, 2024
Merged

OVEP: fix tensor regression#455
sfatimar merged 4 commits intoovep-develop-lnl-1.2from
saurabh/fix_regression

Conversation

@saurabhkale17
Copy link

Description

  1. changing the emplace to [] that does have a difference, emplace will only create a new entry if it doesn't already exist in the map
  2. change the logic of the caching lookup to key off of input/output names instead of ort raw ptrs.
  3. changes OV tensor creation for CPU allocated input/output ORT tensors. The CPU allocated input/output tensor path was re-allocating OV tensors based on the ORT input/output tensors. So we'd get 2 copies: ORT input/output tensor -> OV tensor (OVEP) -> NPU Tensor (NPU plugin).

@saurabhkale17 saurabhkale17 changed the title Saurabh/fix regression OVEP: fix tensor regression Sep 25, 2024
@sfatimar
Copy link

LGTM

@sfatimar sfatimar merged commit b8bbc1c into ovep-develop-lnl-1.2 Sep 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants