Closed
Conversation
…PU (#441) * Prototype shared memory allocator on Windows using OV-EP * Partially working allocator. Crashing on tensor destruction. Might have UMD exceptions. Needs further debug. Unknown if values are correct. * Hard code onnx perf to use RT NPU allocator for inputs * Fix allocation lookups coming from different level zero contexts * Page align OV allocation * Allocate input as WC * Only set tensors when they have changed. * Revert "Allocate input as WC" This reverts commit d43219f. * Hard code onnx perf to use RT NPU for outputs * Revert "Hard code onnx perf to use RT NPU for outputs" This reverts commit c1f3b3e. * Hard code onnx perf to use RT NPU for outputs fixed * Fix onnx_perf_test app crash on tensor destroy * refactor: remove redundant ort_shape_to_ovshape lambda function * alocate buffer in NPU visible region from perf test application * remove redundant code * add command line parameter in perf test for using remote tensors * remove redundant code * remove redundant statements * fix crash during inference * remove redundant code * enable backward compatibility of remote tensor feature * Revert "enable backward compatibility of remote tensor feature" This reverts commit 1791b90. * enable backward compatibility of remote tensor feature in OVEP --------- Co-authored-by: Javier E. Martinez <javier.e.martinez@intel.com> Co-authored-by: Eric Crawford <eric.r.crawford@intel.com>
* fix debug build issue and lint issues * change naming for OVEP NPU specific macro * fix unit tests and lint issues
This reverts commit 60af873.
OVEP: fix tensor regression
update: Enable Python API for load_config in provider options
update: handling few edge cases for parsing
* adding fp8 support on NPU * changed OV Version to 2024_3
* Remove invalid provider option 'enable_npu_fast_compile' in OVEP * Fix lint issues
fix: Securing load_config path parsing
…untime into ovep-develop-lnl-1.2
* Updated API Documentation with new attributes * Revert "Merge branch 'microsoft:main' into tejal_api_doc_changes" This reverts commit 35df7d8, reversing changes made to faae40b. * Revert "Revert "Merge branch 'microsoft:main' into tejal_api_doc_changes"" This reverts commit fdde6cc. * Revert "Revert "Revert "Merge branch 'microsoft:main' into tejal_api_doc_changes""" This reverts commit 162b697. * Revert "Revert "Revert "Revert "Merge branch 'microsoft:main' into tejal_api_doc_changes"""" This reverts commit ec986f1. * Modified provider options with necessary changes and updated comments * changed comments --------- Co-authored-by: TejalKhade28 <tejal.khade@intel.com> Co-authored-by: Vishnudas Thaniel S <vishnudas.thaniel.s@intel.com> Co-authored-by: jatinwadhwa921 <jatin.wadhwa@intel.com>
This reverts commit 14bdb3a.
Author
|
Raised PR #490 resolving conflicts with ovep-develop-lnl-1.4 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
9 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
API doc changes for detailed content