Conversation
…roved performance
…ecks for proxy plugins for NUM_STREAMS
… CompileModel stages
Since there's a common GlobalContext, when we create two Sessions in the same user code, the provider options of the first model gets overwritten with the second model's. To overcome this, this PR creates an instance of GlobalContext for each instance of OpenVINOExecutionProvider and uses it throughout wherever access to the GlobalContext's parameters are required.
…y the onnx frontend
saurabhkale17
force-pushed
the
ort-openvino-npu-1.17-master
branch
from
f7a643b to
ea4001b
Compare
| #elif OPENVINO_CONFIG_NPU_U8 | ||
| #define BACKEND_OPENVINO "-OPENVINO_NPU_U8" | ||
| #elif OPENVINO_CONFIG_NPU | ||
| #define BACKEND_OPENVINO "-OPENVINO_NPU" |
There was a problem hiding this comment.
Are the latest changes preetha made on 1.17 for pybind in this branch ?
tools/ci_build/github/linux/docker/Dockerfile_manylinux2014_openvino_multipython
Outdated
Show resolved
Hide resolved
sspintel
force-pushed
the
ort-openvino-npu-1.17-master
branch
from
b93eb63 to
56ce6fb
Compare
This reverts commit 56ce6fb.
* Fix fallback failure due to handling wrong exception * Apply lintrunner patches
| GetGlobalContext(), | ||
| subgraph_context_); | ||
| } catch (std::string const& msg) { | ||
| } catch (const OnnxRuntimeException& ex) { |
There was a problem hiding this comment.
In ov interface.cc and basic_backend.cc we are throwing ORT_THROW(msg) on getting exception
should we not throw exception
aDDED oPENvino 2024.0 TO THE dOCKERFILES
Sahar/fix npu pr 19666
|
I am seeing this error Even when we specify It seems to me that there the environment is not cleaned properly and it is picking up an old directory. Can you please check. |
…el/onnxruntime into ort-openvino-npu-1.17-master
| wget https://storage.openvinotoolkit.org/repositories/openvino/packages/2024.0/linux/l_openvino_toolkit_ubuntu20_2024.0.0.14509.34caeefd078_x86_64.tgz && \ | ||
| tar xzf l_openvino_toolkit_ubuntu20_2024.0.0.14509.34caeefd078_x86_64.tgz && rm -rf l_openvino_toolkit_ubuntu20_2024.0.0.14509.34caeefd078_x86_64.tgz && \ | ||
| mv l_openvino_toolkit_ubuntu20_2024.0.0.14509.34caeefd078_x86_64 openvino_2024.0.0 && \ | ||
| cd $INTEL_OPENVINO_DIR/install_dependencies && ./install_openvino_dependencies.sh -y |
There was a problem hiding this comment.
maybe we can use Debian packages instead of archives? It's more natural way for docker files, which are based on Ubuntu. NPU is part of Debian packages as well.
Note, current dockerfile is based on Ubuntu 20.04, which is not supported by NPU.
There was a problem hiding this comment.
Microsoft PR is already Raised microsoft#19966 Thanks for your comments . We will track this is in the next PR. It should not be problem because docker is only for CPU. But yes we will change the dockerfile. Currently it does not seem possible because with Ubuntu base image we may need to do SDLE Process.
Ignore Gelu tests in ONNX Backend test
7 participants
Description
Motivation and Context