Skip to content

Allow using MKLML header/libs when use_mklml is specified#178

Merged
ke1337 merged 2 commits intomasterfrom
gt/kedeng/mkl
Dec 17, 2018
Merged

Allow using MKLML header/libs when use_mklml is specified#178
ke1337 merged 2 commits intomasterfrom
gt/kedeng/mkl

Conversation

@ke1337
Copy link
Contributor

@ke1337 ke1337 commented Dec 14, 2018

As mkldnn_sgemm is slower than cblas_sgemm in MKLML. This also allows providers to use MKL integer BLAS directly.

@ke1337 ke1337 requested a review from a team as a code owner December 14, 2018 06:47
jywu-msft
jywu-msft previously approved these changes Dec 14, 2018
souptc pushed a commit that referenced this pull request Dec 17, 2018
Add support for getting model metadata. Will add test cases once the initial review looks good.

Note that this is slightly different from the LotusRT versions of GetInputs/GetOutputs in that the NodeArg is not directly exposed to the clients of the session class.

Also, notice the return by pair<>. Did this to achieve 2 things: (1) ensure that an appropriate error code is returned if the client didn't load the model to begin with (2) avoid copying of the metadata. The LotusRT version didn't check if the model was loaded or not when these functions were called.

Related work items: #178
@ke1337 ke1337 force-pushed the gt/kedeng/mkl branch 3 times, most recently from ad492a8 to 82a74d1 Compare December 17, 2018 20:00
@ke1337 ke1337 changed the title Use MKLML GEMM when USE_MKLDNN and USE_MKLML is set Use MKLML for GEMM when USE_MKLML is set Dec 17, 2018
@ke1337 ke1337 changed the title Use MKLML for GEMM when USE_MKLML is set Allow using MKLML header/libs when use_mklml is specified Dec 17, 2018
@liwchang liwchang self-requested a review December 17, 2018 22:40
@ke1337 ke1337 merged commit b0f27ba into master Dec 17, 2018
@ke1337 ke1337 deleted the gt/kedeng/mkl branch December 18, 2018 00:46
quic-ankus pushed a commit to CodeLinaro/onnxruntime that referenced this pull request Nov 25, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants