Skip to content

[Mobile package] Update required operator config with additional ops for wav2vec2.#8079

Merged
edgchen1 merged 2 commits intomasterfrom
edgchen1/update_mobile_package_ops
Jun 17, 2021
Merged

[Mobile package] Update required operator config with additional ops for wav2vec2.#8079
edgchen1 merged 2 commits intomasterfrom
edgchen1/update_mobile_package_ops

Conversation

@edgchen1
Copy link
Contributor

Description
Add some additional ops to the mobile package that are needed for the wav2vec2 model.

Motivation and Context
Add support for more models.

@edgchen1 edgchen1 requested a review from a team as a code owner June 17, 2021 02:02

# internal ops added by optimizers
com.microsoft;1;DynamicQuantizeMatMul,FusedConv,FusedGemm,FusedMatMul,MatMulIntegerToFloat,NhwcMaxPool,QLinearAdd,QLinearAveragePool,QLinearConv,QLinearGlobalAveragePool,QLinearMul,QLinearSigmoid
ai.onnx;1;LayerNormalization
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Would be good to comment that this is incorrectly registered in the ONNX domain even though it's an internal op.

May be possible to add a registration in the correct domain and mark the old one as deprecated. IIRC that's what we do when internal ops migrate to official onnx ops.

skottmckay
skottmckay previously approved these changes Jun 17, 2021
@edgchen1 edgchen1 merged commit aa68157 into master Jun 17, 2021
@edgchen1 edgchen1 deleted the edgchen1/update_mobile_package_ops branch June 17, 2021 20:08
edgchen1 added a commit that referenced this pull request Jun 22, 2021
edgchen1 added a commit that referenced this pull request Jun 23, 2021
…for newer version of Wav2Vec 2. (#8123)

This is an update to #8079
The sample application motivating the original update changed to use an updated version of the model. Now, fewer ops are required. This change removes the previously added ops which are no longer needed.
harshithapv pushed a commit that referenced this pull request Jun 23, 2021
…for wav2vec2. (#8079)

Add some additional ops to the mobile package that are needed for the wav2vec2 model.
harshithapv pushed a commit that referenced this pull request Jun 23, 2021
…for newer version of Wav2Vec 2. (#8123)

This is an update to #8079
The sample application motivating the original update changed to use an updated version of the model. Now, fewer ops are required. This change removes the previously added ops which are no longer needed.
harshithapv added a commit that referenced this pull request Jun 26, 2021
* fix boost download url (#7843)

* Topo sort the model before saving (#7913)

* checkin toposort

* review comments

* revert and add TODO

* Add shape inference to custom symbolic functions (#7937)

**Description**: As title.

**Motivation and Context**
- PyTorch ONNX exporter heavily depends on ONNX shape inference to export accurate and efficient model. Custom symbolic function exports the op as contrib ops, thus exporter is unable to perform standard onnx shape inference. Models with dynamic shape inputs are affected.

* Fix missing files on linux (#8066)

* [Mobile package] Update required operator config with additional ops for wav2vec2. (#8079)

Add some additional ops to the mobile package that are needed for the wav2vec2 model.

* Add module attribute to ORTModule to support HuggingFace Trainer save_model (#8088)

* Fix input schema extrator for ORTModule (#8098)

* Fix 32bit Android java API crash (#8122)

* Fix 32bit Android java API crash

* fix code formating

* [Mobile package] Update required operator config with additional ops for newer version of Wav2Vec 2. (#8123)

This is an update to #8079
The sample application motivating the original update changed to use an updated version of the model. Now, fewer ops are required. This change removes the previously added ops which are no longer needed.

* Add int64 as a required type to ConstantOfShape as it's used by the pytorch converter for Pad. (#8128)

It's also used pointlessly for torch.tensor.repeat (although that usage should always be able to be constant folded).

* Update logic in props.xml to account for shared provider library changes (#8138)

* Ortmodule override torch.manual_seed() (#8131)

* Ortmodule override torch.manual_seed()

* Fix Python Cuda loading issues (#7939)

* Fix mac shared_provider warning (#8153)

Co-authored-by: Guoyu Wang <62914304+gwang-msft@users.noreply.github.com>
Co-authored-by: Ye Wang <52801275+wangyems@users.noreply.github.com>
Co-authored-by: Bowen Bao <bowbao@microsoft.com>
Co-authored-by: Ryan Hill <38674843+RyanUnderhill@users.noreply.github.com>
Co-authored-by: Edward Chen <18449977+edgchen1@users.noreply.github.com>
Co-authored-by: baijumeswani <bmeswani@microsoft.com>
Co-authored-by: Thiago Crepaldi <thiago.crepaldi@microsoft.com>
Co-authored-by: Scott McKay <skottmckay@gmail.com>
Co-authored-by: Hariharan Seshadri <shariharan91@gmail.com>
Co-authored-by: Sherlock <baihan.huang@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants