Skip to content

[TensorRT EP] Switch to enqueueV3#18008

Closed
chilo-ms wants to merge 5 commits intomainfrom
chi/trt_enqueue_v3_no_dds
Closed

[TensorRT EP] Switch to enqueueV3#18008
chilo-ms wants to merge 5 commits intomainfrom
chi/trt_enqueue_v3_no_dds

Conversation

@chilo-ms
Copy link
Contributor

@chilo-ms chilo-ms commented Oct 18, 2023

There are 2 phases to switch to enqueueV3. This PR is the 1st phases.
Update Following APIs:

  1. buildEngineWithConfig -> buildSerializedNetwork + deserializeCudaEngine
  2. enqueueV2 -> enqueueV3

This PR doesn't make enqueueV3 support of data-dependent shape (DDS) output.
The support of DDS output is in another PR.

@chilo-ms chilo-ms requested a review from jywu-msft October 18, 2023 00:34
@chilo-ms chilo-ms marked this pull request as ready for review October 18, 2023 00:34
@jywu-msft
Copy link
Member

closing this. this is replaced by #17751

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants