Skip to content

[EP API] header-only adapter for EP API#26919

Merged
fs-eire merged 22 commits intomainfrom
fs-eire/ep-api-adatper-header-only
Feb 28, 2026
Merged

[EP API] header-only adapter for EP API#26919
fs-eire merged 22 commits intomainfrom
fs-eire/ep-api-adatper-header-only

Conversation

@fs-eire
Copy link
Contributor

@fs-eire fs-eire commented Jan 6, 2026

Description

This PR adds a few headers for supporting building WebGPU EP and CUDA EP as plugin EPs.

See summary of #26907

@fs-eire fs-eire force-pushed the fs-eire/ep-api-adatper-header-only branch from 74b2ed4 to b8a9132 Compare February 2, 2026 23:35
@adrianlizarraga
Copy link
Contributor

@fs-eire, thank you for adding these utilities. We currently have some plugin EP utilities in this directory: https://github.com/microsoft/onnxruntime/tree/main/include/onnxruntime/core/providers/utils

And there's another on the way here: #25753

Could we consolidate all of these utilities into one location?

@edgchen1
Copy link
Contributor

edgchen1 commented Feb 4, 2026

@fs-eire, thank you for adding these utilities. We currently have some plugin EP utilities in this directory: https://github.com/microsoft/onnxruntime/tree/main/include/onnxruntime/core/providers/utils

And there's another on the way here: #25753

Could we consolidate all of these utilities into one location?

it may be worth considering whether the utility is generally useful to any plugin EP vs. useful to plugin EPs within the ORT repo. some of these seem like the latter.

@fs-eire
Copy link
Contributor Author

fs-eire commented Feb 4, 2026

@fs-eire, thank you for adding these utilities. We currently have some plugin EP utilities in this directory: https://github.com/microsoft/onnxruntime/tree/main/include/onnxruntime/core/providers/utils
And there's another on the way here: #25753
Could we consolidate all of these utilities into one location?

it may be worth considering whether the utility is generally useful to any plugin EP vs. useful to plugin EPs within the ORT repo. some of these seem like the latter.

I agree. we should not have separated implementation in different places of the repo.

In general, I think there are 2 different types of headers:

  • the headers that ONLY depends on ORT public headers. This can include some useful common utils/macros and helper functions.
  • the headers also depending on ORT internal headers. Specifically, for the EP adapter implementation. (currently they are in include/onnxruntime/ep/adapter)

I would recommend to put them somewhere under include/onnxruntime/, because considering the usage header-only will be much more easier for users to use. And if it's header-only, it should be put inside include/onnxruntime/.

All other details are open to discussion.

@fs-eire fs-eire force-pushed the fs-eire/ep-api-adatper-header-only branch from b8a9132 to c9e4973 Compare February 7, 2026 04:58
@fs-eire fs-eire merged commit 4fd9ebb into main Feb 28, 2026
88 of 91 checks passed
@fs-eire fs-eire deleted the fs-eire/ep-api-adatper-header-only branch February 28, 2026 01:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants