Skip to content

doc: add example of adaptive batching for collection parameter types#3873

Merged
aarnphm merged 7 commits into
bentoml:mainfrom
frostming:doc/batching
May 25, 2023
Merged

doc: add example of adaptive batching for collection parameter types#3873
aarnphm merged 7 commits into
bentoml:mainfrom
frostming:doc/batching

Conversation

@frostming
Copy link
Copy Markdown
Contributor

@frostming frostming commented May 19, 2023

Signed-off-by: Frost Ming me@frostming.com

What does this PR address?

Fixes #3805

Before submitting:

Signed-off-by: Frost Ming <me@frostming.com>
@frostming frostming requested a review from a team as a code owner May 19, 2023 07:20
@frostming frostming requested review from sauyon and removed request for a team May 19, 2023 07:20
@frostming frostming requested review from larme and ssheng May 19, 2023 07:23
Signed-off-by: Frost Ming <me@frostming.com>
Comment thread docs/source/guides/batching.rst Outdated
Co-authored-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
Comment thread docs/source/guides/batching.rst Outdated
Comment thread docs/source/guides/batching.rst Outdated
Comment thread docs/source/guides/batching.rst Outdated
frostming and others added 3 commits May 22, 2023 08:54
Co-authored-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
Co-authored-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
Comment thread src/bentoml/_internal/configuration/v1/__init__.py Outdated
Comment thread docs/source/guides/batching.rst
Signed-off-by: Frost Ming <me@frostming.com>
@larme larme self-requested a review May 25, 2023 09:42
Copy link
Copy Markdown
Contributor

@larme larme left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@aarnphm aarnphm merged commit dd4fa71 into bentoml:main May 25, 2023
@frostming frostming deleted the doc/batching branch June 6, 2023 10:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

feature: Support for Dict of Tensors in production mode

4 participants