Skip to content

add http timeout values for general, send, and receive to client#404

Merged
rapids-bot[bot] merged 2 commits intoNVIDIA:branch-25.10from
tmckayus:clienttimeouts
Sep 23, 2025
Merged

add http timeout values for general, send, and receive to client#404
rapids-bot[bot] merged 2 commits intoNVIDIA:branch-25.10from
tmckayus:clienttimeouts

Conversation

@tmckayus
Copy link
Copy Markdown
Contributor

Some large datasets, or even smaller datasets on a slow network, may take more than 30s to transfer to the server. Add timeout parameters to the cuopt service client to control the timeouts, defaulted to 30s.

Timeout parameters added: http_general_timeout (default 30), result_receive_timeout (default None), and data_send_timeout (default None). The latter two inherit the value of http_general_timeout if they are None.

All 3 are settable in the client class, however only the general timeout is exposed in the CLI (which should be enough control).

@tmckayus tmckayus requested a review from a team as a code owner September 19, 2025 20:02
@tmckayus tmckayus added bug Something isn't working non-breaking Introduces a non-breaking change labels Sep 19, 2025
@tmckayus tmckayus requested review from Iroy30 and removed request for rgsl888prabhu September 19, 2025 20:03
@anandhkb anandhkb added this to the 25.10 milestone Sep 20, 2025
@tmckayus
Copy link
Copy Markdown
Contributor Author

/merge

@rapids-bot rapids-bot bot merged commit 02751f3 into NVIDIA:branch-25.10 Sep 23, 2025
102 checks passed
@tmckayus tmckayus deleted the clienttimeouts branch February 5, 2026 14:51
jieyibi pushed a commit to yining043/cuopt that referenced this pull request Mar 26, 2026
…DIA#404)

Some large datasets, or even smaller datasets on a slow network, may take more than 30s to transfer to the server. Add timeout parameters to the cuopt service client to control the timeouts, defaulted to 30s.

Timeout parameters added: http_general_timeout (default 30), result_receive_timeout (default None), and data_send_timeout (default None).  The latter two inherit the value of http_general_timeout if they are None.

All 3 are settable in the client class, however only the general timeout is exposed in the CLI (which should be enough control).

Authors:
  - Trevor McKay (https://github.com/tmckayus)

Approvers:
  - Ramakrishnap (https://github.com/rgsl888prabhu)

URL: NVIDIA#404
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Something isn't working non-breaking Introduces a non-breaking change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants