Skip to content

Fix responses add tests#39848

Merged
LysandreJik merged 5 commits intomainfrom
fix-responses-add-tests
Aug 1, 2025
Merged

Fix responses add tests#39848
LysandreJik merged 5 commits intomainfrom
fix-responses-add-tests

Conversation

@LysandreJik
Copy link
Copy Markdown
Member

Completes the /v1/responses support in transformers serve to:

  • Have transformers serve accept a default seed at startup, enables better integration testing
  • Correctly have the application of chat template return tensors
  • Handle instructions when received

We also add tests for the Responses API, with an end-to-end test.

@LysandreJik LysandreJik requested a review from gante August 1, 2025 14:40
@HuggingFaceDocBuilderDev
Copy link
Copy Markdown

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

Copy link
Copy Markdown
Contributor

@gante gante left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm, thank you for fixing 🙏

@gante
Copy link
Copy Markdown
Contributor

gante commented Aug 1, 2025

@LysandreJik I think our CI doesn't like the current integration tests for transformers serve 🤔

@LysandreJik
Copy link
Copy Markdown
Member Author

It's my bad I put as fast tests which shouldn't be, I'm putting them back as slow; this should get the CI green, and I'll check why the threads seem to not exit down the road

@LysandreJik LysandreJik merged commit 88ead3f into main Aug 1, 2025
17 checks passed
@LysandreJik LysandreJik deleted the fix-responses-add-tests branch August 1, 2025 16:06
zaristei pushed a commit to zaristei/transformers that referenced this pull request Sep 9, 2025
* Quick responses fix

* [serve] Fix responses API and add tests

* Remove typo

* Remove typo

* Tests
zaristei pushed a commit to zaristei/transformers that referenced this pull request Sep 9, 2025
* Quick responses fix

* [serve] Fix responses API and add tests

* Remove typo

* Remove typo

* Tests
zaristei pushed a commit to zaristei/transformers that referenced this pull request Sep 9, 2025
* Quick responses fix

* [serve] Fix responses API and add tests

* Remove typo

* Remove typo

* Tests
zaristei pushed a commit to zaristei/transformers that referenced this pull request Sep 9, 2025
* Quick responses fix

* [serve] Fix responses API and add tests

* Remove typo

* Remove typo

* Tests
zaristei pushed a commit to zaristei/transformers that referenced this pull request Sep 9, 2025
* Quick responses fix

* [serve] Fix responses API and add tests

* Remove typo

* Remove typo

* Tests
zaristei pushed a commit to zaristei/transformers that referenced this pull request Sep 9, 2025
* Quick responses fix

* [serve] Fix responses API and add tests

* Remove typo

* Remove typo

* Tests
zaristei pushed a commit to zaristei/transformers that referenced this pull request Sep 9, 2025
* Quick responses fix

* [serve] Fix responses API and add tests

* Remove typo

* Remove typo

* Tests
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants