Add an integration test for LASR using pipe and chunked decoding by kho · Pull Request #42823 · huggingface/transformers

kho · 2025-12-11T20:37:51Z

What does this PR do?

Update the goldens for test_model_integration_batched
Add an integration test for LASR using pipe and chunked decoding.

This is separated from #42720 per request from @eustlb.

Before submitting

This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
Did you read the contributor guideline,
Pull Request section?
Was this discussed/approved via a Github issue or the forum? Please add a link
to it if that's the case.
Did you make sure to update the documentation with your changes? Here are the
documentation guidelines, and
here are tips on formatting docstrings.
Did you write any new necessary tests?

eustlb · 2025-12-12T13:56:56Z

run-slow: lasr

github-actions · 2025-12-12T13:57:28Z

💔 This comment contains run-slow, but unknown error occurred and the workflow run aborted!

eustlb · 2025-12-12T16:37:31Z

run-slow: lasr

github-actions · 2025-12-12T16:38:42Z

This comment contains run-slow, running the specified jobs:

models: ["models/lasr"]
quantizations: []

HuggingFaceDocBuilderDev · 2025-12-12T16:48:44Z

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

github-actions · 2025-12-12T16:49:02Z

CI Results

Workflow Run ⚙️

✅ No failing test specific to this PR 🎉 !

…tched

kho · 2025-12-22T18:00:36Z

@eustlb This PR would be ready to go once #42920 is in.

eustlb

LGTM, thanks! running slow tests to ensure values are the correct ones on CI devices.

eustlb · 2026-01-05T17:28:06Z

run-slow: lasr

github-actions · 2026-01-05T17:28:47Z

💔 This comment contains run-slow, but unknown error occurred and the workflow run aborted!

eustlb · 2026-01-06T09:14:10Z

run-slow: lasr

github-actions · 2026-01-06T09:14:40Z

💔 This comment contains run-slow, but unknown error occurred and the workflow run aborted!

eustlb · 2026-01-06T15:59:01Z

run-slow: lasr

github-actions · 2026-01-06T16:00:10Z

This comment contains run-slow, running the specified jobs:

models: ["models/lasr"]
quantizations: []

github-actions · 2026-01-06T16:17:12Z

CI Results

Workflow Run ⚙️

Model CI Report

❌ Failed tests

lasr:
tests/models/lasr/test_modeling_lasr.py::LasrForCTCIntegrationTest::test_model_integration
tests/models/lasr/test_modeling_lasr.py::LasrForCTCIntegrationTest::test_model_integration_batched
tests/models/lasr/test_modeling_lasr.py::LasrForCTCIntegrationTest::test_model_integration_pipe_with_chunk

kho · 2026-01-06T16:30:48Z

The tests are failing due to the model used in integration testing is gated. Let me create a new test model later today.

eustlb · 2026-01-07T10:40:06Z

run-slow: lasr

github-actions · 2026-01-07T10:41:14Z

This comment contains run-slow, running the specified jobs:

models: ["models/lasr"]
quantizations: []

github-actions · 2026-01-07T10:59:15Z

CI Results

Workflow Run ⚙️

Model CI Report

❌ Failed tests

lasr:
tests/models/lasr/test_modeling_lasr.py::LasrForCTCIntegrationTest::test_model_integration
tests/models/lasr/test_modeling_lasr.py::LasrForCTCIntegrationTest::test_model_integration_batched
tests/models/lasr/test_modeling_lasr.py::LasrForCTCIntegrationTest::test_model_integration_pipe_with_chunk

…test goldens

kho · 2026-02-03T04:54:10Z

    @classmethod
    def setUp(cls):
-        cls.checkpoint_name = "eustlb/lasr"
+        cls.checkpoint_name = "hf-internal-testing/lasr-test"


@eustlb The test checkpoint is https://huggingface.co/wuketest/lasr_integration_test. Could you help me make a copy to hf-internal-testing/lasr-test?

eustlb

thanks @kho! running slow tests before merging to see whether we need to update value for the runners

eustlb · 2026-02-09T17:05:08Z

run-slow: lasr

github-actions · 2026-02-09T17:05:53Z

💔 This comment contains run-slow, but unknown error occurred and the workflow run aborted!

eustlb · 2026-02-20T13:38:11Z

run-slow: lasr

github-actions · 2026-02-20T13:39:21Z

Workflow Run ⚙️

This comment contains run-slow, running the specified jobs:

models: ["models/lasr"]
quantizations: []

github-actions · 2026-02-20T13:50:08Z

CI Results

Workflow Run ⚙️

Commit Info

Context	Commit	Description
RUN	3579e81d	workflow commit (merge commit)
PR	8940358a	branch commit (from PR)
main	8151000f	base commit (on `main`)

✅ No failing test specific to this PR 🎉 👏 !

Because of the out of date tokenizer mapping, AutoTokenizer started returning TokenizersBackend instead LasrTokenizer after huggingface#42894, which caused Google-Health/medasr#12.

… checkpoint

kho · 2026-03-06T19:50:34Z

run-slow: lasr

kho · 2026-03-10T16:58:15Z

@eustlb Mind taking another look?

github-actions · 2026-03-12T09:49:20Z

[For maintainers] Suggested jobs to run (before merge)

run-slow: auto, lasr

eustlb

Thanks a lot @kho! I've udpated values for our runners

…gingface#42823) * Add an integration test for LASR using pipe and chunked decoding * Revise goldens in LasrForCTCIntegrationTest.test_model_integration_batched * Enable LasrForCTCIntegrationTest * add require_torch_accelerator * Use a publicly accessible test model for LASR and update integration test goldens * Correct the tokenizer mapping for LASR models Because of the out of date tokenizer mapping, AutoTokenizer started returning TokenizersBackend instead LasrTokenizer after huggingface#42894, which caused Google-Health/medasr#12. * Remove require_read_token since we now use a publicly assessible test checkpoint * update values for runners --------- Co-authored-by: eustlb <94853470+eustlb@users.noreply.github.com> Co-authored-by: Eustache Le Bihan <eulebihan@gmail.com>

kho mentioned this pull request Dec 11, 2025

Add inputs_to_logits_ratio to LasrCTCConfig #42720

Merged

5 tasks

kho force-pushed the pipe_with_chunk_test branch from 957df33 to 2310957 Compare December 12, 2025 16:04

kho force-pushed the pipe_with_chunk_test branch from 962049f to d352827 Compare December 19, 2025 20:14

kho added 3 commits December 22, 2025 09:55

Add an integration test for LASR using pipe and chunked decoding

a1d7b22

Revise goldens in LasrForCTCIntegrationTest.test_model_integration_ba…

00083c4

…tched

Enable LasrForCTCIntegrationTest

36af114

kho force-pushed the pipe_with_chunk_test branch from d352827 to 36af114 Compare December 22, 2025 17:59

pcuenca mentioned this pull request Dec 23, 2025

Fix audio pipelines #42920

Merged

eustlb self-requested a review January 5, 2026 17:24

eustlb approved these changes Jan 5, 2026

View reviewed changes

Merge branch 'main' into pipe_with_chunk_test

200637e

eustlb enabled auto-merge (squash) January 6, 2026 09:13

eustlb disabled auto-merge January 6, 2026 09:13

Merge branch 'main' into pipe_with_chunk_test

3d167ba

Merge branch 'main' into pipe_with_chunk_test

cd97ef7

Merge branch 'main' into pipe_with_chunk_test

cb5f71c

Use a publicly accessible test model for LASR and update integration …

943fd80

…test goldens

kho commented Feb 3, 2026

View reviewed changes

eustlb approved these changes Feb 9, 2026

View reviewed changes

Merge branch 'main' into pipe_with_chunk_test

e9952ae

Merge branch 'main' into pipe_with_chunk_test

8940358

eustlb enabled auto-merge (squash) February 20, 2026 13:38

kho added 3 commits March 6, 2026 11:44

Merge branch 'main' into pipe_with_chunk_test

4630b10

Correct the tokenizer mapping for LASR models

f9aa042

Because of the out of date tokenizer mapping, AutoTokenizer started returning TokenizersBackend instead LasrTokenizer after huggingface#42894, which caused Google-Health/medasr#12.

Remove require_read_token since we now use a publicly assessible test…

61e9ba7

… checkpoint

auto-merge was automatically disabled March 6, 2026 19:49
Head branch was pushed to by a user without write access

kho mentioned this pull request Mar 11, 2026

MedAsr does not work on HF transformers 5.0.0 or 5.0.1, prints <epsilon> Google-Health/medasr#12

Closed

update values for runners

64d84c8

eustlb approved these changes Mar 12, 2026

View reviewed changes

eustlb enabled auto-merge March 12, 2026 09:50

eustlb added this pull request to the merge queue Mar 12, 2026

Merged via the queue into huggingface:main with commit dc4016f Mar 12, 2026
28 checks passed

Conversation

kho commented Dec 11, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What does this PR do?

Before submitting

Uh oh!

eustlb commented Dec 12, 2025

Uh oh!

github-actions Bot commented Dec 12, 2025

Uh oh!

eustlb commented Dec 12, 2025

Uh oh!

github-actions Bot commented Dec 12, 2025

Uh oh!

HuggingFaceDocBuilderDev commented Dec 12, 2025

Uh oh!

github-actions Bot commented Dec 12, 2025

CI Results

Uh oh!

kho commented Dec 22, 2025

Uh oh!

eustlb left a comment

Choose a reason for hiding this comment

Uh oh!

eustlb commented Jan 5, 2026

Uh oh!

github-actions Bot commented Jan 5, 2026

Uh oh!

eustlb commented Jan 6, 2026

Uh oh!

github-actions Bot commented Jan 6, 2026

Uh oh!

eustlb commented Jan 6, 2026

Uh oh!

github-actions Bot commented Jan 6, 2026

Uh oh!

github-actions Bot commented Jan 6, 2026

CI Results

Model CI Report

❌ Failed tests

Uh oh!

kho commented Jan 6, 2026

Uh oh!

eustlb commented Jan 7, 2026

Uh oh!

github-actions Bot commented Jan 7, 2026

Uh oh!

github-actions Bot commented Jan 7, 2026

CI Results

Model CI Report

❌ Failed tests

Uh oh!

kho Feb 3, 2026

Choose a reason for hiding this comment

Uh oh!

eustlb Feb 9, 2026

Choose a reason for hiding this comment

Uh oh!

eustlb left a comment

Choose a reason for hiding this comment

Uh oh!

eustlb commented Feb 9, 2026

Uh oh!

github-actions Bot commented Feb 9, 2026

Uh oh!

eustlb commented Feb 20, 2026

Uh oh!

github-actions Bot commented Feb 20, 2026

Uh oh!

github-actions Bot commented Feb 20, 2026

CI Results

Commit Info

Uh oh!

kho commented Mar 6, 2026

Uh oh!

kho commented Mar 10, 2026

Uh oh!

github-actions Bot commented Mar 12, 2026

Uh oh!

eustlb left a comment

kho commented Dec 11, 2025 •

edited

Loading