Make test_generate_with_static_cache even less flaky

[ydshieh]

What does this PR do?

#34464 make some generate tests less flaky. However, with

tests/models/paligemma/test_modeling_paligemma.py::PaliGemmaForConditionalGenerationModelTest::test_generate_with_static_cache

it fails 0.6% of the time.

This PR takes the same idea in #34558 to make test_generate_with_static_cache even much less flaky. Running 2000 times and all pass.

It also make this process easier to applied to other tests in the future whenever necessary

[HuggingFaceDocBuilderDev]

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

[ydshieh]

also fixed

tests/models/persimmon/test_modeling_persimmon.py::PersimmonModelTest::test_generate_with_static_cache

[ydshieh]

tests/models/seamless_m4t_v2test_modeling_seamless_m4t_v2.py::SeamlessM4Tv2GenerationTest::test_speech_generation

previously failed 50% of the time. Now running 300 times and all pass.

[ydshieh]

Run 500 times

tests/models/musicgen_melody/test_modeling_musicgen_melody.py::MusicgenMelodyDecoderTest::test_eager_matches_sdpa_inference_1_bfloat16

2 failed (before) v.s. 0 failed with PR

tests/models/musicgen_melody/test_modeling_musicgen_melody.py::MusicgenMelodyTest::test_eager_matches_sdpa_inference_1_bfloat16

3 failed (before) v.s. 0 failed with PR

[ydshieh]

tests/models/persimmon/test_modeling_persimmon.py::PersimmonModelTest::test_generate_with_static_cache

200 runs: 8 failed (before) v.s 0 failed (PR)

[ArthurZucker]

Cool, I like that we have some utils that can be re-used!