Make test_generate_with_static_cache even less flaky
#34995
Merged
test_generate_with_static_cache even less flaky
#34995