[UniDiffuser test] fix one test so that it runs correctly on V100#3675

sayakpaul merged 2 commits intomainhuggingface/diffusers:mainfrom

fix/issue#3609huggingface/diffusers:fix/issue#3609Copy head branch name to clipboard