[MPS] CrossAttention: (partial) fix for NaN attention_scores on PyTorch nightly#2643

Open

Birch-san wants to merge 1 commit intohuggingface:mainfrom

Birch-san:mps-attn-bias-alloc

Commits on May 9, 2023

for the (unused) attention bias which the baddbmm API requires us to pass in: create a smaller bias and broadcast it. this helps to prevent NaN result from baddbmm() on MPS on PyTorch 2.1.0.dev2023…
Birch-san
committed