Skip to content

Remove size check between attn_weights and kv_seq_len for phi3#32339

Merged
ArthurZucker merged 2 commits intohuggingface:mainfrom
helunwencser:static_cache_for_phi_3
Aug 1, 2024
Merged

Remove size check between attn_weights and kv_seq_len for phi3#32339
ArthurZucker merged 2 commits intohuggingface:mainfrom
helunwencser:static_cache_for_phi_3

Commits

Commits on Jul 30, 2024