[FEATURE]: SP with FlashAttention

[KaiLv69]

Describe the feature

Hi, I'm training LLaMA with SP and found that SP cannot be used with FlashAttention. When will SP compatible with FlashAttention?

[Edenzzzz]

Sure, I'm working on it; maybe in a few days