[BUG]: Shardformer FP8 communication training accuracy degradation

[GuangyaoZhang]

Is there an existing issue for this bug?

• I have searched the existing issues

🐛 Describe the bug

TP+Split Gather(Acc) 4GPU
Original FP16 Model: 0.755
FP8 Communication: 0.737

Environment

No response