[FEATURE]: gemini能否支持梯度累计

[zryowen123]

Describe the feature

训练大模型，增大batchsize有助于训练的稳定性，对于特别大的模型batchsize大小受限，只能通过梯度累积的方式实现增大batchsize的目的，gemini能否实现支持梯度累积呢？

[Issues-translate-bot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

Title: [FEATURE]: Can gemini support gradient accumulation

Describe the feature

To train a large model, increasing the batchsize is helpful for training stability. For a particularly large model, the batchsize is limited, and the purpose of increasing the batchsize can only be achieved through gradient accumulation. Can gemini support gradient accumulation?

[ver217]

您好，这个月有计划开始实现这个功能

[Issues-translate-bot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

Hello, there is a plan to start implementing this feature this month

[Fridge003]

您好，gemini对梯度累积的支持已经完成。
使用方法可以参考 docs/source/en/features/gradient_accumulation_with_booster.md（英文文档）/ docs/source/zh-Hans/features/gradient_accumulation_with_booster.md (中文文档)，我们的在线tutorials也会在几天后更新

[Issues-translate-bot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

Hello, gemini’s support for gradient accumulation has been completed.
For usage methods, please refer to docs/source/en/features/gradient_accumulation_with_booster.md (English document) / (docs/source/zh-Hans/features/gradient_accumulation_with_booster.md) (Chinese document). Our online tutorials will also be available in a few days. renew