v0.3.4
Hotfix/auto parallel zh doc (#2820)
[doc] update advanced tutorials, training gpt with hybrid parallelism (#4866)
[doc] add supported feature diagram for hybrid parallel plugin (#4996)
[doc]update moe chinese document. (#3890)
[gemini] support gradient accumulation (#4869)
[doc] update and revise some typos and errs in docs (#4107)
[dooc] fixed the sidebar itemm key (#2672)