v0.3.2
[shardformer] supported T5 and its variants (#4045)
Next commit [checkpointio] Unsharded Optimizer Checkpoint for Gemini Plugin (#4141)
[testing] move pytest to be inside the function (#4087)
[zero] test gradient accumulation (#1964)
[booster] support torch fsdp plugin in booster (#3697)