v0.3.6
[moe] fix mixtral optim checkpoint (#5344)
[moe] init mixtral impl
[moe] support mixtral (#5309)