main
[moe] merge moe into main (#4978)
[misc] update pre-commit and run all files (#4752)
[Fix]: implement thread-safety singleton to avoid deadlock for very large-scale training scenarios (#5625)