main
[Fix] Fix Inference Example, Tests, and Requirements (#5688)
Pass inference model shard configs for module init
[Inference] Fix flash-attn import and add model test (#5794)