main
[Inference] ADD async and sync Api server using FastAPI (#5396)
[Inference]Fix readme and example for API server (#5742)
[Online Server] Chat Api for streaming and not streaming response (#5470)
[Inference] Fix API server, test and example (#5712)