main
[inference] Refactor inference architecture (#5057)
[pre-commit.ci] pre-commit autoupdate (#5572)
[misc] refactor launch API and tensor constructor (#5666)