v0.3.4
[NFC] polish colossalai/inference/quant/gptq/cai_gptq/__init__.py code style (#4792)
[Inference] Dynamic Batching Inference, online and offline (#4953)