githubmirror/ColossalAI | Gitverse

/

/

Обзор ДокументацияВойти

/

/

Аналитика

Безопасность

tests/test_infer/

test_dynamic_batching

[Inference] Dynamic Batching Inference, online and offline (#4953)

3 года назад

[misc] update pre-commit and run all files (#4752)

3 года назад

test_bloom_infer.py

[Kernels]Updated Triton kernels into 2.1.0 and adding flash-decoding for llama token attention (#4965)

3 года назад

test_chatglm2_infer.py

[Kernels]Updated Triton kernels into 2.1.0 and adding flash-decoding for llama token attention (#4965)

3 года назад

test_infer_engine.py

[misc] update pre-commit and run all files (#4752)

3 года назад

test_kvcache_manager.py

[misc] update pre-commit and run all files (#4752)

3 года назад

test_llama2_infer.py

[Kernels]Updated Triton kernels into 2.1.0 and adding flash-decoding for llama token attention (#4965)

3 года назад

test_llama_infer.py

[Kernels]Updated Triton kernels into 2.1.0 and adding flash-decoding for llama token attention (#4965)

3 года назад

test_pipeline_infer.py

[Pipeline Inference] Merge pp with tp (#4993)

3 года назад