Table of Contents

What is ColossalChat and Coati ?

Online demo

Install

Install the environment

Install the Transformers

How to use?

Supervised datasets collection

RLHF Training Stage1 - Supervised instructs tuning

RLHF Training Stage2 - Training reward model

RLHF Training Stage3 - Training model with reinforcement learning by human feedback

Inference Quantization and Serving - After Training

Coati7B examples

Generation

Open QA

Limitation

FAQ

The Plan

Real-time progress

Invitation to open-source contribution

Quick Preview

Authors

Citations

Licenses