Table of Contents

What is ColossalChat and Coati ?

Online demo

Install

Install the environment

Install the Transformers

How to use?

Supervised datasets collection

Stage1 - Supervised instructs tuning

Stage2 - Training reward model

Stage3 - Training model with reinforcement learning by human feedback

Inference - After Training

8-bit setup

4-bit setup

Coati7B examples

Generation

Open QA

Limitation for LLaMA-finetuned models

Limitation of dataset

FAQ

How to save/load checkpoint

The Plan

Real-time progress

Invitation to open-source contribution

Quick Preview

Authors

Citations

Licenses