Overview

Current Progress

Repository Structure

Dataset Formats

Dataset Types

Instruction dataset

Multi-turn dialog dataset

Safety dataset

Text-only dataset

Dataset Requirements

How to Contribute

Creating a Dataset on Hugging Face

1. Convert your dataset file(s) to the Parquet format using pandas and pyarrow libraries:

2. Install Hugging Face Hub

3. Log in to Hugging Face

4. Push the Parquet file to Hugging Face using the following code:

5. Update the Hugging Face `README.md` file

Making a Pull Request

1. Fork this repository

2. Create a new branch in your fork

3. Add your dataset to the repository

4. Stage your changes and run the pre-commit hook

5. Submit a pull request