Pretraining LLaMA-1/2: best practices for building LLaMA-1/2-like base models

LLaMA2

LLaMA1

Dataset

Training

Usage

1. Installation

2. Download the dataset

3. Command line arguments

4. Shell Script Examples

a. Running environment

b. Running command

c. Results

Reference