Basic Eval

Basic evaluator prompt for QA scenario

Prerequisites

Install promptflow-devkit:

pip install promptflow-devkit

Run prompty

• Prepare your Azure Open AI resource follow this instruction and get your api_key if you don't have one.
• Note: you need the new gpt-35-turbo (0125) version to use the json_object response_format feature.
• Setup environment variables

Ensure you have put your azure open ai endpoint key in .env file. You can create one refer to this example file.

cat ../.env

• Test flow

pf flow test --flow eval.prompty --env --inputs sample.json