/
osbornray
/
PythonHacks
Обзор
Документация
Войти
/
osbornray
/
PythonHacks
Код
Запросы
0
Задачи
Вики
Пакеты
0
Релизы
0
Аналитика
Безопасность
main
AWS_BedRock/chat.py
31 строка
1 KB
RekhuGopal
Udpated
01 окт 2023, 12:04
01 окт 2023, 12:04
c16a334
Код
Авторство
О чём код?
import boto3 import json import base64 client = boto3.client('bedrock-runtime') # Specify the input data and model ID """ input_data = { "modelId": "ai21.j2-mid-v1", "contentType": "application/json", "accept": "*/*", "body": "{\"prompt\":\"how to cook tomato rice\",\"maxTokens\":200,\"temperature\":0.7,\"topP\":1,\"stopSequences\":[],\"countPenalty\":{\"scale\":0},\"presencePenalty\":{\"scale\":0},\"frequencyPenalty\":{\"scale\":0}}" } """ input_data = { "modelId": "ai21.j2-ultra-v1", "contentType": "application/json", "accept": "*/*", "body": {"prompt":"this is where you place your input text","maxTokens":200,"temperature":0,"topP":250,"stop_sequences":[],"countPenalty":{"scale":0},"presencePenalty":{"scale":0},"frequencyPenalty":{"scale":0}} } # Invoke the model for inference response = client.invoke_model(contentType='application/json', body=json.dumps(input_data["body"]).encode('utf-8'), modelId=input_data['modelId']) Data = json.loads(response['body'].read().decode('utf-8')) print(Data) #Retrieve the inference response #print(Data['completions'][0]['data']['text']) #print(Data['generations'][0]['text'])