/
githubmirror
/
Open-Assistant
Обзор
Документация
Войти
/
githubmirror
/
Open-Assistant
Код
Запросы
0
Пакеты
0
Релизы
0
Аналитика
Безопасность
main
docker/inference/Dockerfile.worker-full
34 строки
864 B
AbdBarho
Update web container to include migrations (#2234)
07 апр 2023, 20:43
Не верифицирован
07 апр 2023, 20:43
59a9fe1
Код
Авторство
О чём код?
FROM ghcr.io/yk/text-generation-inference:latest RUN apt-get update && apt-get install -y --no-install-recommends \ git \ && rm -rf /var/lib/apt/lists/* ARG MODULE="inference" ARG SERVICE="worker" ARG APP_RELATIVE_PATH="${MODULE}/${SERVICE}" WORKDIR /worker RUN conda create -n worker python=3.10 -y COPY ./oasst-shared /tmp/oasst-shared RUN /opt/miniconda/envs/worker/bin/pip install /tmp/oasst-shared COPY ./${APP_RELATIVE_PATH}/requirements.txt . RUN /opt/miniconda/envs/worker/bin/pip install -r requirements.txt COPY ./${APP_RELATIVE_PATH}/*.py . COPY ./${APP_RELATIVE_PATH}/worker_full_main.sh /entrypoint.sh ENV MODEL_CONFIG_NAME="distilgpt2" ENV NUM_SHARDS="1" # These are upper bounds for the inference server. ENV MAX_INPUT_LENGTH="4096" ENV MAX_TOTAL_TOKENS="8192" ENV BACKEND_URL="ws://localhost:8000" ENTRYPOINT ["/entrypoint.sh"]