t5gemma2-vllm-plugin

T5Gemma 2 vLLM plugin

Requirements

Install

Serve raw T5Gemma 2

Serve a T5Gemma 2 DFlash-family checkpoint

CUDA Graph support

Quick request

Acceptance metrics

Notes and limitations