accelerate
vllm
grpcio==1.64.0
protobuf
certifi
transformers
setuptools