accelerate
vllm
grpcio==1.64.1
protobuf
certifi
transformers
setuptools