accelerate
vllm
grpcio==1.65.1
protobuf
certifi
transformers
setuptools