accelerate
vllm
grpcio==1.65.0
protobuf
certifi
transformers
setuptools