Ettore Di Giacinto 453e9c5da9

fix(vllm): set default top_p with vllm (#1078) ...

**Description**

This PR fixes vllm when called with a request with an empty top_p

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

2023-09-19 18:10:23 +02:00

..

autogptq

feat(speculative-sampling): allow to specify a draft model in the model config (#1052)

2023-09-14 17:44:16 +02:00

bark

feat(speculative-sampling): allow to specify a draft model in the model config (#1052)

2023-09-14 17:44:16 +02:00

diffusers

feat(speculative-sampling): allow to specify a draft model in the model config (#1052)

2023-09-14 17:44:16 +02:00

exllama

feat(speculative-sampling): allow to specify a draft model in the model config (#1052)

2023-09-14 17:44:16 +02:00

huggingface

feat(speculative-sampling): allow to specify a draft model in the model config (#1052)

2023-09-14 17:44:16 +02:00

vall-e-x

feat(speculative-sampling): allow to specify a draft model in the model config (#1052)

2023-09-14 17:44:16 +02:00

vllm

fix(vllm): set default top_p with vllm (#1078)

2023-09-19 18:10:23 +02:00