fakezeta 8210ffcb6c feat: Token Stream support for Transformer, fix: missing package for OpenVINO (#1908) ... * Streaming working * Small fix for regression on CUDA and XPU * use pip version of optimum[openvino] * Update backend/python/transformers/transformers_server.py Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com> * Token streaming support fix optimum[openvino] package in install.sh * Token Streaming support --------- Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com> Co-authored-by: Ettore Di Giacinto <mudler@users.noreply.github.com>		2024-03-27 17:50:35 +01:00
..
transformers	feat: Token Stream support for Transformer, fix: missing package for OpenVINO (#1908)	2024-03-27 17:50:35 +01:00