fakezeta 4690b534e0

feat: user defined inference device for CUDA and OpenVINO (#2212) ...

user defined inference device

configuration via main_gpu parameter

2024-05-02 09:54:29 +02:00

..

cpp

feat(grpc): return consumed token count and update response accordingly (#2035)

2024-04-15 19:47:11 +02:00

go

refactor(application): introduce application global state (#2072)

2024-04-29 17:42:37 +00:00

python

feat: user defined inference device for CUDA and OpenVINO (#2212)

2024-05-02 09:54:29 +02:00

backend.proto

feat(rerankers): Add new backend, support jina rerankers API (#2121)

2024-04-25 00:19:02 +02:00