Ettore Di Giacinto c89271b2e4 feat(llama.cpp): add distributed llama.cpp inferencing (#2324) ... * feat(llama.cpp): support distributed llama.cpp Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * feat: let tweak how chat messages are merged together Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * refactor Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Makefile: register to ALL_GRPC_BACKENDS Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * refactoring, allow disable auto-detection of backends Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * minor fixups Signed-off-by: mudler <mudler@localai.io> * feat: add cmd to start rpc-server from llama.cpp Signed-off-by: mudler <mudler@localai.io> * ci: add ccache Signed-off-by: mudler <mudler@localai.io> --------- Signed-off-by: Ettore Di Giacinto <mudler@localai.io> Signed-off-by: mudler <mudler@localai.io>		2024-05-15 01:17:02 +02:00
..
ISSUE_TEMPLATE	docs/examples: enhancements (#1572)	2024-01-18 19:41:08 +01:00
workflows	feat(llama.cpp): add distributed llama.cpp inferencing (#2324)	2024-05-15 01:17:02 +02:00
bump_deps.sh	ci: manually update deps	2023-05-04 15:01:29 +02:00
bump_docs.sh	fix: github bump_docs.sh regex to drop emoji and other text (#2180)	2024-04-29 03:55:29 +00:00
checksum_checker.sh	ci: get file name correctly in checksum_checker.sh	2024-05-09 10:57:23 +02:00
dependabot.yml	Add dependabot.yml	2024-04-11 11:47:54 +02:00
FUNDING.yml	Create FUNDING.yml (#725)	2023-07-09 13:39:00 +02:00
labeler.yml	ci: add auto-label rule for gallery in labeler.yml	2024-04-27 19:52:26 +02:00
PULL_REQUEST_TEMPLATE.md	feat(vllm): Allow to set quantization (#1094)	2023-09-22 15:52:38 +02:00
release.yml	Update release.yml	2024-03-23 15:22:26 +01:00
stale.yml	feat: add PR template and stale configuration (#316)	2023-05-20 09:10:20 +02:00