LocalAI/pkg
Ettore Di Giacinto 5d1018495f
feat(intel): add diffusers/transformers support ()
* feat(intel): add diffusers support

* try to consume upstream container image

* Debug

* Manually install deps

* Map transformers/hf cache dir to modelpath if not specified

* fix(compel): update initialization, pass by all gRPC options

* fix: add dependencies, implement transformers for xpu

* base it from the oneapi image

* Add pillow

* set threads if specified when launching the API

* Skip conda install if intel

* defaults to non-intel

* ci: add to pipelines

* prepare compel only if enabled

* Skip conda install if intel

* fix cleanup

* Disable compel by default

* Install torch 2.1.0 with Intel

* Skip conda on some setups

* Detect python

* Quiet output

* Do not override system python with conda

* Prefer python3

* Fixups

* exllama2: do not install without conda (overrides pytorch version)

* exllama/exllama2: do not install if not using cuda

* Add missing dataset dependency

* Small fixups, symlink to python, add requirements

* Add neural_speed to the deps

* correctly handle model offloading

* fix: device_map == xpu

* go back at calling python, fixed at dockerfile level

* Exllama2 restricted to only nvidia gpus

* Tokenizer to xpu
2024-03-07 14:37:45 +01:00
..
assets feat: embedded model configurations, add popular model examples, refactoring () 2024-01-05 23:16:33 +01:00
downloader refactor: move remaining api packages to core () 2024-03-01 16:19:53 +01:00
gallery refactor: move remaining api packages to core () 2024-03-01 16:19:53 +01:00
grammar feat(tools): Parallel function calling () 2024-02-20 21:58:45 +01:00
grpc Bump vLLM version + more options when loading models in vLLM () 2024-03-01 22:48:53 +01:00
langchain feat: add LangChainGo Huggingface backend () 2023-06-01 12:00:06 +02:00
model feat(intel): add diffusers/transformers support () 2024-03-07 14:37:45 +01:00
stablediffusion feat: support upscaled image generation with esrgan () 2023-06-05 17:21:38 +02:00
startup feat(startup): fetch model definition remotely () 2024-01-28 00:14:16 +01:00
tinydream feat: add tiny dream stable diffusion support () 2023-12-24 19:27:24 +00:00
utils Initial implementation of upload files api. () 2024-02-18 10:12:02 +00:00