LocalAI/backend/python/petals/Makefile

.PHONY: petals
petals:
	@echo "Creating virtual environment..."
	bash install.sh "petals.yml"
	@echo "Virtual environment created."

.PHONY: run
run:
	@echo "Running petals..."
	bash run.sh
	@echo "petals run."

.PHONY: test
test:
	@echo "Testing petals..."
	bash test.sh
	@echo "petals tested."
fix/docs: Python backend dependencies (#1360) * Update docs for new requirements.txt path Signed-off-by: Marcus Köhler <khler.marcus@gmail.com> * Fix typo (.PONY -> .PHONY) in python backend makefiles Signed-off-by: Marcus Köhler <khler.marcus@gmail.com> --------- Signed-off-by: Marcus Köhler <khler.marcus@gmail.com> 2023-11-30 17:46:55 +01:00			`.PHONY: petals`
feat(petals): add backend (#1350) * feat(petals): add backend Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * fixups --------- Signed-off-by: Ettore Di Giacinto <mudler@localai.io> 2023-11-28 09:01:46 +01:00			`petals:`
deps(conda): use transformers-env with vllm,exllama(2) (#1554) * deps(conda): use transformers with vllm * join vllm, exllama, exllama2, split petals 2024-01-06 13:32:28 +01:00			`@echo "Creating virtual environment..."`
feat(intel): add diffusers/transformers support (#1746) * feat(intel): add diffusers support * try to consume upstream container image * Debug * Manually install deps * Map transformers/hf cache dir to modelpath if not specified * fix(compel): update initialization, pass by all gRPC options * fix: add dependencies, implement transformers for xpu * base it from the oneapi image * Add pillow * set threads if specified when launching the API * Skip conda install if intel * defaults to non-intel * ci: add to pipelines * prepare compel only if enabled * Skip conda install if intel * fix cleanup * Disable compel by default * Install torch 2.1.0 with Intel * Skip conda on some setups * Detect python * Quiet output * Do not override system python with conda * Prefer python3 * Fixups * exllama2: do not install without conda (overrides pytorch version) * exllama/exllama2: do not install if not using cuda * Add missing dataset dependency * Small fixups, symlink to python, add requirements * Add neural_speed to the deps * correctly handle model offloading * fix: device_map == xpu * go back at calling python, fixed at dockerfile level * Exllama2 restricted to only nvidia gpus * Tokenizer to xpu 2024-03-07 14:37:45 +01:00			`bash install.sh "petals.yml"`
deps(conda): use transformers-env with vllm,exllama(2) (#1554) * deps(conda): use transformers with vllm * join vllm, exllama, exllama2, split petals 2024-01-06 13:32:28 +01:00			`@echo "Virtual environment created."`
feat(petals): add backend (#1350) * feat(petals): add backend Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * fixups --------- Signed-off-by: Ettore Di Giacinto <mudler@localai.io> 2023-11-28 09:01:46 +01:00
fix/docs: Python backend dependencies (#1360) * Update docs for new requirements.txt path Signed-off-by: Marcus Köhler <khler.marcus@gmail.com> * Fix typo (.PONY -> .PHONY) in python backend makefiles Signed-off-by: Marcus Köhler <khler.marcus@gmail.com> --------- Signed-off-by: Marcus Köhler <khler.marcus@gmail.com> 2023-11-30 17:46:55 +01:00			`.PHONY: run`
feat(petals): add backend (#1350) * feat(petals): add backend Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * fixups --------- Signed-off-by: Ettore Di Giacinto <mudler@localai.io> 2023-11-28 09:01:46 +01:00			`run:`
			`@echo "Running petals..."`
			`bash run.sh`
fix/docs: Python backend dependencies (#1360) * Update docs for new requirements.txt path Signed-off-by: Marcus Köhler <khler.marcus@gmail.com> * Fix typo (.PONY -> .PHONY) in python backend makefiles Signed-off-by: Marcus Köhler <khler.marcus@gmail.com> --------- Signed-off-by: Marcus Köhler <khler.marcus@gmail.com> 2023-11-30 17:46:55 +01:00			`@echo "petals run."`
feat(conda): share envs with transformer-based backends (#1465) * feat(conda): share env between diffusers and bark * Detect if env already exists * share diffusers and petals * tests: add petals * Use smaller model for tests with petals * test only model load on petals * tests(petals): run only load model tests * Revert "test only model load on petals" This reverts commit 111cfa97f1ebf07a598386e0fba915695f65d30b. * move transformers and sentencetransformers to common env * Share also transformers-musicgen 2023-12-21 02:35:15 -05:00
			`.PHONY: test`
			`test:`
			`@echo "Testing petals..."`
			`bash test.sh`
			`@echo "petals tested."`