LocalAI/backend/python
fakezeta 4a239a4bff
feat(transformers): various enhancements to the transformers backend (#2468)
update transformers

*Handle Temperature = 0 as greedy search
*Handle custom works as stop words
*Implement KV cache
*Phi 3 no more requires trust_remote_code: true
2024-06-03 08:52:55 +02:00
..
autogptq fix: pin version of setuptools for intel builds to work around #2406 (#2414) 2024-05-26 18:27:07 +00:00
bark fix: pin version of setuptools for intel builds to work around #2406 (#2414) 2024-05-26 18:27:07 +00:00
common fix: install pytorch from proper index for hipblas builds (#2413) 2024-05-26 18:05:52 +00:00
coqui TTS API improvements (#2308) 2024-06-01 18:26:27 +00:00
diffusers fix: pin version of setuptools for intel builds to work around #2406 (#2414) 2024-05-26 18:27:07 +00:00
exllama dependencies(grpcio): bump to fix CI issues (#2362) 2024-05-21 14:33:47 +02:00
exllama2 dependencies(grpcio): bump to fix CI issues (#2362) 2024-05-21 14:33:47 +02:00
mamba dependencies(grpcio): bump to fix CI issues (#2362) 2024-05-21 14:33:47 +02:00
openvoice fix: install pytorch from proper index for hipblas builds (#2413) 2024-05-26 18:05:52 +00:00
parler-tts fix: pin version of setuptools for intel builds to work around #2406 (#2414) 2024-05-26 18:27:07 +00:00
petals fix: pin version of setuptools for intel builds to work around #2406 (#2414) 2024-05-26 18:27:07 +00:00
rerankers fix: pin version of setuptools for intel builds to work around #2406 (#2414) 2024-05-26 18:27:07 +00:00
sentencetransformers fix: pin version of setuptools for intel builds to work around #2406 (#2414) 2024-05-26 18:27:07 +00:00
transformers feat(transformers): various enhancements to the transformers backend (#2468) 2024-06-03 08:52:55 +02:00
transformers-musicgen fix: pin version of setuptools for intel builds to work around #2406 (#2414) 2024-05-26 18:27:07 +00:00
vall-e-x fix: pin version of setuptools for intel builds to work around #2406 (#2414) 2024-05-26 18:27:07 +00:00
vllm fix: pin version of setuptools for intel builds to work around #2406 (#2414) 2024-05-26 18:27:07 +00:00
README.md refactor: move backends into the backends directory (#1279) 2023-11-13 22:40:16 +01:00

Common commands about conda environment

Create a new empty conda environment

conda create --name <env-name> python=<your version> -y

conda create --name autogptq python=3.11 -y

To activate the environment

As of conda 4.4

conda activate autogptq

The conda version older than 4.4

source activate autogptq

Install the packages to your environment

Sometimes you need to install the packages from the conda-forge channel

By using conda

conda install <your-package-name>

conda install -c conda-forge <your package-name>

Or by using pip

pip install <your-package-name>