ExternalVendorCode/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2024-12-21 05:33:09 +00:00
Code Issues Actions 12 Packages Projects Releases Wiki Activity

docs: site update fixing old image text / How To update updating GPU and CPU docker pages (#1399)

Browse Source 
* Update _index.en.md

Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>

* Update easy-setup-docker-cpu.md

Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>

* Update easy-setup-docker-gpu.md

Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>

---------

Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
This commit is contained in:
lunamidori5 2023-12-08 01:27:21 -08:00 committed by GitHub
parent 8b6e601405
commit adfa7aa1fa
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
3 changed files with 63 additions and 18 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

50
docs/content/getting_started/_index.en.md
View File

@ -183,20 +183,48 @@ You can control LocalAI with command line arguments, to specify a binding addres
LocalAI has a set of images to support CUDA, ffmpeg and 'vanilla' (CPU-only). The image list is on [quay](https://quay.io/repository/go-skynet/local-ai?tab=tags): LocalAI has a set of images to support CUDA, ffmpeg and 'vanilla' (CPU-only). The image list is on [quay](https://quay.io/repository/go-skynet/local-ai?tab=tags):
- Vanilla images tags: `master`, `v1.40.0`, `latest`, ... {{< tabs >}}
- FFmpeg images tags: `master-ffmpeg`, `v1.40.0-ffmpeg`, ... {{% tab name="Vanilla / CPU Images" %}}
- CUDA `11` tags: `master-cublas-cuda11`, `v1.40.0-cublas-cuda11`, ... - `master`
- CUDA `12` tags: `master-cublas-cuda12`, `v1.40.0-cublas-cuda12`, ... - `latest`
- CUDA `11` + FFmpeg tags: `master-cublas-cuda11-ffmpeg`, `v1.40.0-cublas-cuda11-ffmpeg`, ... - `v2.0.0`
- CUDA `12` + FFmpeg tags: `master-cublas-cuda12-ffmpeg`, `v1.40.0-cublas-cuda12-ffmpeg`, ... - `v2.0.0-ffmpeg`
- Core images (smaller images without python dependencies): `master-core`, `v1.40.0-core`, ... - `v2.0.0-ffmpeg-core`
Core Images - Smaller images without predownload python dependencies
{{% /tab %}}
{{% tab name="GPU Images CUDA 11" %}}
- `master-cublas-cuda11`
- `master-cublas-cuda11-core`
- `v2.0.0-cublas-cuda11`
- `v2.0.0-cublas-cuda11-core`
- `v2.0.0-cublas-cuda11-ffmpeg`
- `v2.0.0-cublas-cuda11-ffmpeg-core`
Core Images - Smaller images without predownload python dependencies
{{% /tab %}}
{{% tab name="GPU Images CUDA 12" %}}
- `master-cublas-cuda12`
- `master-cublas-cuda12-core`
- `v2.0.0-cublas-cuda12`
- `v2.0.0-cublas-cuda12-core`
- `v2.0.0-cublas-cuda12-ffmpeg`
- `v2.0.0-cublas-cuda12-ffmpeg-core`
Core Images - Smaller images without predownload python dependencies
{{% /tab %}}
{{< /tabs >}}
Example: Example:
- Standard (GPT + `stablediffusion`): `quay.io/go-skynet/local-ai:latest` - Standard (GPT + `stablediffusion`): `quay.io/go-skynet/local-ai:latest`
- FFmpeg: `quay.io/go-skynet/local-ai:v1.40.0-ffmpeg` - FFmpeg: `quay.io/go-skynet/local-ai:v2.0.0-ffmpeg`
- CUDA 11+FFmpeg: `quay.io/go-skynet/local-ai:v1.40.0-cublas-cuda11-ffmpeg` - CUDA 11+FFmpeg: `quay.io/go-skynet/local-ai:v2.0.0-cublas-cuda11-ffmpeg`
- CUDA 12+FFmpeg: `quay.io/go-skynet/local-ai:v1.40.0-cublas-cuda12-ffmpeg` - CUDA 12+FFmpeg: `quay.io/go-skynet/local-ai:v2.0.0-cublas-cuda12-ffmpeg`
{{% notice note %}} {{% notice note %}}
Note: the binary inside the image is pre-compiled, and might not suite all CPUs. Note: the binary inside the image is pre-compiled, and might not suite all CPUs.
@ -237,7 +265,7 @@ Deploy a single LocalAI pod with 6GB of persistent storage serving up a `ggml-gp
replicaCount: 1 replicaCount: 1
deployment: deployment:
image: quay.io/go-skynet/local-ai:latest ##(This is for CPU only, to use GPU change it to a image that supports GPU IE "v1.40.0-cublas-cuda12") image: quay.io/go-skynet/local-ai:latest ##(This is for CPU only, to use GPU change it to a image that supports GPU IE "v2.0.0-cublas-cuda12-core")
env: env:
threads: 4 threads: 4
context_size: 512 context_size: 512

2
docs/content/howtos/easy-setup-docker-cpu.md
View File

@ -85,7 +85,7 @@ version: '3.6'
services: services:
api: api:
image: quay.io/go-skynet/local-ai:v1.40.0 image: quay.io/go-skynet/local-ai:v2.0.0
tty: true # enable colorized logs tty: true # enable colorized logs
restart: always # should this be on-failure ? restart: always # should this be on-failure ?
ports: ports:

29
docs/content/howtos/easy-setup-docker-gpu.md
View File

@ -81,12 +81,29 @@ It will use a container from [quay.io](https://quay.io/repository/go-skynet/loca
Also note this `docker-compose` file is for `CUDA` only. Also note this `docker-compose` file is for `CUDA` only.
Please change the image to what you need. Please change the image to what you need.
``` {{< tabs >}}
Cuda 11 - v1.40.0-cublas-cuda11 {{% tab name="GPU Images CUDA 11" %}}
Cuda 12 - v1.40.0-cublas-cuda12 - `master-cublas-cuda11`
Cuda 11 with TTS - v1.40.0-cublas-cuda11-ffmpeg - `master-cublas-cuda11-core`
Cuda 12 with TTS - v1.40.0-cublas-cuda12-ffmpeg - `v2.0.0-cublas-cuda11`
``` - `v2.0.0-cublas-cuda11-core`
- `v2.0.0-cublas-cuda11-ffmpeg`
- `v2.0.0-cublas-cuda11-ffmpeg-core`
Core Images - Smaller images without predownload python dependencies
{{% /tab %}}
{{% tab name="GPU Images CUDA 12" %}}
- `master-cublas-cuda12`
- `master-cublas-cuda12-core`
- `v2.0.0-cublas-cuda12`
- `v2.0.0-cublas-cuda12-core`
- `v2.0.0-cublas-cuda12-ffmpeg`
- `v2.0.0-cublas-cuda12-ffmpeg-core`
Core Images - Smaller images without predownload python dependencies
{{% /tab %}}
{{< /tabs >}}
```docker ```docker
version: '3.6' version: '3.6'