mirror of
https://github.com/mudler/LocalAI.git
synced 2024-12-26 15:51:05 +00:00
25 lines
772 B
Markdown
25 lines
772 B
Markdown
|
# privateGPT
|
||
|
|
|
||
|
|
This example is a re-adaptation of https://github.com/imartinez/privateGPT to work with LocalAI and OpenAI endpoints. We have a fork with the changes required to work with privateGPT here https://github.com/go-skynet/privateGPT ( PR: https://github.com/imartinez/privateGPT/pull/408 ).
|
||
|
|
|
||
|
|
Follow the instructions in https://github.com/go-skynet/privateGPT:
|
||
|
|
|
||
|
|
```bash
|
||
|
|
git clone git@github.com:go-skynet/privateGPT.git
|
||
|
|
cd privateGPT
|
||
|
|
pip install -r requirements.txt
|
||
|
|
```
|
||
|
|
|
||
|
|
Rename `example.env` to `.env` and edit the variables appropriately.
|
||
|
|
|
||
|
|
This is an example `.env` file for LocalAI:
|
||
|
|
|
||
|
|
```
|
||
|
|
PERSIST_DIRECTORY=db
|
||
|
|
# Set to OpenAI here
|
||
|
|
MODEL_TYPE=OpenAI
|
||
|
|
EMBEDDINGS_MODEL_NAME=all-MiniLM-L6-v2
|
||
|
|
MODEL_N_CTX=1000
|
||
|
|
# LocalAI URL
|
||
|
|
OPENAI_API_BASE=http://localhost:8080/v1
|
||
|
|
```
|