ExternalVendorCode/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2024-12-18 20:27:57 +00:00
Code Issues Actions 12 Packages Projects Releases Wiki Activity
b722e7eb7e
LocalAI/examples/privateGPT
History
Ettore Di Giacinto f5f8c687be
examples: add privateGPT example (#355)
2023-05-23 10:32:34 +02:00
..
README.md examples: add privateGPT example (#355) 2023-05-23 10:32:34 +02:00

README.md

privateGPT

This example is a re-adaptation of https://github.com/imartinez/privateGPT to work with LocalAI and OpenAI endpoints. We have a fork with the changes required to work with privateGPT here https://github.com/go-skynet/privateGPT ( PR: https://github.com/imartinez/privateGPT/pull/408 ).

Follow the instructions in https://github.com/go-skynet/privateGPT:

git clone git@github.com:go-skynet/privateGPT.git
cd privateGPT
pip install -r requirements.txt

Rename example.env to .env and edit the variables appropriately.

This is an example .env file for LocalAI:

PERSIST_DIRECTORY=db
# Set to OpenAI here
MODEL_TYPE=OpenAI
EMBEDDINGS_MODEL_NAME=all-MiniLM-L6-v2
MODEL_N_CTX=1000
# LocalAI URL
OPENAI_API_BASE=http://localhost:8080/v1