LocalAI

mirror of https://github.com/mudler/LocalAI.git synced 2024-12-21 05:33:09 +00:00

History

mudler 6ed7b10273 examples: add langchain agent example		2023-05-07 08:14:01 +02:00
..
agent.py	examples: add langchain agent example	2023-05-07 08:14:01 +02:00
docker-compose.yaml	Return usage in the API responses (#166 )	2023-05-03 17:29:18 +02:00
models	Return usage in the API responses (#166 )	2023-05-03 17:29:18 +02:00
README.md	examples: add langchain agent example	2023-05-07 08:14:01 +02:00
test.py	Return usage in the API responses (#166 )	2023-05-03 17:29:18 +02:00

README.md

Langchain-python

Langchain example from quickstart.

To interact with langchain, you can just set the OPENAI_API_BASE URL and provide a token with a random string.

See the example below:

# Clone LocalAI
git clone https://github.com/go-skynet/LocalAI

cd LocalAI/examples/langchain-python

# (optional) Checkout a specific LocalAI tag
# git checkout -b build <TAG>

# Download gpt4all-j to models/
wget https://gpt4all.io/models/ggml-gpt4all-j.bin -O models/ggml-gpt4all-j

# start with docker-compose
docker-compose up -d --build


pip install langchain
pip install openai

export OPENAI_API_BASE=http://localhost:8080
export OPENAI_API_KEY=sk-

python test.py
# A good company name for a company that makes colorful socks would be "Colorsocks".

python agent.py