LocalAI/examples
Ettore Di Giacinto bc8f648a91
fix(doc/examples): set defaults to mirostat ()
The default sampler on some models don't return enough candidates which
leads to a false sense of randomness. Tracing back the code it looks
that with the temperature sampler there might not be enough
candidates to pick from, and since the seed and "randomness" take effect
while picking a good candidate this yields to the same results over and
over.

Fixes https://github.com/mudler/LocalAI/issues/1723 by updating the
examples and documentation to use mirostat instead.
2024-03-11 19:49:03 +01:00
..
autoGPT Cleaning up examples/ models and starter .env files () 2023-10-02 18:14:10 +02:00
bruno/LocalAI Test Requests refactor: move remaining api packages to core () 2024-03-01 16:19:53 +01:00
chainlit chianlit example () 2023-11-02 22:56:46 +01:00
chatbot-ui Cleaned up chatbot-ui READMEs () 2023-09-18 16:43:06 +02:00
chatbot-ui-manual Cleaning up examples/ models and starter .env files () 2023-10-02 18:14:10 +02:00
configurations fix(doc/examples): set defaults to mirostat () 2024-03-11 19:49:03 +01:00
continue Update README to reflect changes in Continue's config file () 2023-09-07 16:29:07 +02:00
discord-bot Cleaning up examples/ models and starter .env files () 2023-10-02 18:14:10 +02:00
e2e-fine-tuning fix (docs): fixed broken links github/ -> github.com/ () 2024-02-02 18:18:03 +01:00
flowise deps: update gpt4all bindings, fix search path on new versions () 2023-06-14 13:24:53 +02:00
functions Cleaning up examples/ models and starter .env files () 2023-10-02 18:14:10 +02:00
insomnia feat: Model Gallery Endpoint Refactor / Mutable Galleries Endpoints () 2023-09-02 09:00:44 +02:00
k8sgpt Update to working k8sgpt + localai example in documentation () 2023-08-01 22:31:36 +02:00
kubernetes feat(tts): respect YAMLs config file, add sycl docs/examples () 2024-02-10 21:37:03 +01:00
langchain refactor: move remaining api packages to core () 2024-03-01 16:19:53 +01:00
langchain-chroma Cleaning up examples/ models and starter .env files () 2023-10-02 18:14:10 +02:00
langchain-huggingface Cleaning up examples/ models and starter .env files () 2023-10-02 18:14:10 +02:00
langchain-python examples: simplify langchain-python () 2023-06-08 00:05:17 +02:00
llamaindex Modernized LlamaIndex integration () 2024-01-20 10:06:32 +01:00
localai-webui Cleaning up examples/ models and starter .env files () 2023-10-02 18:14:10 +02:00
models Cleaning up examples/ models and starter .env files () 2023-10-02 18:14:10 +02:00
privateGPT examples: add privateGPT example () 2023-05-23 10:32:34 +02:00
query_data Cleaning up examples/ models and starter .env files () 2023-10-02 18:14:10 +02:00
rwkv images: cleanup, drop .dev Dockerfile () 2023-05-30 15:58:10 +02:00
slack-bot Cleaning up examples/ models and starter .env files () 2023-10-02 18:14:10 +02:00
slack-qa-bot Cleaning up examples/ models and starter .env files () 2023-10-02 18:14:10 +02:00
streamlit-bot 1038 - Streamlit bot with LocalAI () 2023-09-17 08:33:23 +02:00
telegram-bot [Telegram-bot example] Fix lint for command docker-compose () 2023-07-21 20:56:04 +02:00
README.md docs: add fine-tuning example () 2023-12-01 19:11:45 +01:00

Examples

ChatGPT OSS alternative Image generation
Screenshot from 2023-04-26 23-59-55 b6441997879
Telegram bot Flowise
Screenshot from 2023-06-09 00-36-26 Screenshot from 2023-05-30 18-01-03

Here is a list of projects that can easily be integrated with the LocalAI backend.

Projects

AutoGPT

by @mudler

This example shows how to use AutoGPT with LocalAI.

Check it out here

Chatbot-UI

by @mkellerman

Screenshot from 2023-04-26 23-59-55

This integration shows how to use LocalAI with mckaywrigley/chatbot-ui.

Check it out here

There is also a separate example to show how to manually setup a model: example

K8sGPT

by @mudler

This example show how to use LocalAI inside Kubernetes with k8sgpt.

Screenshot from 2023-06-19 23-58-47

Fine-tuning a model and convert it to gguf to use it with LocalAI

by @mudler

This example is an e2e example on how to fine-tune a model with axolotl and convert it to gguf to use it with LocalAI.

Check it out here

Flowise

by @mudler

This example shows how to use FlowiseAI/Flowise with LocalAI.

Check it out here

Discord bot

by @mudler

Run a discord bot which lets you talk directly with a model

Check it out here, or for a live demo you can talk with our bot in #random-bot in our discord server.

Langchain

by @dave-gray101

A ready to use example to show e2e how to integrate LocalAI with langchain

Check it out here

Langchain Python

by @mudler

A ready to use example to show e2e how to integrate LocalAI with langchain

Check it out here

LocalAI functions

by @mudler

A ready to use example to show how to use OpenAI functions with LocalAI

Check it out here

LocalAI WebUI

by @dhruvgera

image

A light, community-maintained web interface for LocalAI

Check it out here

How to run rwkv models

by @mudler

A full example on how to run RWKV models with LocalAI

Check it out here

PrivateGPT

by @mudler

A full example on how to run PrivateGPT with LocalAI

Check it out here

Slack bot

by @mudler

Run a slack bot which lets you talk directly with a model

Check it out here

Slack bot (Question answering)

by @mudler

Run a slack bot, ideally for teams, which lets you ask questions on a documentation website, or a github repository.

Check it out here

Question answering on documents with llama-index

by @mudler

Shows how to integrate with Llama-Index to enable question answering on a set of documents.

Check it out here

Question answering on documents with langchain and chroma

by @mudler

Shows how to integrate with Langchain and Chroma to enable question answering on a set of documents.

Check it out here

Telegram bot

_by @mudler

Screenshot from 2023-06-09 00-36-26

Use LocalAI to power a Telegram bot assistant, with Image generation and audio support!

Check it out here

Template for Runpod.io

by @fHachenberg

Allows to run any LocalAI-compatible model as a backend on the servers of https://runpod.io

Check it out here

Continue

by @gruberdev

Screenshot

Demonstrates how to integrate an open-source copilot alternative that enhances code analysis, completion, and improvements. This approach seamlessly integrates with any LocalAI model, offering a more user-friendly experience.

Check it out here

Streamlit bot

by @majoshi1

Screenshot

A chat bot made using Streamlit & LocalAI.

Check it out here

Want to contribute?

Create an issue, and put Example: <description> in the title! We will post your examples here.