mirror of
https://github.com/mudler/LocalAI.git
synced 2024-12-30 09:28:51 +00:00
202 lines
12 KiB
Markdown
202 lines
12 KiB
Markdown
<h1 align="center">
|
||
<br>
|
||
<img height="300" src="https://github.com/go-skynet/LocalAI/assets/2420543/0966aa2a-166e-4f99-a3e5-6c915fc997dd"> <br>
|
||
LocalAI
|
||
<br>
|
||
</h1>
|
||
|
||
<p align="center">
|
||
<a href="https://github.com/go-skynet/LocalAI/fork" target="blank">
|
||
<img src="https://img.shields.io/github/forks/go-skynet/LocalAI?style=for-the-badge" alt="LocalAI forks"/>
|
||
</a>
|
||
<a href="https://github.com/go-skynet/LocalAI/stargazers" target="blank">
|
||
<img src="https://img.shields.io/github/stars/go-skynet/LocalAI?style=for-the-badge" alt="LocalAI stars"/>
|
||
</a>
|
||
<a href="https://github.com/go-skynet/LocalAI/pulls" target="blank">
|
||
<img src="https://img.shields.io/github/issues-pr/go-skynet/LocalAI?style=for-the-badge" alt="LocalAI pull-requests"/>
|
||
</a>
|
||
<a href='https://github.com/go-skynet/LocalAI/releases'>
|
||
<img src='https://img.shields.io/github/release/go-skynet/LocalAI?&label=Latest&style=for-the-badge'>
|
||
</a>
|
||
</p>
|
||
|
||
> :bulb: Get help - [❓FAQ](https://localai.io/faq/) [💭Discussions](https://github.com/go-skynet/LocalAI/discussions) [:speech_balloon: Discord](https://discord.gg/uJAeKSAGDy) [:book: Documentation website](https://localai.io/)
|
||
>
|
||
> [💻 Quickstart](https://localai.io/basics/getting_started/) [📣 News](https://localai.io/basics/news/) [ 🛫 Examples ](https://github.com/go-skynet/LocalAI/tree/master/examples/) [ 🖼️ Models ](https://localai.io/models/) [ 🚀 Roadmap ](https://github.com/mudler/LocalAI/issues?q=is%3Aissue+is%3Aopen+label%3Aroadmap)
|
||
|
||
[](https://github.com/go-skynet/LocalAI/actions/workflows/test.yml)[](https://github.com/go-skynet/LocalAI/actions/workflows/release.yaml)[](https://github.com/go-skynet/LocalAI/actions/workflows/image.yml)[](https://github.com/go-skynet/LocalAI/actions/workflows/bump_deps.yaml)[](https://artifacthub.io/packages/search?repo=localai)
|
||
|
||
**LocalAI** is the free, Open Source OpenAI alternative. LocalAI act as a drop-in replacement REST API that’s compatible with OpenAI API specifications for local inferencing. It allows you to run LLMs, generate images, audio (and not only) locally or on-prem with consumer grade hardware, supporting multiple model families. Does not require GPU.
|
||
|
||
<p align="center"><b>Follow LocalAI </b></p>
|
||
|
||
<p align="center">
|
||
<a href="https://twitter.com/LocalAI_API" target="blank">
|
||
<img src="https://img.shields.io/twitter/follow/LocalAI_API?label=Follow: LocalAI_API&style=social" alt="Follow LocalAI_API"/>
|
||
</a>
|
||
<a href="https://discord.gg/uJAeKSAGDy" target="blank">
|
||
<img src="https://dcbadge.vercel.app/api/server/uJAeKSAGDy?style=flat-square&theme=default-inverted" alt="Join LocalAI Discord Community"/>
|
||
</a>
|
||
|
||
<p align="center"><b>Connect with the Creator </b></p>
|
||
|
||
<p align="center">
|
||
<a href="https://twitter.com/mudler_it" target="blank">
|
||
<img src="https://img.shields.io/twitter/follow/mudler_it?label=Follow: mudler_it&style=social" alt="Follow mudler_it"/>
|
||
</a>
|
||
<a href='https://github.com/mudler'>
|
||
<img alt="Follow on Github" src="https://img.shields.io/badge/Follow-mudler-black?logo=github&link=https%3A%2F%2Fgithub.com%2Fmudler">
|
||
</a>
|
||
</p>
|
||
|
||
<p align="center"><b>Share LocalAI Repository</b></p>
|
||
|
||
<p align="center">
|
||
|
||
<a href="https://twitter.com/intent/tweet?text=Check%20this%20GitHub%20repository%20out.%20LocalAI%20-%20Let%27s%20you%20easily%20run%20LLM%20locally.&url=https://github.com/go-skynet/LocalAI&hashtags=LocalAI,AI" target="blank">
|
||
<img src="https://img.shields.io/twitter/follow/_LocalAI?label=Share Repo on Twitter&style=social" alt="Follow _LocalAI"/></a>
|
||
<a href="https://t.me/share/url?text=Check%20this%20GitHub%20repository%20out.%20LocalAI%20-%20Let%27s%20you%20easily%20run%20LLM%20locally.&url=https://github.com/go-skynet/LocalAI" target="_blank"><img src="https://img.shields.io/twitter/url?label=Telegram&logo=Telegram&style=social&url=https://github.com/go-skynet/LocalAI" alt="Share on Telegram"/></a>
|
||
<a href="https://api.whatsapp.com/send?text=Check%20this%20GitHub%20repository%20out.%20LocalAI%20-%20Let%27s%20you%20easily%20run%20LLM%20locally.%20https://github.com/go-skynet/LocalAI"><img src="https://img.shields.io/twitter/url?label=whatsapp&logo=whatsapp&style=social&url=https://github.com/go-skynet/LocalAI" /></a> <a href="https://www.reddit.com/submit?url=https://github.com/go-skynet/LocalAI&title=Check%20this%20GitHub%20repository%20out.%20LocalAI%20-%20Let%27s%20you%20easily%20run%20LLM%20locally.
|
||
" target="blank">
|
||
<img src="https://img.shields.io/twitter/url?label=Reddit&logo=Reddit&style=social&url=https://github.com/go-skynet/LocalAI" alt="Share on Reddit"/>
|
||
</a> <a href="mailto:?subject=Check%20this%20GitHub%20repository%20out.%20LocalAI%20-%20Let%27s%20you%20easily%20run%20LLM%20locally.%3A%0Ahttps://github.com/go-skynet/LocalAI" target="_blank"><img src="https://img.shields.io/twitter/url?label=Gmail&logo=Gmail&style=social&url=https://github.com/go-skynet/LocalAI"/></a> <a href="https://www.buymeacoffee.com/mudler" target="_blank"><img src="https://cdn.buymeacoffee.com/buttons/default-orange.png" alt="Buy Me A Coffee" height="23" width="100" style="border-radius:1px"></a>
|
||
|
||
</p>
|
||
|
||
## 💻 [Getting started](https://localai.io/basics/getting_started/index.html)
|
||
|
||
## 🔥🔥 Hot topics / Roadmap
|
||
|
||
[Roadmap](https://github.com/mudler/LocalAI/issues?q=is%3Aissue+is%3Aopen+label%3Aroadmap)
|
||
|
||
🆕 New! [LLM finetuning guide](https://localai.io/advanced/fine-tuning/)
|
||
|
||
Hot topics (looking for contributors):
|
||
- Backends v2: https://github.com/mudler/LocalAI/issues/1126
|
||
- Improving UX v2: https://github.com/mudler/LocalAI/issues/1373
|
||
|
||
If you want to help and contribute, issues up for grabs: https://github.com/mudler/LocalAI/issues?q=is%3Aissue+is%3Aopen+label%3A%22up+for+grabs%22
|
||
|
||
|
||
|
||
<hr>
|
||
|
||
In a nutshell:
|
||
|
||
- Local, OpenAI drop-in alternative REST API. You own your data.
|
||
- NO GPU required. NO Internet access is required either
|
||
- Optional, GPU Acceleration is available in `llama.cpp`-compatible LLMs. See also the [build section](https://localai.io/basics/build/index.html).
|
||
- Supports multiple models
|
||
- 🏃 Once loaded the first time, it keep models loaded in memory for faster inference
|
||
- ⚡ Doesn't shell-out, but uses C++ bindings for a faster inference and better performance.
|
||
|
||
LocalAI was created by [Ettore Di Giacinto](https://github.com/mudler/) and is a community-driven project, focused on making the AI accessible to anyone. Any contribution, feedback and PR is welcome!
|
||
|
||
Note that this started just as a [fun weekend project](https://localai.io/#backstory) in order to try to create the necessary pieces for a full AI assistant like `ChatGPT`: the community is growing fast and we are working hard to make it better and more stable. If you want to help, please consider contributing (see below)!
|
||
|
||
## 🚀 [Features](https://localai.io/features/)
|
||
|
||
- 📖 [Text generation with GPTs](https://localai.io/features/text-generation/) (`llama.cpp`, `gpt4all.cpp`, ... [:book: and more](https://localai.io/model-compatibility/index.html#model-compatibility-table))
|
||
- 🗣 [Text to Audio](https://localai.io/features/text-to-audio/)
|
||
- 🔈 [Audio to Text](https://localai.io/features/audio-to-text/) (Audio transcription with `whisper.cpp`)
|
||
- 🎨 [Image generation with stable diffusion](https://localai.io/features/image-generation)
|
||
- 🔥 [OpenAI functions](https://localai.io/features/openai-functions/) 🆕
|
||
- 🧠 [Embeddings generation for vector databases](https://localai.io/features/embeddings/)
|
||
- ✍️ [Constrained grammars](https://localai.io/features/constrained_grammars/)
|
||
- 🖼️ [Download Models directly from Huggingface ](https://localai.io/models/)
|
||
- 🆕 [Vision API](https://localai.io/features/gpt-vision/)
|
||
|
||
## 💻 Usage
|
||
|
||
Check out the [Getting started](https://localai.io/basics/getting_started/index.html) section in our documentation.
|
||
|
||
### 🔗 Community and integrations
|
||
|
||
WebUIs:
|
||
- https://github.com/Jirubizu/localai-admin
|
||
- https://github.com/go-skynet/LocalAI-frontend
|
||
|
||
Model galleries
|
||
- https://github.com/go-skynet/model-gallery
|
||
|
||
Other:
|
||
- Helm chart https://github.com/go-skynet/helm-charts
|
||
|
||
### 🔗 Resources
|
||
|
||
- 🆕 New! [LLM finetuning guide](https://localai.io/advanced/fine-tuning/)
|
||
- [How to build locally](https://localai.io/basics/build/index.html)
|
||
- [How to install in Kubernetes](https://localai.io/basics/getting_started/index.html#run-localai-in-kubernetes)
|
||
- [Projects integrating LocalAI](https://localai.io/integrations/)
|
||
- [How tos section](https://localai.io/howtos/) (curated by our community)
|
||
|
||
## :book: 🎥 [Media, Blogs, Social](https://localai.io/basics/news/#media-blogs-social)
|
||
|
||
- [Create a slackbot for teams and OSS projects that answer to documentation](https://mudler.pm/posts/smart-slackbot-for-teams/)
|
||
- [LocalAI meets k8sgpt](https://www.youtube.com/watch?v=PKrDNuJ_dfE)
|
||
- [Question Answering on Documents locally with LangChain, LocalAI, Chroma, and GPT4All](https://mudler.pm/posts/localai-question-answering/)
|
||
- [Tutorial to use k8sgpt with LocalAI](https://medium.com/@tyler_97636/k8sgpt-localai-unlock-kubernetes-superpowers-for-free-584790de9b65)
|
||
|
||
## Citation
|
||
|
||
If you utilize this repository, data in a downstream project, please consider citing it with:
|
||
|
||
```
|
||
@misc{localai,
|
||
author = {Ettore Di Giacinto},
|
||
title = {LocalAI: The free, Open source OpenAI alternative},
|
||
year = {2023},
|
||
publisher = {GitHub},
|
||
journal = {GitHub repository},
|
||
howpublished = {\url{https://github.com/go-skynet/LocalAI}},
|
||
```
|
||
|
||
## ❤️ Sponsors
|
||
|
||
> Do you find LocalAI useful?
|
||
|
||
Support the project by becoming [a backer or sponsor](https://github.com/sponsors/mudler). Your logo will show up here with a link to your website.
|
||
|
||
A huge thank you to our generous sponsors who support this project:
|
||
|
||
|  |
|
||
|:-----------------------------------------------:|
|
||
| [Spectro Cloud](https://www.spectrocloud.com/) |
|
||
| Spectro Cloud kindly supports LocalAI by providing GPU and computing resources to run tests on lamdalabs! |
|
||
|
||
And a huge shout-out to individuals sponsoring the project by donating hardware or backing the project.
|
||
|
||
- [Sponsor list](https://github.com/sponsors/mudler)
|
||
- JDAM00 (donating HW for the CI)
|
||
|
||
## 🌟 Star history
|
||
|
||
[](https://star-history.com/#go-skynet/LocalAI&Date)
|
||
|
||
## 📖 License
|
||
|
||
LocalAI is a community-driven project created by [Ettore Di Giacinto](https://github.com/mudler/).
|
||
|
||
MIT - Author Ettore Di Giacinto
|
||
|
||
## 🙇 Acknowledgements
|
||
|
||
LocalAI couldn't have been built without the help of great software already available from the community. Thank you!
|
||
|
||
- [llama.cpp](https://github.com/ggerganov/llama.cpp)
|
||
- https://github.com/tatsu-lab/stanford_alpaca
|
||
- https://github.com/cornelk/llama-go for the initial ideas
|
||
- https://github.com/antimatter15/alpaca.cpp
|
||
- https://github.com/EdVince/Stable-Diffusion-NCNN
|
||
- https://github.com/ggerganov/whisper.cpp
|
||
- https://github.com/saharNooby/rwkv.cpp
|
||
- https://github.com/rhasspy/piper
|
||
- https://github.com/cmp-nct/ggllm.cpp
|
||
|
||
## 🤗 Contributors
|
||
|
||
This is a community project, a special thanks to our contributors! 🤗
|
||
<a href="https://github.com/go-skynet/LocalAI/graphs/contributors">
|
||
<img src="https://contrib.rocks/image?repo=go-skynet/LocalAI" />
|
||
</a>
|