🤖 The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference
Go to file
Ettore Di Giacinto 710b195be1
Update README.md
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
2023-12-02 08:55:26 +01:00
.github ci: rename workflow 2023-11-30 19:25:33 +01:00
.vscode feat: Add more test-cases and remove dev container () 2023-05-30 13:01:55 +02:00
api feat: initial watchdog implementation () 2023-11-26 18:36:23 +01:00
backend fix/docs: Python backend dependencies () 2023-11-30 17:46:55 +01:00
custom-ca-certs feat(certificates): add support for custom CA certificates () 2023-11-01 20:10:14 +01:00
docs Update fine-tuning.md 2023-12-02 08:54:21 +01:00
examples Update README.md 2023-12-02 08:55:26 +01:00
internal feat: cleanups, small enhancements 2023-07-04 18:58:19 +02:00
metrics feat(metrics): Adding initial support for prometheus metrics () 2023-10-17 18:22:53 +02:00
models Add docker-compose 2023-04-13 01:13:14 +02:00
pkg feat: initial watchdog implementation () 2023-11-26 18:36:23 +01:00
prompt-templates Requested Changes from GPT4ALL to Luna-AI-Llama2 () 2023-09-22 11:22:17 +02:00
tests ci: add GPU tests () 2023-10-19 13:50:40 +02:00
.dockerignore Remove .git from .dockerignore 2023-07-06 21:25:10 +02:00
.env feat: initial watchdog implementation () 2023-11-26 18:36:23 +01:00
.gitattributes Create .gitattributes to force git clone to keep the LF line endings on .sh files () 2023-07-30 15:27:43 +02:00
.gitignore refactor: rename llama-stable to llama-ggml () 2023-11-18 08:18:43 +01:00
.gitmodules docs: Initial import from localai-website () 2023-11-22 18:13:50 +01:00
assets.go feat: Update gpt4all, support multiple implementations in runtime () 2023-06-01 23:38:52 +02:00
CONTRIBUTING.md Add the CONTRIBUTING.md () 2023-09-24 14:54:55 +02:00
docker-compose.yaml fix: update docker-compose.yaml () 2023-10-05 22:13:18 +02:00
Dockerfile feat(petals): add backend () 2023-11-28 09:01:46 +01:00
Earthfile Rename project to LocalAI () 2023-04-19 18:43:10 +02:00
Entitlements.plist Feat: OSX Local Codesigning () 2023-11-23 15:22:54 +01:00
entrypoint.sh deps(go-piper): update to 2023.11.6-3 () 2023-11-11 18:40:26 +01:00
go.mod fix(deps): update module github.com/onsi/gomega to v1.28.1 () 2023-10-24 09:16:02 +02:00
go.sum fix(deps): update module github.com/onsi/gomega to v1.28.1 () 2023-10-24 09:16:02 +02:00
LICENSE docs: update docs/license(clarification) and point to new website () 2023-05-29 23:09:19 +02:00
main.go feat: initial watchdog implementation () 2023-11-26 18:36:23 +01:00
Makefile ⬆️ Update ggerganov/llama.cpp () 2023-12-02 00:09:48 +00:00
README.md Update README.md 2023-12-01 20:05:58 +01:00
renovate.json ci: manually update deps 2023-05-04 15:01:29 +02:00



LocalAI

LocalAI forks LocalAI stars LocalAI pull-requests

💡 Get help - FAQ 💭Discussions 💬 Discord 📖 Documentation website

💻 Quickstart 📣 News 🛫 Examples 🖼️ Models 🚀 Roadmap

testsBuild and Releasebuild container imagesBump dependenciesArtifact Hub

LocalAI is the free, Open Source OpenAI alternative. LocalAI act as a drop-in replacement REST API thats compatible with OpenAI API specifications for local inferencing. It allows you to run LLMs, generate images, audio (and not only) locally or on-prem with consumer grade hardware, supporting multiple model families. Does not require GPU.

Follow LocalAI

Follow LocalAI_API Join LocalAI Discord Community

Connect with the Creator

Follow mudler_it Follow on Github

Share LocalAI Repository

Follow _LocalAI Share on Telegram Share on Reddit Buy Me A Coffee

💻 Getting started

🔥🔥 Hot topics / Roadmap

Roadmap

🆕 New! LLM finetuning guide

Hot topics (looking for contributors):

If you want to help and contribute, issues up for grabs: https://github.com/mudler/LocalAI/issues?q=is%3Aissue+is%3Aopen+label%3A%22up+for+grabs%22


In a nutshell:

  • Local, OpenAI drop-in alternative REST API. You own your data.
  • NO GPU required. NO Internet access is required either
    • Optional, GPU Acceleration is available in llama.cpp-compatible LLMs. See also the build section.
  • Supports multiple models
  • 🏃 Once loaded the first time, it keep models loaded in memory for faster inference
  • Doesn't shell-out, but uses C++ bindings for a faster inference and better performance.

LocalAI was created by Ettore Di Giacinto and is a community-driven project, focused on making the AI accessible to anyone. Any contribution, feedback and PR is welcome!

Note that this started just as a fun weekend project in order to try to create the necessary pieces for a full AI assistant like ChatGPT: the community is growing fast and we are working hard to make it better and more stable. If you want to help, please consider contributing (see below)!

🚀 Features

💻 Usage

Check out the Getting started section in our documentation.

🔗 Community and integrations

WebUIs:

Model galleries

Other:

🔗 Resources

📖 🎥 Media, Blogs, Social

Citation

If you utilize this repository, data in a downstream project, please consider citing it with:

@misc{localai,
  author = {Ettore Di Giacinto},
  title = {LocalAI: The free, Open source OpenAI alternative},
  year = {2023},
  publisher = {GitHub},
  journal = {GitHub repository},
  howpublished = {\url{https://github.com/go-skynet/LocalAI}},

❤️ Sponsors

Do you find LocalAI useful?

Support the project by becoming a backer or sponsor. Your logo will show up here with a link to your website.

A huge thank you to our generous sponsors who support this project:

Spectro Cloud logo_600x600px_transparent bg
Spectro Cloud
Spectro Cloud kindly supports LocalAI by providing GPU and computing resources to run tests on lamdalabs!

And a huge shout-out to individuals sponsoring the project by donating hardware or backing the project.

🌟 Star history

LocalAI Star history Chart

📖 License

LocalAI is a community-driven project created by Ettore Di Giacinto.

MIT - Author Ettore Di Giacinto

🙇 Acknowledgements

LocalAI couldn't have been built without the help of great software already available from the community. Thank you!

🤗 Contributors

This is a community project, a special thanks to our contributors! 🤗