2023-06-10 14:15:19 +00:00
# LoLLMS Web UI
2023-07-11 20:00:59 +00:00
< div align = "center" >
< img src = "https://github.com/ParisNeo/lollms/blob/main/lollms/assets/logo.png" alt = "Logo" width = "200" height = "200" >
< / div >
2023-04-06 19:12:49 +00:00
2023-06-10 14:15:54 +00:00
2023-04-20 17:50:47 +00:00
[](https://discord.gg/4rR282WJb6)
2023-05-05 07:32:56 +00:00
[](https://twitter.com/SpaceNerduino)
2023-05-05 07:43:23 +00:00
[](https://www.youtube.com/user/Parisneo)
2023-06-18 08:43:04 +00:00
[](https://github.com/ParisNeo/lollms-webui/actions/workflows/pages/pages-build-deployment)
2023-06-20 06:50:22 +00:00
2023-06-10 14:15:19 +00:00
Welcome to LoLLMS WebUI (Lord of Large Language Models: One tool to rule them all), the hub for LLM (Large Language Model) models. This project aims to provide a user-friendly interface to access and utilize various LLM models for a wide range of tasks. Whether you need help with writing, coding, organizing data, generating images, or seeking answers to your questions, LoLLMS WebUI has got you covered.
2023-05-26 23:00:40 +00:00
2023-07-11 19:48:23 +00:00
[Click here for my youtube video on how to use the tool ]([https://youtu.be/ds_U0TDzbzI](https://youtu.be/MxXNGv1zJ1A ))
2023-05-26 23:00:40 +00:00
## Features
- Choose your preferred binding, model, and personality for your tasks
- Enhance your emails, essays, code debugging, thought organization, and more
- Explore a wide range of functionalities, such as searching, data organization, and image generation
- Easy-to-use UI with light and dark mode options
- Integration with GitHub repository for easy access
- Support for different personalities with predefined welcome messages
- Thumb up/down rating for generated answers
- Copy, edit, and remove messages
- Local database storage for your discussions
- Search, export, and delete multiple discussions
- Support for Docker, conda, and manual virtual environment setups
2023-07-11 19:48:23 +00:00
## Screenshots
Main page
2023-07-11 19:58:37 +00:00
Settings page
Hardware status
Support for most known bindings
Huge and updated models zoo for each binding type
Models search options
Custom models installation
2023-07-11 20:33:15 +00:00
Huge personalities library (about 300 personalities split in 36 categories)
Personalities search option
Personalities bag where you can activate simultaniously multiple personalities
Multiple personalities discussions
2023-07-11 20:56:56 +00:00
Hot personality selection
2023-07-11 20:33:15 +00:00
2023-07-11 19:48:23 +00:00
Artbot
Lollms personality maker
2023-07-11 20:33:15 +00:00
Chat with docs with commands like send file and set database
2023-07-11 19:58:37 +00:00
2023-07-11 19:48:23 +00:00
Python Specialist
2023-07-11 21:11:23 +00:00
2023-07-11 19:58:37 +00:00
2023-07-11 19:48:23 +00:00
2023-05-26 23:00:40 +00:00
## Installation
### Prerequisites
2023-06-10 14:15:19 +00:00
Before installing LoLLMS WebUI, make sure you have the following dependencies installed:
2023-05-26 23:00:40 +00:00
2023-06-24 12:09:25 +00:00
- [Python 3.10 or higher ](https://www.python.org/downloads/release/python-3100/ )
- Pip - installation depends on OS, but make sure you have it installed.
- [Git (for cloning the repository) ](https://git-scm.com/downloads )
- [Visual Studio Community ](https://visualstudio.microsoft.com/vs/community/ ) with c++ build tools (for CUDA [nvidia GPU's]) - optional for windows
- Build essentials (for CUDA [nvidia GPU's]) - optional for linux
- [Nvidia CUDA toolkit 11.7 or higher ](https://developer.nvidia.com/cuda-downloads ) (for CUDA [nvidia GPU's]) - optional
- [Miniconda3 ](https://docs.conda.io/en/latest/miniconda.html ) - optional (more stable than python)
2023-05-26 23:00:40 +00:00
Ensure that the Python installation is in your system's PATH, and you can call it from the terminal. To verify your Python version, run the following command:
2023-06-24 12:09:25 +00:00
Windows:
2023-05-26 23:00:40 +00:00
```bash
python --version
```
2023-06-24 12:09:25 +00:00
Linux:
```bash
python3 --version
```
2023-05-26 23:00:40 +00:00
If you receive an error or the version is lower than 3.10, please install a newer version and try again.
### Installation steps
2023-06-24 12:09:25 +00:00
For detailed installation steps please refer to these documents:
- [Windows 10/11 ](./docs/usage/AdvancedInstallInstructions.md#windows-10-and-11 )
- [Linux (tested on ubuntu) ](./docs/usage/AdvancedInstallInstructions.md#linux )
2023-05-26 23:00:40 +00:00
#### Easy install
2023-05-27 07:29:30 +00:00
- Download the appropriate application launcher based on your platform:
2023-05-26 23:00:40 +00:00
For Windows: `webui.bat`
For Linux: `webui.sh`
2023-06-24 12:09:25 +00:00
For Linux: `c_webui.sh` - using miniconda3
2023-05-27 07:29:30 +00:00
- Place the downloaded launcher in a folder of your choice, for example:
2023-06-10 14:15:19 +00:00
Windows: `C:\ai\LoLLMS-webui`
Linux: `/home/user/ai/LoLLMS-webui`
2023-05-27 07:29:30 +00:00
- Run the launcher script. Note that you might encounter warnings from antivirus or Windows Defender due to the tool's newness and limited usage. These warnings are false positives caused by reputation conditions in some antivirus software. You can safely proceed with running the script.
2023-06-10 14:15:19 +00:00
Once the installation is complete, the LoLLMS WebUI will launch automatically.
2023-05-26 23:00:40 +00:00
#### Using Conda
If you use conda, you can create a virtual environment and install the required packages using the provided `requirements.txt` file. Here's an example of how to set it up:
First clone the project or download the zip file and unzip it:
```bash
2023-06-08 06:58:02 +00:00
git clone https://github.com/ParisNeo/lollms-webui.git
cd lollms-webui
2023-05-26 23:00:40 +00:00
```
Now create a new conda environment, activate it and install requirements
2023-08-27 17:21:44 +00:00
With cuda support (GPU mode):
2023-05-26 23:00:40 +00:00
```bash
2023-08-27 17:21:44 +00:00
conda create --prefix ./env python=3.10 cuda-toolkit ninja git
2023-06-24 12:09:25 +00:00
conda activate ./env
2023-05-26 23:00:40 +00:00
pip install -r requirements.txt
```
2023-08-27 17:21:44 +00:00
Without cuda support (CPU mode):
```bash
conda create --prefix ./env python=3.10 ninja git
conda activate ./env
pip install -r requirements.txt
```
You should create an empty file called `.no_gpu` in the folder in order to prevent lollms from trying to use GPU.
2023-05-26 23:00:40 +00:00
#### Using Docker
2023-06-10 14:15:19 +00:00
Alternatively, you can use Docker to set up the LoLLMS WebUI. Please refer to the Docker documentation for installation instructions specific to your operating system.
2023-05-26 23:00:40 +00:00
## Usage
You can launch the app from the webui.sh or webui.bat launcher. It will automatically perform updates if any are present. If you don't prefer this method, you can also activate the virtual environment and launch the application using python app.py from the root of the project.
Once the app is running, you can go to the application front link displayed in the console (by default localhost:9600 but can change if you change configuration)
### Selecting a Model and Binding
2023-06-10 14:15:19 +00:00
- Open the LoLLMS WebUI and navigate to the Settings page.
2023-05-27 07:29:30 +00:00
- In the Models Zoo tab, select a binding from the list (e.g., llama-cpp-official).
- Wait for the installation process to finish. You can monitor the progress in the console.
- Once the installation is complete, click the Install button next to the desired model.
- After the model installation finishes, select the model and press Apply changes.
- Remember to press the Save button to save the configuration.
2023-05-26 23:00:40 +00:00
### Starting a Discussion
2023-05-27 07:29:30 +00:00
- Go to the Discussions view.
- Click the + button to create a new discussion.
2023-06-10 14:15:19 +00:00
- You will see a predefined welcome message based on the selected personality (by default, LoLLMS).
2023-05-27 07:29:30 +00:00
- Ask a question or provide an initial prompt to start the discussion.
- You can stop the generation process at any time by pressing the Stop Generating button.
2023-05-26 23:00:40 +00:00
### Managing Discussions
2023-05-27 07:29:30 +00:00
- To edit a discussion title, simply type a new title or modify the existing one.
- To delete a discussion, click the Delete button.
- To search for specific discussions, use the search button and enter relevant keywords.
- To perform batch operations (exporting or deleting multiple discussions), enable Check Mode, select the discussions, and choose the desired action.
2023-05-26 23:00:40 +00:00
# Contributing
2023-06-10 14:15:19 +00:00
Contributions to LoLLMS WebUI are welcome! If you encounter any issues, have ideas for improvements, or want to contribute code, please open an issue or submit a pull request on the GitHub repository.
2023-04-06 19:12:49 +00:00
2023-04-15 11:17:02 +00:00
# License
2023-06-08 06:58:02 +00:00
This project is licensed under the Apache 2.0 License. You are free to use this software commercially, build upon it, and integrate it into your own projects. See the [LICENSE ](https://github.com/ParisNeo/lollms-webui/blob/main/LICENSE ) file for details.
2023-05-26 23:00:40 +00:00
# Acknowledgements
2023-06-10 14:15:19 +00:00
Please note that LoLLMS WebUI is not affiliated with the LoLLMS application developed by Nomic AI. The latter is a separate professional application available at LoLLMS.io, which has its own unique features and community.
2023-05-26 23:00:40 +00:00
We express our gratitude to all the contributors who have made this project possible and welcome additional contributions to further enhance the tool for the benefit of all users.
# Contact
For any questions or inquiries, feel free to reach out via our discord server: https://discord.gg/4rR282WJb6
Thank you for your interest and support!
2023-06-10 14:15:19 +00:00
If you find this tool useful, don't forget to give it a star on GitHub, share your experience, and help us spread the word. Your feedback and bug reports are valuable to us as we continue developing and improving LoLLMS WebUI.
2023-05-26 23:00:40 +00:00
If you enjoyed this tutorial, consider subscribing to our YouTube channel for more updates, tutorials, and exciting content.
2023-04-06 19:12:49 +00:00
2023-06-10 14:15:19 +00:00
Happy exploring with LoLLMS WebUI!
