mirror of
https://github.com/ParisNeo/lollms-webui.git
synced 2024-12-22 13:52:21 +00:00
120 lines
10 KiB
Markdown
120 lines
10 KiB
Markdown
# LoLLMs (Lord of Large Language Multimodal Systems) Web UI
|
|
<div align="center">
|
|
<img src="https://github.com/ParisNeo/lollms/blob/main/lollms/assets/logo.png" alt="Logo" width="200" height="200">
|
|
</div>
|
|
|
|
|
|
|
|
|
|
|
|
[](https://discord.gg/4rR282WJb6)
|
|
[](https://twitter.com/ParisNeo_AI)
|
|
[](https://www.youtube.com/user/Parisneo)
|
|
|
|
## LoLLMs core library download statistics
|
|
[](https://pepy.tech/project/lollms)
|
|
[](https://pepy.tech/project/lollms)
|
|
[](https://pepy.tech/project/lollms)
|
|
|
|
## LoLLMs webui download statistics
|
|
[](https://github.com/ParisNeo/lollms-webui/releases)
|
|
[](https://github.com/ParisNeo/lollms-webui/releases)
|
|
|
|
|
|
Welcome to LoLLMS WebUI (Lord of Large Language Multimodal Systems: One tool to rule them all), the hub for LLM (Large Language Models) and multimodal intelligence systems. This project aims to provide a user-friendly interface to access and utilize various LLM and other AI models for a wide range of tasks. Whether you need help with writing, coding, organizing data, analyzing images, generating images, generating music or seeking answers to your questions, LoLLMS WebUI has got you covered.
|
|
|
|
As an all-encompassing tool with access to over 500 AI expert conditionning across diverse domains and more than 2500 fine tuned models over multiple domains, you now have an immediate resource for any problem. Whether your car needs repair or if you need coding assistance in Python, C++ or JavaScript; feeling down about life decisions that were made wrongly yet unable see how? Ask Lollms. Need guidance on what lies ahead healthwise based on current symptoms presented, our medical assistance AI can help you get a potential diagnosis and guide you to seek the right medical care. If stuck with legal matters such contract interpretation feel free reach out to Lawyer personality, to get some insight at hand -all without leaving comfort home. Not only does it aid students struggling through those lengthy lectors but provides them extra support during assessments too, so they are able grasp concepts properly rather then just reading along lines which could leave many confused afterward. Want some entertainment? Then engage Laughter Botand let yourself go enjoy hysterical laughs until tears roll from eyes while playing Dungeons&Dragonsor make up crazy stories together thanks to Creative Story Generator. Need illustration work done? No worries, Artbot got us covered there! And last but definitely not least LordOfMusic here for music generation according to individual specifications. So essentially say goodbye boring nights alone because everything possible can be achieved within one single platform called Lollms...
|
|
|
|
## Features
|
|
|
|
- Choose your preferred binding, model, and personality for your tasks
|
|
- Enhance your emails, essays, code debugging, thought organization, and more
|
|
- Explore a wide range of functionalities, such as searching, data organization, image generation, and music generation
|
|
- Easy-to-use UI with light and dark mode options
|
|
- Integration with GitHub repository for easy access
|
|
- Support for different personalities with predefined welcome messages
|
|
- Thumb up/down rating for generated answers
|
|
- Copy, edit, and remove messages
|
|
- Local database storage for your discussions
|
|
- Search, export, and delete multiple discussions
|
|
- Support for image/video generation based on stable diffusion
|
|
- Support for music generation based on musicgen
|
|
- Support for multi generation peer to peer network through Lollms Nodes and Petals.
|
|
- Support for Docker, conda, and manual virtual environment setups
|
|
- Support for LM Studio as a backend
|
|
- Support for Ollama as a backend
|
|
- Support for vllm as a backend
|
|
|
|
## Star History
|
|
|
|
<a href="https://star-history.com/#ParisNeo/lollms-webui&ParisNeo/lollms&ParisNeo/lollms_cpp_client&ParisNeo/lollms_bindings_zoo&ParisNeo/lollms_personalities_zoo&Date">
|
|
<picture>
|
|
<source media="(prefers-color-scheme: dark)" srcset="https://api.star-history.com/svg?repos=ParisNeo/lollms-webui,ParisNeo/lollms,ParisNeo/lollms_cpp_client,ParisNeo/lollms_bindings_zoo,ParisNeo/lollms_personalities_zoo&type=Date&theme=dark" />
|
|
<source media="(prefers-color-scheme: light)" srcset="https://api.star-history.com/svg?repos=ParisNeo/lollms-webui,ParisNeo/lollms,ParisNeo/lollms_cpp_client,ParisNeo/lollms_bindings_zoo,ParisNeo/lollms_personalities_zoo&type=Date" />
|
|
<img alt="Star History Chart" src="https://api.star-history.com/svg?repos=ParisNeo/lollms-webui,ParisNeo/lollms,ParisNeo/lollms_cpp_client,ParisNeo/lollms_bindings_zoo,ParisNeo/lollms_personalities_zoo&type=Date" />
|
|
</picture>
|
|
</a>
|
|
|
|
Thank you for all users who tested this tool and helped making it more user friendly.
|
|
|
|
## Installation
|
|
### Automatic installation (UI)
|
|
If you are using Windows, just visit the release page, download the windows installer and install it.
|
|
|
|
### Automatic installation (Console)
|
|
Download the installation script from scripts folder and run it.
|
|
The installation scripts are:
|
|
- `win_install.bat` for Windows.
|
|
- `linux_install.sh`for Linux.
|
|
- `mac_install.sh`for Mac.
|
|
|
|
### Manual install:
|
|
Since v 9.4, it is not advised to do manual install as many services require the creation of a separate environment and lollms needs to have complete control on the environments. So If you install it using your own conda setup, you will not be able to install any service and reduce the use of lollms to the chat interface (no xtts, no comfyui, no fast generation through vllm or petals or soever)
|
|
|
|
# Code of conduct
|
|
|
|
By using this tool, users agree to follow these guidelines :
|
|
- This tool is not meant to be used for building and spreading fakenews / misinformation.
|
|
- You are responsible for what you generate by using this tool. The creators will take no responsibility for anything created via this lollms.
|
|
- You can use lollms in your own project free of charge if you agree to respect the Apache 2.0 licenseterms. Please refer to https://www.apache.org/licenses/LICENSE-2.0 .
|
|
- You are not allowed to use lollms to harm others directly or indirectly. This tool is meant for peacefull purposes and should be used for good never for bad.
|
|
- Users must comply with local laws when accessing content provided by third parties like OpenAI API etc., including copyright restrictions where applicable.
|
|
|
|
# ⚠️ Security Warning
|
|
|
|
Please be aware that LoLLMs WebUI does not have built-in user authentication and is primarily designed for local use. Exposing the WebUI to external access without proper security measures could lead to potential vulnerabilities.
|
|
|
|
If you require remote access to LoLLMs, it is strongly recommended to follow these security guidelines:
|
|
|
|
1. **Activate Headless Mode**: Enabling headless mode will expose only the generation API while turning off other potentially vulnerable endpoints. This helps to minimize the attack surface.
|
|
|
|
2. **Set Up a Secure Tunnel**: Establish a secure tunnel between the localhost running LoLLMs and the remote PC that needs access. This ensures that the communication between the two devices is encrypted and protected.
|
|
|
|
3. **Modify Configuration Settings**: After setting up the secure tunnel, edit the `/configs/local_config.yaml` file and adjust the following settings:
|
|
```yaml
|
|
host: 0.0.0.0 # Allow remote connections
|
|
port: 9600 # Change the port number if desired (default is 9600)
|
|
force_accept_remote_access: true # Force accepting remote connections
|
|
headless_server_mode: true # Set to true for API-only access, or false if the WebUI is needed
|
|
```
|
|
|
|
By following these security practices, you can help protect your LoLLMs instance and its users from potential security risks when enabling remote access.
|
|
|
|
Remember, it is crucial to prioritize security and take necessary precautions to safeguard your system and sensitive information. If you have any further questions or concerns regarding the security of LoLLMs, please consult the documentation or reach out to the community for assistance.
|
|
|
|
Stay safe and enjoy using LoLLMs responsibly!
|
|
|
|
|
|
# Disclaimer
|
|
Large Language Models are amazing tools that can be used for diverse purposes. Lollms was built to harness this power to help the user inhance its productivity. But you need to keep in mind that these models have their limitations and should not replace human intelligence or creativity, but rather augment it by providing suggestions based on patterns found within large amounts of data. It is up to each individual how they choose use them responsibly!
|
|
|
|
The performance of the system varies depending on the used model, its size and the dataset on whichit has been trained. The larger a language model's training set (the more examples), generally speaking - better results will follow when using such systems as opposed those with smaller ones. But there is still no garantee that the output generated from any given prompt would always be perfect and it may contain errors due various reasons. So please make sure you do not use it for serious matters like choosing medications or making financial decisions without consultating an expert first hand !
|
|
|
|
# license
|
|
This repository uses code under ApacheLicense Version 2.0 , see [license](https://github.com/ParisNeo/lollms-webui/blob/main/LICENSE) file for details about rights granted with respect to usage & distribution
|
|
|
|
# Copyright:
|
|
ParisNeo 2023
|
|
|
|
|