lollms/examples/lollms_playground/README.md
2023-06-19 10:27:18 +02:00

3.8 KiB

LoLLMs Playground

Logo

GitHub license GitHub issues GitHub stars GitHub forks Discord Follow me on Twitter Follow Me on YouTube pages-build-deployment

This tool provides a web-based interface to test LoLLMs endpoints and generate text using a LoLLMs server.

Prerequisites

To use this tool, you need to have Node.js installed on your machine.

Installation

  1. Clone this repository or download the source code.

    git clone https://github.com/ParisNeo/lollms-playground.git
    
  2. Navigate to the project directory (if you are not yet inside that directory).

    cd lollms-playground
    
  3. Install the dependencies.

    npm install http-server
    

Usage

  1. Start the LoLLMs server. You can use lollms-server to run the server with the desired configuration. Here are a few examples:

    • To run the server on localhost and port 9600:

      lollms-server --host localhost --port 9600
      
    • To run the server on a different host and port:

      lollms-server --host mydomain.com --port 8080
      
    • For more information on the available options, you can use the --help flag:

      lollms-server --help
      
  2. Start the web server for the LoLLMs Endpoint Test Tool.

    http-server
    
  3. Open your web browser and visit http://localhost:8080 (or the appropriate URL) to access the LoLLMs Endpoint Test Tool. image

  4. Press the icon to get to the connection ui. image

  5. Fill in the host and port fields with the appropriate values for your LoLLMs server.

  6. Click the "Connect" button to establish a connection with the LoLLMs server. image

  7. Once connected, you can enter a prompt and click the "Generate Text" button to initiate text generation. image

  8. The generated text will be displayed in the output section of the page. image image

Customization

You can customize the appearance and behavior of the tool by modifying the HTML, CSS, and JavaScript code in the test_generation.html file.

Contributing

Contributions are welcome! If you find any issues or want to add new features, feel free to open an issue or submit a pull request.

License

This project is licensed under the Apache 2.0.