18 Commits

Author	SHA1	Message	Date
Gavin Mogan	cbd61dccd4	fix(install.sh): vulkan docker tag (#5589) ... vulkan docker tag is not prefixed with gpu ``` regctl tag ls localai/localai | grep 2.29 | grep vulkan v2.29.0-vulkan ``` Signed-off-by: Gavin Mogan <github@gavinmogan.com>	2025-06-05 08:12:16 +02:00
omahs	0f365ac204	fix: typos (#5376) ... Signed-off-by: omahs <73983677+omahs@users.noreply.github.com>	2025-05-16 12:45:48 +02:00
Ettore Di Giacinto	e52c66c76e	chore(docs/install.sh): image changes (#5354) ... chore(docs): image changes Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-05-14 19:28:30 +02:00
Alessandro Pirastru	69667521e2	fix(install/gpu):Fix docker not being able to leverage the GPU on systems that have SELinux Enforced (#5252) ... * Update installation script for improved compatibility and clarity - Renamed VERSION to LOCALAI_VERSION to avoid conflicts with system variables. - Enhanced NVIDIA and CUDA repository installation for DNF5 compatibility. - Adjusted default Fedora version handling for CUDA installation. - Updated Docker image tag handling to use LOCALAI_VERSION consistently. - Improved logging messages for repository and LocalAI binary downloads. - Added a temporary bypass for nvidia-smi installation on Fedora Cloud Edition. * feat: Add SELinux configuration for NVIDIA GPU support in containers - Introduced `enable_selinux_container_booleans` function to handle SELinux configuration changes for GPU access. - Included user confirmation prompt to enable SELinux `container_use_devices` boolean due to security implications. - Added NVIDIA Container Runtime to Docker runtimes and restarted Docker to ensure proper GPU support. - Applied SELinux adjustments conditionally for Fedora, RHEL, CentOS, Rocky, and openSUSE distributions. Signed-off-by: Alessandro Pirastru <alessandro.pirastru.94@gmail.com> * fix: Correct SELinux boolean parsing and add loop break - Fixed incorrect parsing of `container_use_devices` boolean by changing the awk field from `$2` to `$3` to retrieve the correct value. - Added a `break` statement after enabling the SELinux boolean to prevent unnecessary loop iterations after user prompt. Signed-off-by: Alessandro Pirastru <alessandro.pirastru.94@gmail.com> * fix: typo in install.sh Signed-off-by: Alessandro Pirastru <57262788+Bloodis94@users.noreply.github.com> --------- Signed-off-by: Alessandro Pirastru <alessandro.pirastru.94@gmail.com> Signed-off-by: Alessandro Pirastru <57262788+Bloodis94@users.noreply.github.com>	2025-04-27 16:01:29 +02:00
Alessandro Pirastru	a0244e3fb4	feat(install): added complete process for installing nvidia drivers on fedora without pulling X11 (#5246) ... * Update installation script for improved compatibility and clarity - Renamed VERSION to LOCALAI_VERSION to avoid conflicts with system variables. - Enhanced NVIDIA and CUDA repository installation for DNF5 compatibility. - Adjusted default Fedora version handling for CUDA installation. - Updated Docker image tag handling to use LOCALAI_VERSION consistently. - Improved logging messages for repository and LocalAI binary downloads. - Added a temporary bypass for nvidia-smi installation on Fedora Cloud Edition. * Enhance log functions with ANSI color formatting - Added ANSI escape codes for improved log styling: light blue for info, orange for warnings, and red for errors. - Updated all log functions (`info`, `warn`, `fatal`) to include bold and colored output. Signed-off-by: Alessandro Pirastru <alessandro.pirastru.94@gmail.com> * feat: Enhance log functions with ANSI color formatting - Added ANSI escape codes for improved log styling: light blue for info, orange for warnings, and red for errors. - Updated all log functions (`info`, `warn`, `fatal`) to include bold and colored output. Signed-off-by: Alessandro Pirastru <alessandro.pirastru.94@gmail.com> * chore: ⬆️ Update ggml-org/llama.cpp to `ecda2ec4b347031a9b8a89ee2efc664ce63f599c` (#5238) ⬆️ Update ggml-org/llama.cpp Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <2420543+mudler@users.noreply.github.com> * fix(stablediffusion-ggml): Build with DSD CUDA, HIP and Metal flags (#5236) Signed-off-by: Richard Palethorpe <io@richiejp.com> * feat(install): enhance script with choice functions and logs - Added custom `choice_info`, `choice_warn`, and `choice_fatal` functions for interactive input logging. - Adjusted Docker volume creation message for better clarity. - Included NVIDIA driver check log for improved feedback to users. - Added consistent logging before starting LocalAI Docker containers across configurations. Signed-off-by: Alessandro Pirastru <alessandro.pirastru.94@gmail.com> * feat(install): add Fedora NVIDIA driver installation option - Introduced a new function to install NVIDIA kernel drivers on Fedora using akmod packages. - Added user prompt to choose between installing drivers automatically or exiting for manual setup. - Integrated the new function into the existing Fedora-specific CUDA toolkit installation workflow. Signed-off-by: Alessandro Pirastru <alessandro.pirastru.94@gmail.com> * fix(install): correct repository ID for DNF5 configuration - Update repository ID from 'nome-repo' to 'nvidia-cuda' for DNF5. - Ensures the correct repository name matches expected configuration. - Fix prevents potential misconfiguration during installation process. Signed-off-by: Alessandro Pirastru <alessandro.pirastru.94@gmail.com> * feat(install): enhance NVIDIA driver handling on Fedora - fixed `install_cuda_driver_yum` function call in `install_fedora_nvidia_kernel_drivers` - Added `cuda-toolkit` for Fedora installations, as recommended by RPM Fusion. - Adjusted driver repository commands for compatibility with DNF5. - Improved URL and version handling for package manager installations. Signed-off-by: Alessandro Pirastru <alessandro.pirastru.94@gmail.com> * Refactor NVIDIA driver installation process in install.sh - Removed redundant empty lines for cleaner formatting. - Standardized URL formatting by removing unnecessary quotes around URLs. - Reverted logic by removing Fedora-specific exclusions for cuda-toolkit and using `cuda-drivers` universally. - Refined repository addition for `dnf` by explicitly setting `id` and `name` parameters for clarity and accuracy. - Fixed minor formatting inconsistencies in parameter passing. Signed-off-by: Alessandro Pirastru <alessandro.pirastru.94@gmail.com> * feat: Update NVIDIA module installation warning in install script - Clarified that Akmod installation may inhibit the reboot command. - Added a cautionary note to the warning to inform users of potential risks. Signed-off-by: Alessandro Pirastru <alessandro.pirastru.94@gmail.com> * Update NVIDIA driver installation warning message - Clarify prerequisites by noting the need for rpmfusion free/nonfree repos. - Improve formatting of the warning box for better readability. - Inform users that the script will install missing repos if necessary. Signed-off-by: Alessandro Pirastru <alessandro.pirastru.94@gmail.com> --------- Signed-off-by: Alessandro Pirastru <alessandro.pirastru.94@gmail.com> Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Signed-off-by: Richard Palethorpe <io@richiejp.com> Co-authored-by: LocalAI [bot] <139863280+localai-bot@users.noreply.github.com> Co-authored-by: mudler <2420543+mudler@users.noreply.github.com> Co-authored-by: Richard Palethorpe <io@richiejp.com>	2025-04-26 09:44:40 +02:00
Alessandro Pirastru	1ae0b896fa	fix: installation script compatibility with fedora 41 and later, fedora headless unclear errors (#5239) ... Update installation script for improved compatibility and clarity - Renamed VERSION to LOCALAI_VERSION to avoid conflicts with system variables. - Enhanced NVIDIA and CUDA repository installation for DNF5 compatibility. - Adjusted default Fedora version handling for CUDA installation. - Updated Docker image tag handling to use LOCALAI_VERSION consistently. - Improved logging messages for repository and LocalAI binary downloads. - Added a temporary bypass for nvidia-smi installation on Fedora Cloud Edition.	2025-04-24 09:34:25 +02:00
Ettore Di Giacinto	cc3df759f8	chore(docs): improve installer.sh docs (#5232) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-04-21 22:11:43 +02:00
Ettore Di Giacinto	72693b3917	feat(install.sh): allow to uninstall with --uninstall (#5202) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-04-17 16:32:23 +02:00
Dave	7c4e526853	fix: install.sh bash specific equality check (#3038) ... fix == to = for sh portability Signed-off-by: Dave Lee <dave@gray101.com>	2024-07-29 01:19:36 +02:00
Ettore Di Giacinto	95e31fd279	feat(install.sh): support federated install (#2752) ... * feat(install.sh): support federated install This allows to support federation by exposing: - FEDERATED: true/false to share the instance - FEDERATED_SERVER: true/false to start the federated load balancer (it forwards requests to the federation) Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: update installer parameters Signed-off-by: Ettore Di Giacinto <mudler@localai.io> --------- Signed-off-by: Ettore Di Giacinto <mudler@localai.io> Co-authored-by: Dave <dave@gray101.com>	2024-07-12 08:42:21 +02:00
Ettore Di Giacinto	cca881ec49	feat(p2p): Federation and AI swarms (#2723) ... * Wip p2p enhancements * get online state * Pass-by token to show in the dashboard Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Style * Minor fixups * parametrize SearchID * Refactoring * Allow to expose/bind more services Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Add federation * Display federated mode in the WebUI Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Small fixups Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * make federated nodes visible from the WebUI * Fix version display * improve web page * live page update * visual enhancements * enhancements * visual enhancements --------- Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2024-07-08 22:04:06 +02:00
Ettore Di Giacinto	9e6dec0bc4	fix(install.sh): not all systems have nproc ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2024-06-24 18:21:20 +02:00
Ettore Di Giacinto	69206fcd4b	fix(install.sh): move ARCH detection so it works also for mac (#2646) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2024-06-24 10:34:35 +02:00
Ettore Di Giacinto	2c94e15746	fix(install.sh): fix version typo (#2645) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2024-06-24 10:30:17 +02:00
Ettore Di Giacinto	0f9aa1ef91	fix(install.sh): install CUDA toolkit only if CUDA is detected ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2024-06-22 12:21:59 +02:00
Ettore Di Giacinto	0bc82d7270	fix(install.sh): properly detect suse distros ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2024-06-22 12:08:48 +02:00
Ettore Di Giacinto	260f2e1d94	fix(install.sh): correctly handle systemd service installation (#2627) ... Fixup install.sh systemd service installation Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2024-06-21 23:56:06 +02:00
Ettore Di Giacinto	603d81dda1	feat(install): add install.sh for quick installs (#2489) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2024-06-07 22:30:41 +02:00