ExternalVendorCode/lollms
1
0
Fork 0
mirror of https://github.com/ParisNeo/lollms.git synced 2025-02-01 00:45:29 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity

fixed error in petals run script

Browse Source
This commit is contained in:
Saifeddine ALOUI 2024-02-20 00:27:02 +01:00
parent 4141260697
commit d86c24e8c2
1 changed files with 0 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
lollms/services/petals/run_petals.sh
View File

@ -1,6 +1,5 @@
#!/bin/bash
cd ~/vllm
PATH="$HOME/miniconda3/bin:$PATH"
export PATH
conda activate vllm && python -m vllm.entrypoints.openai.api_server --model_name "$1" --node_name "$2" --device "$3"