This website requires JavaScript.
Explore
Help
Sign In
ExternalVendorCode
/
LocalAI
Watch
1
Star
0
Fork
0
You've already forked LocalAI
mirror of
https://github.com/mudler/LocalAI.git
synced
2025-02-12 05:35:20 +00:00
Code
Issues
Actions
14
Packages
Projects
Releases
Wiki
Activity
LocalAI
/
backend
/
python
/
vllm
History
Taikono-Himazin
03adc1f60d
Add tensor_parallel_size setting to vllm setting items (
#2085
)
...
Signed-off-by: Taikono-Himazin <kazu@po.harenet.ne.jp>
2024-04-20 14:37:02 +00:00
..
backend_vllm.py
Add tensor_parallel_size setting to vllm setting items (
#2085
)
2024-04-20 14:37:02 +00:00
Makefile
fix: dont commit generated files to git (
#1993
)
2024-04-13 09:37:32 +02:00
README.md
refactor: move backends into the backends directory (
#1279
)
2023-11-13 22:40:16 +01:00
run.sh
deps(conda): use transformers-env with vllm,exllama(2) (
#1554
)
2024-01-06 13:32:28 +01:00
test_backend_vllm.py
feat(conda): share envs with transformer-based backends (
#1465
)
2023-12-21 08:35:15 +01:00
test.sh
deps(conda): use transformers-env with vllm,exllama(2) (
#1554
)
2024-01-06 13:32:28 +01:00
README.md
Creating a separate environment for the vllm project
make vllm
