lollms-webui/bindings/py_llama_cpp/binding_card.yaml

13 lines
446 B
YAML
Raw Normal View History

2023-05-27 08:06:52 +00:00
name: PyLLamaCpp
author: abdeladim
version: 1.0
link: https://github.com/abdeladim-s/pyllamacpp
description: 'Python bindings for llama.cpp
2023-05-28 12:22:22 +00:00
For those who don''t know, llama.cpp is a port of Facebook''s LLaMA model in pure C/C++:
2023-05-27 08:06:52 +00:00
Without dependencies
Apple silicon first-class citizen - optimized via ARM NEON
AVX2 support for x86 architectures
Mixed F16 / F32 precision
4-bit quantization support
Runs on the CPU
'