ExternalVendorCode/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2024-12-20 05:07:54 +00:00
Code Issues Actions 13 Packages Projects Releases Wiki Activity

Documentation for Hipblas (#1425)

Browse Source 
hiplas arch
This commit is contained in:
Samuel Walker 2023-12-12 09:05:01 -05:00 committed by GitHub
parent 9aa2a7ca13
commit 865e523ff1
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 12 additions and 8 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

20
docs/content/build/_index.en.md
View File

@ -147,20 +147,24 @@ make BUILD_TYPE=cublas build
More informations available in the upstream PR: https://github.com/ggerganov/llama.cpp/pull/1412 More informations available in the upstream PR: https://github.com/ggerganov/llama.cpp/pull/1412
#### Hipblas (AMD GPU)
AMD GPU Acceleration #### Hipblas (AMD GPU with ROCm on Arch Linux)
Requirement: ROCm
Packages:
``` ```
make BUILD_TYPE=hipblas build pacman -S base-devel git rocm-hip-sdk rocm-opencl-sdk opencv clblast grpc
``` ```
Specific GPU targets can be specified with `GPU_TARGETS`: Library links:
``` ```
make BUILD_TYPE=hipblas GPU_TARGETS=gfx90a build export CGO_CFLAGS="-I/usr/include/opencv4"
export CGO_CXXFLAGS="-I/usr/include/opencv4"
export CGO_LDFLAGS="-L/opt/rocm/hip/lib -lamdhip64 -L/opt/rocm/lib -lOpenCL -L/usr/lib -lclblast -lrocblas -lhipblas -lrocrand -lomp -O3 --rtlib=compiler-rt -unwindlib=libgcc -lhipblas -lrocblas --hip-link"
```
Build:
```
make BUILD_TYPE=hipblas GPU_TARGETS=gfx1030
``` ```
#### ClBLAS #### ClBLAS