Djip007
68ef10805e
update HIP_UMA #7399 (llama/7414)
...
* update HIP_UMA #7399
add use of hipMemAdviseSetCoarseGrain when LLAMA_HIP_UMA is enable.
- get x2 on prompte eval and x1.5 on token gen with rocm6.0 on ryzen 7940HX iGPU (780M/gfx1103)
* simplify code, more consistent style
---------
Co-authored-by: slaren <slarengh@gmail.com>
2024-06-16 18:19:48 +03:00
..
2024-03-27 18:55:10 +02:00
2024-03-27 18:55:10 +02:00
2024-03-27 18:55:10 +02:00
2024-03-27 18:55:10 +02:00
2024-04-07 16:15:57 +03:00
2024-03-27 18:55:10 +02:00
2024-05-13 11:02:26 +03:00
2024-03-27 18:55:10 +02:00
2024-05-13 11:02:26 +03:00
2024-03-27 18:55:10 +02:00
2024-06-16 18:19:48 +03:00
2024-03-27 18:55:10 +02:00
2024-03-27 18:55:10 +02:00
2024-06-16 18:19:48 +03:00
2024-04-09 20:26:18 +03:00
2024-05-13 11:02:26 +03:00
2024-05-13 11:02:26 +03:00
2024-04-09 20:26:18 +03:00
2024-03-27 18:55:10 +02:00
2024-03-27 18:55:10 +02:00
2024-06-16 18:19:48 +03:00
2024-04-07 16:15:57 +03:00
2024-06-16 18:19:48 +03:00
2024-06-16 18:19:48 +03:00
2024-06-16 18:19:48 +03:00
2024-06-16 18:19:48 +03:00
2024-06-16 18:19:48 +03:00
2024-05-14 19:16:29 +03:00
2024-05-14 19:16:29 +03:00
2024-05-14 19:16:29 +03:00
2024-05-14 19:16:29 +03:00
2024-06-16 18:19:48 +03:00
2024-05-13 11:02:26 +03:00
2024-03-27 18:55:10 +02:00
2024-03-27 18:55:10 +02:00
2024-03-27 18:55:10 +02:00
2024-03-27 18:55:10 +02:00
2024-06-16 18:19:48 +03:00
2024-03-27 18:55:10 +02:00
2024-06-11 17:39:01 +03:00
2024-03-27 18:55:10 +02:00
2024-03-27 18:55:10 +02:00
2024-03-27 18:55:10 +02:00
2024-03-27 18:55:10 +02:00
2024-03-27 18:55:10 +02:00
2024-03-27 18:55:10 +02:00
2024-03-27 18:55:10 +02:00
2024-04-09 20:26:18 +03:00
2024-04-09 20:26:18 +03:00
2024-06-16 18:19:48 +03:00
2024-03-27 18:55:10 +02:00
2024-05-13 11:02:26 +03:00
2024-03-27 18:55:10 +02:00
2024-06-16 18:19:48 +03:00
2024-03-27 18:55:10 +02:00
2024-03-27 18:55:10 +02:00
2024-03-27 18:55:10 +02:00
2024-03-27 18:55:10 +02:00
2024-03-27 18:55:10 +02:00
2024-05-13 11:02:26 +03:00
2024-05-13 11:02:26 +03:00
2024-06-16 18:19:48 +03:00
2024-03-27 18:55:10 +02:00
2024-06-16 18:19:48 +03:00