mirror of
https://github.com/ParisNeo/lollms-webui.git
synced 2025-01-18 02:39:47 +00:00
updated
This commit is contained in:
parent
facef64b22
commit
f0fc7d5473
@ -107,11 +107,6 @@ class LoLLMsAPPI():
|
||||
if config.model_name is None:
|
||||
self.menu.select_model()
|
||||
|
||||
try:
|
||||
self.model = self.binding.build_model()
|
||||
except Exception as ex:
|
||||
ASCIIColors.error(f"Couldn't build model. Try to reinstall binding {self.config['binding_name']}")
|
||||
self.model = None
|
||||
self.mounted_personalities = []
|
||||
try:
|
||||
self.model = self.binding.build_model()
|
||||
|
@ -56,4 +56,6 @@ Now let's find our falcon 7B model. For now the search option is not yet impleme
|
||||
|
||||
Let's select a 4 bits quantization which is a good ratio between size and performance.
|
||||
Press install and wait for it to download the model. You can install multiple models simultaniously. Make sure you have enough disk space as some of those models are very big.
|
||||
Once installed, we can ask the same question and compare the output.
|
||||
Now let's take a look at the new personalities system.
|
||||
The new system allows us to mount multiple personalities in the same session. This means that we can create a multipersonalities discussion.
|
||||
|
||||
|
Loading…
Reference in New Issue
Block a user