This commit is contained in:
Saifeddine ALOUI 2023-06-27 00:15:53 +02:00
parent facef64b22
commit f0fc7d5473
2 changed files with 3 additions and 6 deletions

View File

@ -107,11 +107,6 @@ class LoLLMsAPPI():
if config.model_name is None:
self.menu.select_model()
try:
self.model = self.binding.build_model()
except Exception as ex:
ASCIIColors.error(f"Couldn't build model. Try to reinstall binding {self.config['binding_name']}")
self.model = None
self.mounted_personalities = []
try:
self.model = self.binding.build_model()

View File

@ -56,4 +56,6 @@ Now let's find our falcon 7B model. For now the search option is not yet impleme
Let's select a 4 bits quantization which is a good ratio between size and performance.
Press install and wait for it to download the model. You can install multiple models simultaniously. Make sure you have enough disk space as some of those models are very big.
Once installed, we can ask the same question and compare the output.
Now let's take a look at the new personalities system.
The new system allows us to mount multiple personalities in the same session. This means that we can create a multipersonalities discussion.