This commit is contained in:
Saifeddine ALOUI 2023-11-05 16:03:40 +01:00
parent f3c16c697d
commit f1f027fd6e
2 changed files with 70 additions and 1 deletions

View File

@ -41,3 +41,72 @@ Here we're going to make some Steampunk style artworks. As you can see, the artw
Now let's try to test a steampunk illustration in continuous mode. To activate this mode, just go to the settings of artbot and select continue_from_last_image. This means that the prompts will induce updates to last picture instead of starting from scratch. We can also fix the image to image denoising strength. A bigger value yields more changes to the generated image, and a smaller value yields less changes.
For example, here we ask to make a steampunk artwork of a white haired girl. Here I have activated imagine mode, so I don't need to be very specific. The AI will take care of imagining all the details and building the positive prompt as well as the negative prompt. You can also activate the make title option so that the AI builds a title to the artwork. All we have to do is wait.
As you can see, the AI generated an image of a steampunk girl with white hair. We can click the image to view it in the new full screen mode. Notice here that this video took days to make and now we are using artbot version 2.2 with the new UI that offers more options than before. You can see that we have lots of metadata that we can use and export.
To make consistant changes to the artwork, I advice you to copy the seed number and set it as the default seed for the subsequent generations. This ensures that the noise used in the diffusion model stays the same allowing for more similar generations. Make sure you get it back to -1 if you want more randomness.
Using the metadata of the image allows you to have the full set of configurations to allow you to reproduce it.
Now let's try to change the hair of thegirl to be red instead of white.
It looks like the hair wasn't that changed. You can feel a hue but it is not as red as we may want. The thing is that the denoising strength that we did set was not enough to get any significant changes. Let's change that.
Now instead of starting the imagination process which will probably change the prompt again, we can just use the regenerate with last prompt command from the artbot commands menu.
As you can see, the hair is now red. But you can notice that the AI has added a new element which is the glasses. Well, those glasses were introduced because we used the imagination mode between the first and second generations which triggers a whole new imagination. We could have avoided this by simply disabling the imagination mode, copy the prompt generated by the AI and then paste it and change the color in the text.
Ok, now let's do the same and build an image of a steampunk male with long moustache.
Here we have set the number of images to generate to three. This is interesting if you want to choose between multiple alternatives and build from it.
In the new version of artbot, we have a copy button that will copy the positive and negative prompts allowing us to use it in manual mode. Let's copy the prompt and paste it in the chatbox input. Let's select the second image then we can modify the prompt content. For example we can emphesize an aspect of the image by adding multiple braces around it. Let's inphesize the colorful nature of the image.
Now before generating, let's deactivate the imagination mode.
Also, let's copy the seed value from the image we want to build next images from, and activate the continuous mode.
Now let's generate the image.
As you can see, the image is basically the same but we get a little more color in the background.
We can press the Variate button to generate more images. Here we generate a single image, but you can set the number of variations to generate in the settings in order to produce more variations and choose from.
Here is the original image. And here is the modified image. Finally, here is the variant we have produced from the modified image. You can see that the rainbow is now different.
Now let's reactivate the imagination part and talk to the AI about our artwork. Here I remind you that Artbot can also discuss with you the aspects of the artwork. Let's ask it for some ideas to make out artwork a little more original.
As you can see, the AI proposed a set of ideas to make the artwork more original. I like the idea about the mechanical wings. Let's add this element to the artwork.
Remember, when you are in imagination mode, you need to explicitly ask the AI to generate an artwork, an icon or whatever you like or it will consider your prompt for discussion. In fact, the AI reads your prompt then decides whether you are asking for a generation or if you are just asking a question or discussing about the artwork.
Here we have our colorful wings. We can press variate button to get more variants.
Be careful not to keep a fixed seed or you will just have an exact copy to your previous image.
To set a random seed, just set it to -1.
Let's also increase the value of denoising strength to make more changes.
As we can see, we have a new different image but with the same elements. Make sure to change the number of generated images to a higher value so that you can choose from the variants generated at once instead of generating them one by one.
This time we can see that multiple images have been generated. We can view them and select the best one. We can go on and on until we finish building the artwork that satisfies our needs.
It is important to note that the quality of the output is tightly linked to the model you are using. It is a good idea to install a more stylized model finetuned for the kind of art you are trying to make. You can find multiple models on https://civitai.com/. Make sure you only download safetensors models as this format was designed to prevent from putting malicious code in the model. Other file types especially those based on python's pickle may present a security risk as they can embed malicious code inside.
Download the model to your lollms personal folder / shared / auto_sd / models / stable-diffusion. You can install as many models as you wish and thage them from the advanced automatic1111's web UI.
Now to select our model, go back to lollms, and press the artbot contextual menu and select Show Stable diffusion UI. This is a modofied version of Automatic 1111 Stable diffusion webui where you can perform exactly the same operations. It is uptodate to their main branch and you can use it to perform advanced upgrades by disabling the paint functionality in artbot and use it as a prompt generation tool. Here we are going to use it to select the model. If you don't see the model yet, just press the refresh button on the right of the models list. All you have to do is wait and when it is ready, we can go back to lollms and do some variations.
As you can see, the style has completely changed. We can see the manga like aspect of the generated images. You can try playing around with all those combinations, mixing models, your imagination, artbot imagination and your sense of beauty in order to produce even better images.
You can also use the Stable diffusion webui to do inpainting, image guidance using controlnet and so much more. You can find more tutorials on stable diffusion web UI on the internet as this video is only about Artbot parts.

@ -1 +1 @@
Subproject commit 801640ab88880309c5b70b353476f742d9033807
Subproject commit bd78d8a30d81304ddc1c9e7e96da632de2f2c7ab