Pics 105: AI Ariane Experiments 3 Controlnet
Added 2023-03-02 21:59:01 +0000 UTC
Controlnet is a new AI extension tool that I am really excited about, because not only does it copy the image better, it also copies the pose being used in the figure.
The result is that the img2img using controlnet preprocessing (I use the HED model here), basically turns 3D renders into near perfect photographs, bridging that gap between 3D art and AI art.
It has the same problems as img2img as far as storytelling goes, images with two different people result in their faces merging requiring a lot of extra photoshop to look right, which I am not willing to do at this time. But considering how fast this technology is moving, who knows what I can do in the future?
I decided to try this technology on the same five test images I used last week to see if I really could get photo quality images.
This first one looks a little washed out, but some color adjustments and I could make it work.
Another that looks the same except for color desaturation. I wonder if I can fix that in post?
Since the model is designed to mirror poses it handles the side view test perfectly.
A reminder that while the AI side mostly uses info from the left side to render. It is still using "photos scraped from the internet" to make the face and skin more realistic. The skin texture is not the same as the one used in the 3D side, so who knows whose nipples those really are (not that there is a shortage of nipple textures online).
Yet another reason to avoid using AI images in games.
Finally the lying on the couch naked actually looks realistic with Controlnet. Did a bunch of different renders for this one and the lighting is off on all of them, but at least this week her boobs are on her chest.
