zImageBase - V1.0
After quite a few test with different settings, including theory's without any proof, decided to just change all training settings till something works. Did a small test with only 6 images, different styles, photo, illustration etc. After 500 steps it pretty much nailed all images, low style bleeding if any, no flip-flopping of characters changing position, reduced hallucinations, learns faster ( well, it's slow but constant ) and the Lora has more influence even with lower strength ( in some cases you had to crank up the strength over 1.0 which induces artifacts )
This one is just another test with 20 images. Old images with a lot of junk in them, which was wanted to see if it tries to compensate mistakes or learns what is given.
This is a version with lower step count. The versions with higher steps where a bit too close to the source images and made the output very rigged even with different seeds. Even this one is kinda strong.
I don't trust it fully yet. Currently training stuff with a bigger dataset which takes some time.
• AI-Toolkit - Prodigy ( non 8bit, at least i think, if i read the optimizer files correctly )
• Rank 64 ( haven't tested lower ranks yet, just went with it )
• LR: 1 ( Prodigy changes the learning rate dynamically )
• noise_scheduler: "flowmatch"
optimizer: "prodigy"
timestep_type: "shift"
content_or_style: "balanced"
optimizer_params:
weight_decay: 0.01 ( still needs testing if needed at all, changed it a few times )
d_coef: 1.0 ( also needs testing, changed it to 1.5 for the bigger dataset for now )
decouple: true
use_bias_correction: false
Take all of this with a big grain of salt ... actually buy a whole salt-mine. With AI it seems no one knows how and why shit works or not. Even the people who made the models don't know what the fuck is going on, all just theory and math. High chance that i'm on the wrong path too, wouldn't be the first time. It did what it's supposed to do for now, so i'll stick with it