Page 1 of 1
Newbie - should I continue with this data/training
Posted: Sat Mar 02, 2024 1:06 am
by Gaben1994
Hi everyone, young player here, I try to create a deepfake video to my friend's birthday, I am getting very close to the deadline so would like to ask experienced players if I should give up below training after 135 000 iterations (villian trainer)? I have this at the moment after that many iterations, probably I should have shaved and maybe I should wear a hat:
If I should give up, could you give me a few suggestions how to improve the new training? Since I am new, I don't even know what information should I share that could help people here with suggestions. Btw at the moment the average loss is: face_a: 0.02814, face_b: 0.01728.
Re: Newbie - should I continue with this data/training
Posted: Sat Mar 02, 2024 1:13 pm
by torzdf
Villain is a notoriously slow model to train. so you may want to switch to something like dfaker to get quicker results (at slightly lower quality).
Note that neither of these models will be good for close-up shots as they output at 128px. Bigger models require more VRAM and more time to train though.
Also, see here: I've trained the model for ages, the previews look good, so why is the swapped face blurry?
Re: Newbie - should I continue with this data/training
Posted: Tue Mar 12, 2024 1:13 pm
by d3x
135k iterations is nothing Seems very undertrained
With villain (or any trainer with high resolution output) it always takes me a couple million iterations before it gets all the details right
Sidenote: when converting you can increase the Face Scale in the Face Processing section to better line up the edge of the replacement face with the original face (I usually have to increase mine by at least 1 or 2 to make it fit good)
But as mentioned above: with only 128px output, close-ups will always be kind of blurry - decreasing the Output Scale for the converted image or video can help make this less noticeable (compared to everything outside the swap area)