I'm confused: What's the purpose of merging alignment files when merging training sets given that alignment files aren't actually used during training?
[Guide] Extraction - A Workflow
Read the FAQs and search the forum before posting a new topic.
This forum is for discussing tips and understanding the process involved for Extracting and preparing face sets for training a model in Faceswap.
If you have found a bug are having issues with the Extraction process not working, then you should post in the Extract Support forum.
Please mark any answers that fixed your problems so others can find the solutions.
- deephomage
- Posts: 33
- Joined: Fri Jul 12, 2019 6:09 pm
- Has thanked: 2 times
- Been thanked: 8 times
Re: [Guide] Extraction - A Workflow
In a broad sense, a clean set of images means keeping the extracted faces you want to swap, deleting unwanted faces extracted from the video clip and also deleting any extracted objects falsely identified as faces.
Re: [Guide] Extraction - A Workflow
deephomage wrote: ↑Wed Feb 12, 2020 8:07 pmIn a broad sense, a clean set of images means keeping the extracted faces you want to swap, deleting unwanted faces extracted from the video clip and also deleting any extracted objects falsely identified as faces.
Was that in response to me? Not trying to be rude, but genuinely confused because it doesn't seem to be answering the question I was asking at all. Maybe I did a bad job explaining. From the top:
Sometimes I extract for conversion, in which case I extract every frame, and keep the alignments file, as the alignments file is what will be used for the conversion process.
Sometimes I extract for training, in which case I'll only extract every 10-15 frames, and discard the alignments file, because the training phase only makes use of the images, not the alignment files.
Sometimes I build a training set from images extracted from multiple videos, which means multiple extraction steps, followed by copy the contents of multiple image folders into one image folder.
The above Extract guide explains how to merge the alignment files from multiple extractions into a single alignment file, which only makes sense in the context of assembling a training set - you would never need to merge alignment files for a conversion, because conversions are done on single videos.
But if I'm not using the alignment file for training, then what need is there to merge them? Why bother merging alignment files into a single alignment file that you won't be using for anything?
It doesn't make sense, which to me is a red flag that I'm misunderstanding something potentially important.
Re: [Guide] Extraction - A Workflow
If you're training with a mask or using Warp to Landmarks, then you need an alignments file, as stated here:
viewtopic.php?f=5&t=27#why
My word is final
Re: [Guide] Extraction - A Workflow
torzdf wrote: ↑Wed Feb 12, 2020 10:03 pmIf you're training with a mask or using Warp to Landmarks, then you need an alignments file, as stated here:
viewtopic.php?f=5&t=27#why
Great, that helps. I'm just getting into learning the Manual tool now, and made a decision to figure out masks and landmarks after I get the basics of the Manual tool, so I haven't actually looked into them yet. I'll postpone further comments on this question until I do.
Re: [Guide] Extraction - A Workflow
Dear facewap:
Thanks to facewap for providing such a magical application, when I learned to extract according to the guide, I found that there are some abnormal situations, I don't know if other friends have encountered:
Extract the face in the video, the face in several frames of the picture is rotated at an angle, which will cause the face position to be misaligned in the subsequent training;
Among the extracted results, there are still pictures that are not faces. Can I directly delete them manually, and then use the “Clean the Alignments File” in the guide to process?
I would like to consult how to solve this situation.
Thanks ~ ···
Re: [Guide] Extraction - A Workflow
Yes.
The slightly misaligned faces can be fixed with the manual alignments tool.
My word is final
Re: [Guide] Extraction - A Workflow
deephomage wrote: ↑Thu Jan 23, 2020 6:47 pmTo train a model, you need to extract both pairs of faces from video clips, to make a face set. For example, to swap Keanu Reeves and Nic Cage, you would extract Keanu and Nic faces from a variety of sources, to make a training set for each. If the video clips also contain unwanted faces, just delete the unwanted faces.
HI, regarding this, I have a few source videos of myself.
As you mentioned, I should extract my faces from these source; but do I output them to the same folder?
Example:
Code: Select all
/Output Pic/Myself
And same for whoever I want to swap my face with?
Example:
Code: Select all
/Output Pic/Whoever
Just verifying and trying to understand whether I am on the right path.
- bryanlyon
- Site Admin
- Posts: 793
- Joined: Fri Jul 12, 2019 12:49 am
- Location: San Francisco
- Has thanked: 4 times
- Been thanked: 218 times
- Contact:
Re: [Guide] Extraction - A Workflow
[mention]meDaniel[/mention] Yes, you can do that. You'll just need to follow the merging instructions in the guide to merge your alignments files after you finish extracting. Personally, I extract to different folders, then merge, but that's just a personal choice.
Re: [Guide] Extraction - A Workflow
You definitely should be outputting to different folders, and then looking to fix up the alignments for each extract run prior to merging.
Once the files are merged, you won't be able to use the Manual tool to fix up any issues.
My word is final
Re: [Guide] Extraction - A Workflow
Thanks for both the tips.
I will redo my extraction again. Because I extracted my own face from two source into the same folder.
Will try the method with the least issue =D
Guess I will be staring in some movies soon.
- FuorissimoX
- Posts: 56
- Joined: Mon Sep 21, 2020 6:49 am
- Location: Italy
- Has thanked: 10 times
- Been thanked: 2 times
Re: [Guide] Extraction - A Workflow
Hi, I'm trying the "Manually Fixing" function but I'm having trouble understanding what is right and what is wrong. Can you post photos? It would be easier. Thank you
- DildoSaggins
- Posts: 1
- Joined: Mon Nov 09, 2020 10:47 am
Re: [Guide] Extraction - A Workflow
I'm failing to understand exactly what I should have/keep from the extraction process to be used in either training or conversion. For example, following the extraction guide, for my "B" face(the face to be inserted INTO the video), when I finished, I now have two folders.
"B_faces_source" - which contains the original unaltered images to get faces from, as well as the alignments file I ended up with after following the guide.
and
"B_faces_extracted" - which contains the cropped/rotated face images generated during the extraction process and NO alignments files.
Once I get to the training section, it specifies that I should be feeding in the face files from the extracted folder, and not the source folder. But what about the alignment file? Can I use the alignment file from the source folder with the images from the extracted folder? Or do I feed the trainer both the original uncropped images from the source folder and that alignment file, and not actually use those cropped images in the extracted folder at all? When I did my extracting I used a mask (vgg-clean), so I know I definitely need to train with an alignments file.
Re: [Guide] Extraction - A Workflow
Hi all
First, again a BIG thank you for all the Faceswap team's hard work designing and supporting this massive project. We should all be supporting the team by signing up to Patreon.
Second, can I ask a question about alignments for conversion please?
I have an alignment file for training where I painstakingly adjusted each alignment mapped to the face. This extract used an EEN of every 10 frames or so.
I have now extracted a full alignment file for conversion with EEN 1. Is there any way to import the training alignments which I worked so hard on? I could then use those corrected alignments as a basis to correct the other 90% of "conversion alignments"?
Thanks very much for advice