Is it possible to lip sync ?

Discussions about research, Faceswapping and things that don't fit in the other categories here.


Locked
User avatar
gseinstein
Posts: 6
Joined: Thu Aug 27, 2020 11:41 am
Has thanked: 2 times

Is it possible to lip sync ?

Post by gseinstein »

I have a person talking in english (person 1) and a person talking in german (person 2). Both clips are of same duration is there any way to make person 1 taking german using faceswap ??

User avatar
torzdf
Posts: 2693
Joined: Fri Jul 12, 2019 12:53 am
Answers: 159
Has thanked: 136 times
Been thanked: 630 times

Re: Is it possible to lip sync ?

Post by torzdf »

That sounds like a pretty standard faceswap to me.

'A' would be the person 2, 'B' would be person 1.

My word is final

User avatar
gseinstein
Posts: 6
Joined: Thu Aug 27, 2020 11:41 am
Has thanked: 2 times

Re: Is it possible to lip sync ?

Post by gseinstein »

torzdf wrote: Tue Dec 08, 2020 2:27 pm

That sounds like a pretty standard faceswap to me.

'A' would be the person 2, 'B' would be person 1.

But I do not want to change the face. only lip movement

User avatar
bryanlyon
Site Admin
Posts: 793
Joined: Fri Jul 12, 2019 12:49 am
Answers: 44
Location: San Francisco
Has thanked: 4 times
Been thanked: 218 times
Contact:

Re: Is it possible to lip sync ?

Post by bryanlyon »

That is not what FaceSwap does. We just swap faces, not animate others. You could try doing a faceswap then using other tools to move the lips back, but I don't think that'd be the easiest way. You may want to check out other programs such as wav2lip or first order model.

Locked