SimSwap++: Towards Faster and High-Quality Identity Swapping

Accepted by TPAMI (IEEE Transactions on Pattern Analysis and Machine Intelligence)

Xuanhong Chen, Bingbing Ni $\dagger$, Yutian Liu, Naiyuan Liu, Linzhi Zeng, Hang Wang

$\dagger$ Corresponding author

Project page of SimSwap++

Please note that the current respository is a supplementary material for the SimSwap++ paper, NO issues will be replied at this stage. Once everything is ready we will release training and testing codes like our SimSwap.

Methodology of SimSwap++

Additional Results:

[Source ID: Angelina Jolie Target ID: Gamora]

[Source ID: Tom Cruise Target ID: Gamora]

[Source ID: Brad Pitt Target ID: Gamora]

[Source ID: Will Smith Target ID: Gamora]

[Source ID: Geoffrey Hinton Target ID: Gamora]

[Source ID: Captain America Chris Evans Target ID: Gamora]

[Source ID: Jim Carrey Target ID: Gamora]

[Source ID: Matthew McConaughey Target ID: Gamora]

[Source ID: Jackie Chan Target ID: Gamora]

[Source ID: Messi Target ID: Gamora]

[Source ID: Kylian Mbappé Target ID: Gamora]

[Source ID: Cristiano Ronaldo Target ID: Gamora]

[Source ID: Quentin Tarantino Target ID: Gamora]

Video in-the-wild Results (under construction):

Videos are generated frame by frame without any temporal smoothing (e.g., Kalman Filter), which may cause some subtle flickering.

Group1 [SimSwap++ (S)]:

Source ID: Scarlett Johansson Target ID: Shakira (1080p on YouTube)

Source ID: Dilireba Target ID: Shakira (1080p on Google Drive)

Source ID: Tom Cruise Target ID: Shakira (1080p on Google Drive)

Source ID: Elon Musk Target ID: Shakira (1080p on Google Drive)

Musk's face is always so recognizable!

Source ID: Keira Knightley Target ID: Shakira (1080p on Google Drive)

Source ID: Brad Pitt Target ID: Shakira (1080p on Google Drive)

Source ID: Nicole Kidman Target ID: Shakira (1080p on Google Drive)

Group2 [SimSwap++ (S)]:

Source ID: Kelly Clarkson Target ID: Taylor Swift (1080p on YouTube)

Source ID: Geoffrey Hinton Target ID: Taylor Swift (1080p on YouTube)

Source ID: Gal Gadot Target ID: Taylor Swift (1080p on YouTube)

Source ID: Leonardo DiCaprio Target ID: Taylor Swift (1080p on YouTube)

Source ID: Elon Musk Target ID: Taylor Swift (1080p on YouTube)

Source ID: Robert Downey Target ID: Taylor Swift (1080p on YouTube)

Source ID: Aamir Khan Target ID: Taylor Swift (1080p on YouTube)

Group3 [SimSwap++ (S)] Complex Movie Scene:

I am Iron Man

Few previous face-swapping papers have published such complex movie scenes

The subtle flickering can be resolved by introducing temporal smoothing, which is not our concern

Source ID: Captain America Chris Evans Target ID: Iron Man (1080p on YouTube)

Source ID: Scarlett Johansson Target ID: Iron Man (1080p on YouTube)

Source ID: Elon Musk Target ID: Iron Man (1080p on Google Drive)

Source ID: Leonardo Target ID: Iron Man (1080p on YouTube)

Source ID: Gal Gadot Target ID: Iron Man (1080p on YouTube)

VGGFace2-HQ Dataset

VGGFace2-HQ contains more than $1.36M$ $512 \times 512$ aligned face images and up to $9, 630$ distinct identities. In addition, this dataset consists of two parts:

• (1) a natural image sub-collection, which collects up to $200, 000$ images covering $1, 000$ different identities;
• (2) a synthetic image sub-collection, containing $8, 630$ cleaned and re-annotated identities (i.e., clean up the images with mismatching identities and low-quality faces in the cropped VGGFace2).

Download the dataset:

Via Google Drive:

[Google Drive] VGGFace2-HQ

We are especially grateful to Kairui Feng PhD student from Princeton University.

Via Baidu Drive:

[Baidu Drive] VGGFace2-HQ Password: sjtu

Samples from VGGFace2-HQ

Natural Part:

Synthetic Part:

Acknowledgements

• GFPGAN
• Insightface
• VGGFace2 Dataset for Face Recognition