|
|
<!DOCTYPE html> |
|
|
<html lang="en"> |
|
|
|
|
|
<head> |
|
|
<meta charset="utf-8"> |
|
|
<meta http-equiv="X-UA-Compatible" content="IE=edge"> |
|
|
<meta name="viewport" content="width=device-width, initial-scale=1"> |
|
|
|
|
|
<meta name="description" content="SimSwap"> |
|
|
<meta name="author" content=""> |
|
|
<link rel="icon" href="./favicon.ico"> |
|
|
|
|
|
<title>SimSwap</title> |
|
|
|
|
|
|
|
|
<link href="./css/bootstrap.min.css" rel="stylesheet"> |
|
|
|
|
|
|
|
|
<link href="./css/ie10-viewport-bug-workaround.css" rel="stylesheet"> |
|
|
|
|
|
|
|
|
<link href="./css/jumbotron.css" rel="stylesheet"> |
|
|
<link href="./css/page.css" rel="stylesheet"> |
|
|
|
|
|
|
|
|
|
|
|
<script src="./js/ie-emulation-modes-warning.js"></script> |
|
|
<script src="./js/which-image.js"></script> |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
</head> |
|
|
|
|
|
<body> |
|
|
|
|
|
<nav class="navbar navbar-inverse navbar-fixed-top"> |
|
|
<div class="container"> |
|
|
<div class="navbar-header"> |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
<a class="navbar-brand" href="#">SimSwap</a> |
|
|
</div> |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
</div> |
|
|
</nav> |
|
|
|
|
|
|
|
|
<div class="jumbotron jumbotron-fluid" style="background: url('./img/nrsig.png'); background-size: 33%;"> |
|
|
<div height=100% width=100% style="background: rgba(255,255,255, 1); background-size: 33%;"> |
|
|
</div> |
|
|
<div class="container"> |
|
|
<div class="row"> |
|
|
<div class="col-md-6 col-md-offset-3 text-center"> |
|
|
<img src="./img/logo2.png" alt="SimSwap" class="img-rounded" style="width: 100%;"> |
|
|
</div> |
|
|
</div> |
|
|
|
|
|
<div class="row text-center"> |
|
|
<div class="col-md-* text-center" style="color:white;"> |
|
|
<h2>SimSwap: An Efficient Framework For High Fidelity Face Swapping</h2> |
|
|
</div> |
|
|
</div> |
|
|
|
|
|
<div class="row"> |
|
|
<div class="col-md-* text-center" style="color:white;"> |
|
|
<h4>Renwang Chen<sup>*</sup>, Xuanhong Chen<sup>*</sup>, Bingbing Ni, Yanhao Ge</h4> |
|
|
</div> |
|
|
</div> |
|
|
<div class="row"> |
|
|
<div class="col-md-* text-center" style="color:white;"> |
|
|
<h4>Shanghai Jiao Tong University, Tencent, China</h4> |
|
|
</div> |
|
|
</div> |
|
|
<div class="row"> |
|
|
<div class="col-md-2 col-md-offset-5 text-center" style="color:white;"> |
|
|
<h5><sup>*</sup>Equal contribution.</h5> |
|
|
</div> |
|
|
</div> |
|
|
<div class="row"> |
|
|
<h5 class="page-header"></h5> |
|
|
</div> |
|
|
<div class="row"> |
|
|
<div class="col-md-6 col-md-offset-3 text-center"> |
|
|
<div class="row"> |
|
|
<div class="col-md-4 col-sm-4 text-center"> |
|
|
<p> |
|
|
<a class="btn btn-primary btn-lg" href="https://github.com/neuralchen/SimSwap" role="button" target="_blank"> <span class="glyphicon glyphicon-star" aria-hidden="true"></span> Code »</a> |
|
|
</p> |
|
|
</div> |
|
|
<div class="col-md-4 col-sm-4 text-center"> |
|
|
<p><a class="btn btn-primary btn-lg" href="#downloads" role="button"><span class="glyphicon glyphicon-cloud-download" aria-hidden="true"></span> Download »</a></p> |
|
|
</div> |
|
|
<div class="col-md-4 col-sm-4 text-center"> |
|
|
<p><a class="btn btn-primary btn-lg" href="https://arxiv.org/abs/2106.06340" role="button" target="_blank"><span class="glyphicon glyphicon-save-file" aria-hidden="true"></span> Paper »</a></p> |
|
|
</div> |
|
|
</div> |
|
|
</div> |
|
|
</div> |
|
|
|
|
|
</div> |
|
|
</div> |
|
|
|
|
|
<div class="container"> |
|
|
|
|
|
<div class="row"> |
|
|
<div class="col-md-*"> |
|
|
<h2>Abstract</h2> |
|
|
</div> |
|
|
</div> |
|
|
<div class="row"> |
|
|
<div class="col-md-* text-justify" style="line-height:150%; font-size: large;"> |
|
|
<p> |
|
|
We propose an efficient framework, called <strong><i>Simple Swap (SimSwap)</i></strong>, aiming for generalized and high fidelity face swapping. In contrast to previous approaches that either lack the ability to generalize to arbitrary |
|
|
identity or fail to preserve attributes like facial expression and gaze direction, our framework is capable of transferring the identity of an arbitrary source face into an arbitrary target face while preserving the attributes of the |
|
|
target face. We overcome the above defects in the following two ways. First, we present the <i>ID Injection Module (IIM)</i> which transfers the identity information of the source face into the target face at feature level. By using |
|
|
this module, we extend the architecture of an identityspecific face swapping algorithm to a framework for arbitrary face swapping. Second, we propose the <i>Weak Feature Matching Loss</i> which efficiently helps our framework to preserve |
|
|
the facial attributes in an implicit way. Extensive experiments on wild faces demonstrate that our <i>SimSwap</i> is able to achieve competitive identity performance while preserving attributes better than previous state-of-the-art |
|
|
methods. The code is already available on github: https://github.com/neuralchen/SimSwap. |
|
|
</p> |
|
|
</div> |
|
|
</div> |
|
|
<div class="row"> |
|
|
<h5 class="page-header"></h5> |
|
|
</div> |
|
|
|
|
|
<div class="row"> |
|
|
<div class="col-md-*"> |
|
|
<h2>SimSwap Demo</h2> |
|
|
</div> |
|
|
</div> |
|
|
<div class="row"> |
|
|
<div class="col-md-*"> |
|
|
<h3>Single Face Video Swap</h3> |
|
|
</div> |
|
|
</div> |
|
|
<div class="row select-show"> |
|
|
<div class="col-md-12"> |
|
|
<div class="col-md-3 which-image-container"> |
|
|
<div class="which-image" id=anni> |
|
|
<img src="./img/id/anni.jpg" onclick="select_source(0)" /> |
|
|
</div> |
|
|
<div class="which-image" id=chenglong> |
|
|
<img src="./img/id/zhoujielun.jpg" onclick="select_source(1)" /> |
|
|
</div> |
|
|
</div> |
|
|
<div class="col-md-3 which-image-container"> |
|
|
<div class="which-image" id=zhoujielun> |
|
|
<img src="./img/id/chenglong.jpg" onclick="select_source(2)" /> |
|
|
</div> |
|
|
<div class="which-image" id=zhuyin> |
|
|
<img src="./img/id/zhuyin.jpg" onclick="select_source(3)" /> |
|
|
</div> |
|
|
</div> |
|
|
<div class="col-md-6 image-display" height=100%> |
|
|
<img id=jiroujinlun src="./img/anni.webp" /> |
|
|
</div> |
|
|
</div> |
|
|
</div> |
|
|
<div class="row select-show" style="margin-top: 10px;"> |
|
|
<div class="col-md-12"> |
|
|
<div class="col-md-3 which-image-container"> |
|
|
<div class="which-image" id=Iron_man> |
|
|
<img src="./img/id/Iron_man.jpg" onclick="select_source2(0)" /> |
|
|
</div> |
|
|
</div> |
|
|
<div class="col-md-3 which-image-container"> |
|
|
<div class="which-image" id=wuyifan> |
|
|
<img src="./img/id/wuyifan.png" onclick="select_source2(1)" /> |
|
|
</div> |
|
|
</div> |
|
|
<div class="col-md-6 image-display2"> |
|
|
<img id=mama src="./img/mama_mask_short.webp" /> |
|
|
</div> |
|
|
</div> |
|
|
</div> |
|
|
<div class="row"> |
|
|
<div class="col-md-*"> |
|
|
<h3>Multiple Faces Video Swap</h2> |
|
|
</div> |
|
|
</div> |
|
|
<div class="row"> |
|
|
[TODO] |
|
|
</div> |
|
|
|
|
|
<div class="row"> |
|
|
<div class="col-md-*"> |
|
|
<h3>An overview of model capacity</h2> |
|
|
</div> |
|
|
</div> |
|
|
<div class="row"> |
|
|
<div class="col-md-12 col-sm-12"> |
|
|
<img src="./img/results1.PNG" style="width: 100%;" /> |
|
|
</div> |
|
|
|
|
|
</div> |
|
|
<div class="row"> |
|
|
<div class="col-md-12 col-sm-12"> |
|
|
<img src="./img/total.PNG" style="width: 100%;" /> |
|
|
</div> |
|
|
</div> |
|
|
|
|
|
<div class="row"> |
|
|
<h5 class="page-header"></h5> |
|
|
</div> |
|
|
<div class="row"> |
|
|
<div class="col-md-*"> |
|
|
<h2>Downloads</h2> |
|
|
</div> |
|
|
</div> |
|
|
<div id="downloads" class="row"> |
|
|
<div class="col-md-6 col-sm-6 text-center"> |
|
|
<p> |
|
|
<a class="btn btn-success btn-lg" href="https://github.com/neuralchen/SimSwap" role="button" target="_blank"> <span class="glyphicon glyphicon-hdd" aria-hidden="true"></span> Donwnload via Google Drive »</a> |
|
|
</p> |
|
|
</div> |
|
|
<div class="col-md-6 col-sm-6 text-center"> |
|
|
<p><a class="btn btn-success btn-lg" href="#downloads" role="button" target="_blank"><span class="glyphicon glyphicon-cloud-download" aria-hidden="true"></span> Download via Baidu Drive »</a></p> |
|
|
<span class="label label-info">password: xxxx</span> |
|
|
</div> |
|
|
</div> |
|
|
|
|
|
<div class="row"> |
|
|
<h5 class="page-header"></h5> |
|
|
</div> |
|
|
<div class="row"> |
|
|
<div class="col-md-*"> |
|
|
<h2>Citation</h2> |
|
|
</div> |
|
|
</div> |
|
|
<div class="row"> |
|
|
<div class="col-md-*"> |
|
|
<div class="well"> |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
@article{Chen_2020, |
|
|
<br/>   title={SimSwap}, |
|
|
<br/>   ISBN={9781450379885}, |
|
|
<br/>   url={http://dx.doi.org/10.1145/3394171.3413630}, |
|
|
<br/>   DOI={10.1145/3394171.3413630}, |
|
|
<br/>   journal={Proceedings of the 28th ACM International Conference on Multimedia}, |
|
|
<br/>   publisher={ACM}, |
|
|
<br/>   author={Chen, Renwang and Chen, Xuanhong and Ni, Bingbing and Ge, Yanhao}, |
|
|
<br/>   year={2020}, |
|
|
<br/>   month={Oct} |
|
|
<br/> } |
|
|
</div> |
|
|
</div> |
|
|
</div> |
|
|
|
|
|
<div class="row"> |
|
|
<h5 class="page-header"></h5> |
|
|
</div> |
|
|
<div class="row"> |
|
|
<div class="col-md-*"> |
|
|
<h2>Contact</h2> |
|
|
</div> |
|
|
</div> |
|
|
<div class="row"> |
|
|
<div class="col-md-*"> |
|
|
<p>Please concat Renwang Chen <span class="label label-primary">applebananac@sjtu.edu.cn</span> and Xuanhong Chen <span class="label label-primary">xuanhongchenzju@outlook.com</span> for questions about the paper. </p> |
|
|
</div> |
|
|
</div> |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
<hr> |
|
|
|
|
|
<footer> |
|
|
<p><a>Accessibility</a></p> |
|
|
</footer> |
|
|
</div> |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
<script src="https://ajax.googleapis.com/ajax/libs/jquery/1.12.4/jquery.min.js"></script> |
|
|
<script> |
|
|
window.jQuery || document.write('<script src="./js/vendor/jquery.min.js"><\/script>') |
|
|
</script> |
|
|
<script src="./js/bootstrap.min.js"></script> |
|
|
|
|
|
<script src="./js/ie10-viewport-bug-workaround.js"></script> |
|
|
<script> |
|
|
document.getElementById('Iron_man').style.borderWidth = '5px'; |
|
|
document.getElementById('Iron_man').style.borderColor = 'red'; |
|
|
document.getElementById('Iron_man').style.borderStyle = 'outset'; |
|
|
|
|
|
document.getElementById('anni').style.borderWidth = '5px'; |
|
|
document.getElementById('anni').style.borderColor = 'red'; |
|
|
document.getElementById('anni').style.borderStyle = 'outset'; |
|
|
</script> |
|
|
</body> |
|
|
|
|
|
</html> |