A Hybrid Model for Natural Face De-Identiation with Adjustable Privacy

Abstract

As more and more personal photos are shared and tagged in social media, security and privacy protection are becoming an unprecedentedly focus of attention. Avoiding privacy risks such as unintended verification, becomes increasingly challenging. To enable people to enjoy uploading photos without having to consider these privacy concerns, it is crucial to study techniques that allow individuals to limit the identity information leaked in visual data. In this paper, we propose a novel hybrid model consists of two stages to generate visually pleasing de-identified face images according to a single input. Meanwhile, we successfully preserve visual similarity with the original face to retain data usability. Our approach combines latest advances in GAN-based face generation with well-designed adjustable randomness. In our experiments we show visually pleasing de-identified output of our method while preserving a high similarity to the original image content. Moreover, our method adapts well to the verificator of unknown structure, which further improves the practical value in our real life.

Publication
2020 IEEE International Conference on Visual Communications and Image Processing (VCIP)
Yunqian Wen
Yunqian Wen
PhD Student

I’m a Research PHD candidate at SJTU Media Lab. I’m doing my research on computer vision and privacy protection, under the direction of Prof. Li Song.

Yunhui Zhu
Yunhui Zhu
Master Student

I’m a master student at SJTU Media Lab. I’m doing my research on deep learning and image privacy, under the direction of Prof. Li Song.

Jingyi Cao
Jingyi Cao
Master Student

I’m a master student at SJTU Media Lab. I am doing my research on image privacy and deep learning, under the direction of Prof. Li Song.

Li Song
Li Song
Professor, IEEE Senior Member

Professor, Doctoral Supervisor, the Deputy Director of the Institute of Image Communication and Network Engineering of Shanghai Jiao Tong University, the Double-Appointed Professor of the Institute of Artificial Intelligence and the Collaborative Innovation Center of Future Media Network, the Deputy Secretary-General of the China Video User Experience Alliance and head of the standards group.