Exposing low-quality deepfake videos of Social Network Service using Spatial Restored Detection Framework
dc.authorid | 0000-0003-1840-9958 | en_US |
dc.authorid | 0000-0002-7201-6963 | en_US |
dc.contributor.author | Li, Ying | |
dc.contributor.author | Bian, Shan | |
dc.contributor.author | Wang, Chuntao | |
dc.contributor.author | Polat, Kemal | |
dc.contributor.author | Alhudhaif, Adi | |
dc.contributor.author | Alenezi, Fayadh | |
dc.date.accessioned | 2023-09-07T07:11:40Z | |
dc.date.available | 2023-09-07T07:11:40Z | |
dc.date.issued | 2023 | en_US |
dc.department | BAİBÜ, Mühendislik Fakültesi, Elektrik Elektronik Mühendisliği Bölümü | en_US |
dc.description | This work was supported by the National Natural Science Foun-dation of China (62172165) ; the Science and Technology Program of Guangzhou (202102020582) ; the Natural Science Foundation of Guangdong Province (2022A1515010325) ; the Guangzhou Basic and Applied Basic Research Project (202201010742) . | en_US |
dc.description.abstract | The increasing abuse of facial manipulation methods, such as FaceSwap, Deepfakes etc., seriously threatens the authenticity of digital images/videos on the Internet. Therefore, it is of great importance to identify the facial videos to confirm the contents and avoid fake news or rumors. Many researchers have paid great attention to the detection of deepfakes and put forward a number of deep-learning-based detection models. The existing approaches mostly face the performance degradation in detecting low-quality(LQ) videos, i.e. heavily compressed or low-resolution videos through some SNS (Social Network Service), resulting in the limitation in real applications. To address this issue, in this paper, a novel Spatial Restore Detection Framework(SRDF) is proposed for improving the detection performance for LQ videos by restoring spatial features. We designed a feature extraction-enhancement block and a mapping block inspired by super-resolution methods, to restore and enhance texture features. An attention module was introduced to guide the texture features restoration and enhancement stage attending to different local areas and restoring the texture features. Besides, an improved isolated loss was put forward to prevent the expansion of a single area concerned. Moreover, we adopted a regional data augmentation strategy to prompt feature restore and enhancement in the region attended. Extensive experiments conducted on two deepfake datasets have validated the superiority of the proposed method compared to the state-of-the-art, especially in the scenarios of detecting low-quality deepfake videos. | en_US |
dc.description.sponsorship | National Natural Science Foun-dation of China [62172165]; Science and Technology Program of Guangzhou [202102020582]; Natural Science Foundation of Guangdong Province [2022A1515010325]; Guangzhou Basic and Applied Basic Research Project [202201010742] | en_US |
dc.identifier.citation | Li, Y., Bian, S., Wang, C., Polat, K., Alhudhaif, A., & Alenezi, F. (2023). Exposing low-quality deepfake videos of Social Network Service using Spatial Restored Detection Framework. Expert Systems with Applications, 120646. | en_US |
dc.identifier.doi | 10.1016/j.eswa.2023.120646 | |
dc.identifier.endpage | 14 | en_US |
dc.identifier.issn | 0957-4174 | |
dc.identifier.issn | 1873-6793 | |
dc.identifier.scopus | 2-s2.0-85162054325 | en_US |
dc.identifier.scopusquality | Q1 | en_US |
dc.identifier.startpage | 1 | en_US |
dc.identifier.uri | http://dx.doi.org/10.1016/j.eswa.2023.120646 | |
dc.identifier.uri | https://hdl.handle.net/20.500.12491/11671 | |
dc.identifier.volume | 231 | en_US |
dc.identifier.wos | WOS:001020457900001 | en_US |
dc.identifier.wosquality | Q1 | en_US |
dc.indekslendigikaynak | Web of Science | en_US |
dc.indekslendigikaynak | Scopus | en_US |
dc.institutionauthor | Polat, Kemal | |
dc.language.iso | en | en_US |
dc.publisher | Pergamon-Elsevier Science Ltd | en_US |
dc.relation.ispartof | Expert Systems with Applications | en_US |
dc.relation.publicationcategory | Makale - Uluslararası Hakemli Dergi - Kurum Öğretim Elemanı | en_US |
dc.rights | info:eu-repo/semantics/closedAccess | en_US |
dc.subject | Deepfake Detection | en_US |
dc.subject | Video Forensics | en_US |
dc.subject | Super Resolution | en_US |
dc.subject | Attention Mechanism | en_US |
dc.subject | Face | en_US |
dc.subject | Images | en_US |
dc.title | Exposing low-quality deepfake videos of Social Network Service using Spatial Restored Detection Framework | en_US |
dc.type | Article | en_US |