Research on intelligence fusion: a holistic analysis of open-source intelligence fusion from the perspective of confrontation

YUAN Weilin; ZHAO Weiwei; HU Zhenzhen; CAO Wei; HE Jun; DONG Shaojin; WANG Chengyuan; WANG Shengqing

doi:10.11959/j.issn.2096-6652.202429

您当前的位置：

首页 >

文章列表页 >

Research on intelligence fusion: a holistic analysis of open-source intelligence fusion from the perspective of confrontation

Surveys and Prospectives | 更新时间：2024-11-04

- Research on intelligence fusion: a holistic analysis of open-source intelligence fusion from the perspective of confrontation
- Chinese Journal of Intelligent Science and Technology Vol. 6, Issue 3, Pages: 284-300(2024)
- 作者机构：
  
  1.国防科技大学信息通信学院，湖北武汉 430000
  2.国防科技大学智能科学学院，湖南长沙 410073
- 作者简介：
- 基金信息：
- DOI：10.11959/j.issn.2096-6652.202429
  CLC： TP181
- Received：01 April 2024，
  
  Revised：2024-08-10，
  
  Published：15 September 2024
- 稿件说明：
移动端阅览
袁唯淋,赵卫伟,胡振震等.智能情报融合综述：对抗视角下的开源情报融合分析[J].智能科学与技术学报,2024,06(03):284-300.

YUAN Weilin,ZHAO Weiwei,HU Zhenzhen,et al.Research on intelligence fusion: a holistic analysis of open-source intelligence fusion from the perspective of confrontation[J].Chinese Journal of Intelligent Science and Technology,2024,06(03):284-300.
袁唯淋,赵卫伟,胡振震等.智能情报融合综述：对抗视角下的开源情报融合分析[J].智能科学与技术学报,2024,06(03):284-300. DOI： 10.11959/j.issn.2096-6652.202429.

YUAN Weilin,ZHAO Weiwei,HU Zhenzhen,et al.Research on intelligence fusion: a holistic analysis of open-source intelligence fusion from the perspective of confrontation[J].Chinese Journal of Intelligent Science and Technology,2024,06(03):284-300. DOI： 10.11959/j.issn.2096-6652.202429.

摘要

在“信息开放共享、万物互通互联”的数字社会，互联网中“海量、多源、爆炸式增长”的信息痕迹，为开源情报提供了富饶的“矿藏”。自然语言处理和计算机视觉等先进人工智能技术赋能的情报处理，极大提升了情报产出效率，被广泛应用于安防领域。然而，以深度伪造为代表的生成式人工智能打开了人工智能的“潘多拉魔盒”，不断被用于制造数字野火，投放虚假信息混淆视听，给智能情报融合带来巨大的挑战。为此，以开源情报为主要研究对象，深入分析开源情报特点和现有挑战；然后，综述先进人工智能技术在开源情报融合中的发展现状，从对抗视角总结现有的情报欺骗攻击方法和情报对抗防御方法；最后，提出未来智能情报融合新方向，旨在为可信情报融合分析提供借鉴，为智能态势分析与辅助决策提供支撑。

Abstract

In the digital society of "open sharing of information and interconnection of everything"

the information traces characterized with "massive

multi-source and explosive growth" in the internet provide rich "mineral deposits" for open-source intelligence collecting. Intelligence processing enabled by advanced artificial intelligence technologies

such as natural language processing and computer vision

greatly improves the efficiency of intelligence production and is widely used in the field of security. However

generative artificial intelligence represented by deepfake has opened the "Pandora's box" of artificial intelligence and is used to create digital wildfires and put false information

which confuse the public and bring crucial challenges to the integration of intelligent intelligence. This paper focuses on open-source intelligence and deeply analyzes its characteristics and existing challenges. Then

this paper summarizes the development of advanced artificial intelligence technology in opensource intelligence fusion

summarizes the existing intelligence spoofing attack methods and intelligence anti-spoofing defense methods from the perspective of confrontation. Finally

new directions of intelligence fusion in the future are proposed to provide reference for the trusted intelligence fusion and provide support for intelligent situation analysis and auxiliary decision making.

关键词

Keywords

references

崔琳, 杨黎斌, 何清林, 等. 基于开源信息平台的威胁情报挖掘综述[J]. 信息安全学报, 2022, 7(1): 1-26.

CUI L, YANG L B, HE Q L, et al. Survey of cyber threat intelligence mining based on open source information platform[J]. Journal of Cyber Security, 2022, 7(1): 1-26.

赖茂生. 情报检索技术与方法的研究综述[J]. 情报学进展, 2004, 5: 164-202.

LAI M S. A review on information retrieval techniques and methods[J]. Advances in Information Science, 2004, 5: 164-202.

刘颖, 王哲, 房杰, 等. 基于图文融合的多模态舆情分析[J]. 计算机科学与探索, 2022, 16(6): 1260-1278.

LIU Y, WANG Z, FANG J, et al. Multi-modal public opinion analysis based on image and text fusion[J]. Journal of Frontiers of Computer Science and Technology, 2022, 16(6): 1260-1278.

刘欣, 张占月, 朱丰. 空中进攻作战中天基信息支援指挥[J]. 指挥与控制学报, 2021, 7(3): 319-325.

LIU X, ZHANG Z Y, ZHU F. Space-based information support command for air offensive operation[J]. Journal of Command and Control, 2021, 7(3): 319-325.

范昊, 郑小川. 国内外开源情报研究综述[J]. 情报理论与实践, 2021, 44(10): 185-192, 201.

FAN H, ZHENG X C. A review of the research on open source intelligence at home and broad[J]. Information Studies: Theory & Application, 2021, 44(10): 185-192, 201.

桂韬, 奚志恒, 郑锐, 等. 基于深度学习的自然语言处理鲁棒性研究综述[J]. 计算机学报, 2024, 47(1): 90-112.

GUI T, XI Z H, ZHENG R, et al. Recent researches of robustness in natural language processing based on deep neural network[J]. Chinese Journal of Computers, 2024, 47(1): 90-112.

CAO Y H, LI S Y, LIU Y X, et al. A comprehensive survey of AI-generated content (AIGC): a history of generative AI from GAN to ChatGPT[EB ] . arXiv preprint, 2023, arXiv: 2303.04226 .

白如江, 鞠孜涵, 张玉洁, 等. 面向情报感知的多源多模态数据融合方法研究[J]. 情报杂志, 2023, 42(10): 124-131.

BAI R J, JU Z H, ZHANG Y J, et al. Research on multi-source and multi-mode data fusion for intelligence perception[J]. Jounal of Intelligence, 2023, 42(10): 124-131.

赵茁乔, 承楠, 陈劼, 等. 基于知识图谱的6G网络场景认知研究[J]. 智能科学与技术学报, 2023(4): 494-504.

ZHAO Z Q, CHENG N, CHEN J, et al. Research on 6G network scenario cognition based on knowledge graph[J]. Chinese Journal of Intelligent Science and Technology, 2023(4): 494-504.

王剑, 彭雨琦, 赵宇斐, 等. 基于深度学习的社交网络舆情信息抽取方法综述[J]. 计算机科学, 2022, 49(8): 279-293.

WANG J, PENG Y Q, ZHAO Y F, et al. Survey of social network public opinion information extraction based on deep learning[J]. Computer Science, 2022, 49(8): 279-293.

李玥琪. 社交网络舆情多平台主题图谱构建及风险识别研究[D]. 长春: 吉林大学, 2023.

LI Y Q. Research on the construction of multi platform theme maps for social network public opinion and risk identification[D]. Changchun: Jilin University, 2023.

ZHANG Y C, WANG Y F, FAN H, et al. Worldwide COVID-19 topic knowledge graph analysis from social media[C]//Proceedings of the 2023 International Joint Conference on Neural Networks (IJCNN). Piscataway: IEEE Press, 2023: 1-10.

苏琦, 史红权, 王义涛, 等. 海战场情报态势知识超图组织与运用[J]. 舰船电子工程, 2023, 43(8): 37-42.

SU Q, SHI H Q, WANG Y T, et al. Organizing and application of intelligence situation knowledge hyper-graph in the sea battlefield[J]. Ship Electronic Engineering, 2023, 43(8): 37-42.

ZHU X R, LI Z X, WANG X D, et al. Multi-modal knowledge graph construction and application: a survey[J]. IEEE Transactions on Knowledge and Data Engineering, 2024, 36(2): 715-735.

何俊, 张彩庆, 李小珍, 等. 面向深度学习的多模态融合技术研究综述[J]. 计算机工程, 2020, 46(5): 1-11.

HE J, ZHANG C Q, LI X Z, et al. Survey of research on multimodal fusion technology for deep learning[J]. Computer Engineering, 2020, 46(5): 1-11.

DA MATA A S. Complex networks: a mini-review[J]. Brazilian Journal of Physics, 2020, 50(5): 658-672.

胡艳丽. 在线社会网络中的舆论演化关键技术研究[D]. 长沙: 国防科学技术大学, 2011.

HU Y L. Research on key technologies of public opinion evolution in online social network[D]. Changsha: National University of Defense Technology, 2011.

黄宝成. 基于社交网络的舆情信息挖掘方法研究[D]. 哈尔滨: 哈尔滨工业大学, 2017.

HUANG B C. Research on public opinion information mining method based on social network[D]. Harbin: Harbin Institute of Technology, 2017.

艾川. 大规模复杂社会网络上传播行为建模仿真研究[D]. 长沙: 国防科技大学, 2021.

AI C. Modeling and simulation of communication behavior on large-scale complex social network[D]. Changsha: National University of Defense Technology, 2021.

张连峰, 周红磊, 王丹, 等. 基于超网络理论的微博舆情关键节点挖掘[J]. 情报学报, 2019, 38(12): 1286-1296.

ZHANG L F, ZHOU H L, WANG D, et al. Key node mining of weibo public opinion based on super network theory[J]. Journal of the China Society for Scientific and Technical Information, 2019, 38(12): 1286-1296.

党中恺. 基于复杂网络的信息传播建模与防控研究[D]. 北京: 北京邮电大学, 2022.

DANG Z K. Research on modeling and prevention of information dissemination based on complex network[D]. Beijing: Beijing University of Posts and Telecommunications, 2022.

张钹. 人工智能进入后深度学习时代[J]. 智能科学与技术学报, 2019, 1(1): 4-6.

ZHANG B. Artificial intelligence is entering the post deep-learning era[J]. Chinese Journal of Intelligent Science and Technology, 2019, 1(1): 4-6

GANDHI A, ADHVARYU K, PORIA S, et al. Multimodal sentiment analysis: a systematic review of history, datasets, multimodal fusion methods, applications, challenges and future directions[J]. Information Fusion, 2023, 91: 424-444.

ETAIWI W, SULEIMAN D, AWAJAN A. Deep learning based techniques for sentiment analysis: a survey[J]. Informatica, 2021, 45(7): 89-95.

ZHANG L, WANG S, LIU B. Deep learning for sentiment analysis: a survey[J]. WIREs Data Mining and Knowledge Discovery, 2018, 8(4): 1253-1258.

王璐, 马宏伟, 吕欢欢. 方面级文本情感分析综述[J]. 计算机应用, 2022, 42(2): 1-9.

WANG L, MA H W, LYU H H. Summary of aspect-based sentiment analysis[J]. Journal of Computer Applications, 2022, 42(2): 1-9.

LI Q D, JIN Z P, WANG C, et al. Mining opinion summarizations using convolutional neural networks in Chinese microblogging systems[J]. Knowledge-Based Systems, 2016, 107: 289-300.

DA'U A, SALIM N. Sentiment-aware deep recommender system with neural attention networks[C]//Proceedings of the IEEE Access. Piscataway: IEEE Press, 2019: 45472-45484.

MA D H, LI S J, ZHANG X D, et al. Interactive attention networks for aspect-level sentiment classification[C]//Proceedings of the Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence. California: International Joint Conferences on Artificial Intelligence Organization, 2017: 4068-4074.

WEI J Y, LIAO J, YANG Z F, et al. BiLSTM with multi-polarity orthogonal attention for implicit sentiment analysis[J]. Neurocomputing, 2020, 383: 165-173.

YANG H, ZENG B Q, YANG J H, et al. A multi-task learning model for Chinese-oriented aspect polarity classification and aspect term extraction[J]. Neurocomputing, 2021, 419: 344-356.

SONG K K, YAO T, LING Q, et al. Boosting image sentiment analysis with visual attention[J]. Neurocomputing, 2018, 312: 218-228.

于洋, 孙芳芳, 吕华, 等. 基于多尺度时空注意力网络的微表情检测方法[J]. 计算机工程, 2023, 50(6): 228-235.

YU Y, SUN F F, LYU H, et al. Micro-expression detection method based on multi-scale spationtemporal attention network[J]. Computer Engineering, 2023, 50(6): 228-235.

PLUTCHIK R. A general psychoevolutionary theory of emotion[M]//Theories of Emotion. Devon: Academic Press, 1980: 3-33.

YOU Q Z, LUO J B, JIN H L, et al. Robust image sentiment analysis using progressively trained and domain transferred deep networks[J]. Proceedings of the AAAI Conference on Artificial Intelligence, 2015, 29(1): 381-388.

LIU B. Sentiment analysis: mining opinions, sentiments, and emotions[M]. Cambridge: Cambridge university press, 2020.

ZHANG Y Y, GONG K X, ZHANG K P, et al. Meta-Transformer: a unified framework for multimodal learning[EB ] . arXiv preprint, 2023, arXiv: 2307.10802 .

TANG J J, LI K, JIN X Y, et al. CTFN: hierarchical learning for multimodal sentiment analysis using coupled-translation fusion network[C]//Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing. Stroudsburg: Association for Computational Linguistics, 2021: 5301-5311.

彭勇, 彭旋, 郑志军, 等. 多模态大模型: 技术原理与实战[M]. 北京: 电子工业出版社, 2023.

PENG Y, PENG X, ZHENG Z J, et al. Multimodal large model: technical principles and practical applications[M]. Beijing: Publishing House of Electronics Industry, 2023.

蔡国永, 夏彬彬. 基于卷积神经网络的图文融合媒体情感预测[J]. 计算机应用, 2016, 36(2): 428-431, 477.

CAI G Y, XIA B B. Multimedia sentiment analysis based on convolutional neural network[J]. Journal of Computer Applications, 2016, 36(2): 428-431, 477.

YOU Q Z, LUO J B, JIN H L, et al. Cross-modality consistent regression for joint visual-textual sentiment analysis of social multimedia[C]//Proceedings of the Ninth ACM International Conference on Web Search and Data Mining. New York: ACM, 2016: 13-22.

MAJUMDER N, HAZARIKA D, GELBUKH A, et al. Multimodal sentiment analysis using hierarchical fusion with context modeling[J]. Knowledge-Based Systems, 2018, 161: 124-133.

黄峻, 林飞, 杨静, 等. 生成式AI的大模型提示工程:方法、现状与展望[J]. 智能科学与技术学报, 2024, 6(2): 115-133.

HUANG J, LIN F, YANG J, et al. From prompt engineering to generative artificial intelligence for large models: the state of the art and perspective[J]. Chinese Journal of Intelligent Science and Technology, 2024, 6(2): 115-133.

李荣, 吴晨生, 董洁, 等. ChatGPT对开源情报工作的影响及对策[J]. 情报理论与实践, 2023, 46(5): 1-5.

LI R, WU C S, DONG J, et al. Study on the Impact of ChatGPT on open source intelligence work and countermeasures[J]. Information Studies: Theory & Application, 2023, 46(5): 1-5.

LIU H T, LI C Y, WU Q Y, et al. Visual instruction tuning[EB ] . arXiv preprint, 2023, arXiv: 2304.08485 .

BAI Y T, GENG X Y, MANGALAM K, et al. Sequential modeling enables scalable learning for large vision models[EB ] . arXiv preprint, 2023, arXiv: 2312.00785 .

GAO P, HAN J M, ZHANG R R, et al. LLaMA-Adapter v2: parameter-efficient visual instruction model[EB ] . arXiv preprint, 2023, arXiv: 2304.15010 .

DAI W L, LI J N, LI D X, et al. InstructBLIP: towards general-purpose vision-language models with instruction tuning[EB]. arXiv preprint, 2023, arXiv: 2305.06500

HUA W Y, FAN L Z, LI L Y, et al. War and peace (waragent): large language model-based multi-agent simulation of world wars[EB ] . arXiv preprint, 2023, arXiv: 2311.17227 .

BI K F, XIE L X, ZHANG H H, et al. Accurate medium-range global weather forecasting with 3D neural networks[J]. Nature, 2023, 619(7970): 533-538.

VYKOPAL I, PIKULIAK M, SRBA I, et al. Disinformation capabilities of large language models[EB ] . arXiv preprint, 2023, arXiv: 2311.08838 .

EMRE K, ROBERT O, AMIT S, et al. Causal reasoning and large language models: opening a new frontier for causality[EB ] . arXiv preprint, 2023, arXiv: 2305.00050 .

SU J W, VARGAS D V, SAKURAI K. One pixel attack for fooling deep neural networks[J]. IEEE Transactions on Evolutionary Computation, 2019, 23(5): 828-841.

MIRSKY Y, LEE W. The creation and detection of deepfakes: a survey[J]. ACM Computing Surveys, 2020, 54: 1-41.

GOODFELLOW I J, SHLENS J, SZEGEDY C. Explaining and harnessing adversarial examples[EB ] . arXiv preprint, 2014, arXiv: 1412.6572 .

KURAKIN A, GOODFELLOW I J, BENGIO S. Adversarial examples in the physical world[M]//Artificial Intelligence Safety and Security. Florida: Chapman and Hall/CRC, 2018: 99-112.

MOOSAVI-DEZFOOLI S M, FAWZI A, FROSSARD P. DeepFool: a simple and accurate method to fool deep neural networks[C]//Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition(CVPR). Piscataway: IEEE Press, 2016: 2574-2582.

PAPERNOT N, MCDANIEL P, JHA S, et al. The limitations of deep learning in adversarial settings[C]//Proceedings of the 2016 IEEE European Symposium on Security and Privacy (EuroS&P). Piscataway: IEEE Press, 2016: 372-387.

CHEN P Y, ZHANG H, SHARMA Y, et al. ZOO: zeroth order optimization based black-box attacks to deep neural networks without training substitute models[C]//Proceedings of the 10th ACM Workshop on Artificial Intelligence and Security. New York: ACM, 2017: 15-26.

CHEN S Z, HE Z B, SUN C J, et al. Universal adversarial attack on attention and the resulting dataset DAmageNet[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2022, 44(4): 2188-2197.

MOOSAVI-DEZFOOLI S M, FAWZI A, FAWZI O, et al. Universal adversarial perturbations[C]//Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition(CVPR). Piscataway: IEEE Press, 2017: 86-94.

CHEN G K, CHENB S, FAN L L, et al. Who is real bob? adversarial attacks on speaker recognition systems[C]//Proceedings of the 2021 IEEE Symposium on Security and Privacy (SP). Piscataway: IEEE Press, 2021: 694-711.

CISSE M, ADI Y, NEVEROVA N, et al. Houdini: Fooling deep structured prediction models[EB ] . arXiv preprint, 2017, arXiv: 1707.05373 .

NEWELL A, YANG K, DENG J. Stacked hourglass networks for human pose estimation[C]//Proceedings of the 14th European Conference on Computer Vision. Cham: Springer, 2016: 483-499.

THYS S, VAN RANST W, GOEDEMÉ T. Fooling automated surveillance cameras: adversarial patches to attack person detection[C]//Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). Piscataway: IEEE Press, 2019: 49-55.

LIU A S, LIU X L, FAN J X, et al. Perceptual-sensitive GAN for generating adversarial patches[J]. Proceedings of the AAAI Conference on Artificial Intelligence, 2019, 33(1): 1028-1035.

WEI X X, RUAN S W, DONG Y P, et al. Distributional modeling for location-aware adversarial patches[EB ] . arXiv preprin t, 2023, arXiv: 2023.16131 .

DUAN R J, MA X J, WANG Y S, et al. Adversarial camouflage: hiding physical-world attacks with natural styles[C]//Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Piscataway: IEEE Press, 2020: 997-1005.

WEI X X, HUANG Y, SUN Y T, et al. Unified adversarial patch for cross-modal attacks in the physical world[C]//Proceedings of the 2023 IEEE/CVF International Conference on Computer Vision (ICCV). Piscataway: IEEE Press, 2023: 4422-4431.

AKHTAR N, MIAN A, KARDAN N, et al. Advances in adversarial attacks and defenses in computer vision: a survey[J]. IEEE Access, 2021, 9: 155161-155196.

GOODFELLOW I J, POUGET-ABADIE J, MIRZA M, et al. Generative adversarial networks[EB ] . arXiv preprint, 2014, arXiv: 1406.2661 .

ISOLA P, ZHU J Y, ZHOU T H, et al. Image-to-image translation with conditional adversarial networks[C]//Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Piscataway: IEEE Press, 2017: 5967-5976.

ZHU J Y, PARK T, ISOLA P, et al. Unpaired image-to-image translation using cycle-consistent adversarial networks[C]//Proceedings of the 2017 IEEE International Conference on Computer Vision(ICCV). Piscataway: IEEE Press, 2017: 2242-2251.

KINGMA D P, WELLING M. Auto- encoding variational bayes[EB ] . arXiv preprint, 2013, arXiv: 1312.6114 .

REZENDE D J, MOHAMED S. Variational inference with normalizing flows[EB ] . arXiv preprint, 2015, arXiv: 1505.05770 .

HO J, JAIN A, ABBEEL P. Denoising diffusion probabilistic models[J]. Advances in Neural Information Processing Systems, 2020, 33: 6840-6851.

POPOV V, VOVK I, GOGORYAN V, et al. Grad-TTS: a diffusion probabilistic model for text-to-speech[EB ] . arXiv preprint, 2021, arXiv: 2105.06337 .

SAHARIA C, CHAN W, SAXENA S, et al. Photorealistic text-to-image diffusion models with deep language understanding[J]. Advances in Neural Information Processing Systems, 2022, 35: 36479-36494.

MOLAD E, HORWITZ E, VALEVSKI D, et al. Dreamix: video diffusion models are general video editors[EB ] . arXiv preprint, 2023, arXiv: 2302.01329 .

WU J Z, GE Y X, WANG X T, et al. Tune-A-video: one-shot tuning of image diffusion models for text-to-video generation[C]//Proceedings of the 2023 IEEE/CVF International Conference on Computer Vision (ICCV). Piscataway: IEEE Press, 2023: 7589-7599.

WU X, HE R, SUN Z N, et al. A light CNN for deep face representation with noisy labels[J]. IEEE Transactions on Information Forensics and Security, 2018, 13(11): 2884-2896.

LIU H X, SIMONYAN K, YANG Y M. DARTS: differentiable architecture search[EB ] . arXiv preprint, 2018, arXiv: 1806.09055 .

LI X, LI N, WENG C, et al. Replay and synthetic speech detection with Res2Net architecture[C]//Proceedings of the ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). Piscataway: IEEE Press, 2021: 6354-6358.

周文柏, 张卫明, 俞能海, 赵汉卿, 刘泓谷, 韦天一. 人脸视频深度伪造与防御技术综述[J]. 信号处理, 2021, 37(12): 2338-2355.

ZHOU W B, ZHANG W M, YU N H, et al. An overview of deepfake forgery and defense techniques[J]. Journal Of Signal Processing, 2021, 37(12): 2338-2355.

DOLHANSKY B, BITTON J, PFLAUM B, et al. The DeepFake detection challenge (DFDC) dataset[EB ] . arXiv preprint, 2020, arXiv: 2006.07397 .

JIANG L M, LI R, WU W, et al. DeeperForensics-1.0: a large-scale dataset for real-world face forgery detection[C]//Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Piscataway: IEEE Press, 2020: 2886-2895.

JIN Z W, CAO J, GUO H, et al. Multimodal fusion with recurrent neural networks for rumor detection on microblogs[C]//Proceedings of the 25th ACM international conference on Multimedia. New York: ACM, 2017: 795-816.

LI Y Z, LYU S W. Exposing deepfake videos by detecting face warping artifacts[EB ] . arXiv preprint, 2019, arXiv: 1811.00656 .

YANG X, LI Y Z, QI H G, et al. Exposing GAN-synthesized faces using landmark locations[C]//Proceedings of the ACM Workshop on Information Hiding and Multimedia Security. New York: ACM, 2019: 113-118.

HE P S, LI H L, WANG H X. Detection of fake images via the ensemble of deep representations from multi color spaces[C]//Proceedings of the 2019 IEEE International Conference on Image Processing (ICIP). Piscataway: IEEE Press, 2019: 2299-2303.

SEGALIS E, GALILI E. OGAN: disrupting deepfakes with an adversarial attack that survives training[EB ] . arXiv preprint, 2020, arXiv: 2006.12247 .

BALLESTEROS D M, RODRIGUEZ-ORTEGA Y, RENZA D, et al. Deep4SNet: deep learning for fake speech classification[J]. Expert Systems with Applications, 2021, 184: 115465.

ANEJA S, BREGLER C, NIESSNER M. COSMOS: catching out-of-context misinformation with self-supervised learning [EB ] . arXiv preprint, 2021, arXiv: 2101.06278 .

WANG R, JUEFEI-XU F, LUO M, et al. FakeTagger: robust safeguards against DeepFake dissemination via provenance tracking[C]//Proceedings of the 29th ACM International Conference on Multimedia. New York: ACM, 2021: 3546-3555.

ZHANG Y X, WANG W C, ZHANG P Y. The effect of silence and dual-band fusion in anti-spoofing system[C]//Proceedings of the Interspeech 2021. ISCA: ISCA, 2021: 4279-4283.

WODAJO D, ATNAFU S. Deepfake video detection using convolutional vision transformer[EB ] . arXiv preprint, 2021, arXiv: 2102.11126 .

ZHAO Y, YI J Y, TAO J H, et al. EmoFake: an initial dataset for emotion fake audio detection[EB ] . arXiv preprint, 2022, arXiv: 2211.05363 .

WANG Y Q, MA F L, JIN Z W, et al. EANN: event adversarial neural networks for multi-modal fake news detection[C]//Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. New York: ACM, 2018: 849-857.

ABDELNABI S, HASAN R, FRITZ M. Open-domain, content-based, multi-modal fact-checking of out-of-context images via online resources[C]//Proceedings of the 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Piscataway: IEEE Press, 2022: 14920-14929.

SHAO R, WU T X, LIU Z W. Detecting and grounding multi-modal media manipulation[C]//Proceedings of the 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Piscataway: IEEE Press, 2023: 6904-6913.

SHA Z Y, LI Z, YU N, et al. DE-FAKE: detection and attribution of fake images generated by text-to-image generation models[C]//Proceedings of the 2023 ACM SIGSAC Conference on Computer and Communications Security. New York: ACM, 2023: 3418-3432.

YANG X, LI Y Z, LYU S W. Exposing deep fakes using inconsistent head poses[C]//Proceedings of the ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). Piscataway: IEEE Press, 2019: 8261-8265.

LI H D, LI B, TAN S Q, et al. Detection of deep network generated images using disparities in color components[EB ] . arXiv preprint, 2018, arXiv: 1808.07276 .

WANG J, LI Z, ZHANG C, et al. Fighting malicious media data: a survey on tampering detection and deepfake detection[EB ] . arXiv preprint, 2022, arXiv: 2212.05667 .

FUNG S, LU X Q, ZHANG C, et al. DeepfakeUCL: deepfake detection via unsupervised contrastive learning[C]//Proceedings of the 2021 International Joint Conference on Neural Networks (IJCNN). Piscataway: IEEE Press, 2021: 1-8.

CAO J Y, MA C, YAO T P, et al. End-to-end reconstruction-classification learning for face forgery detection[C]//Proceedings of the 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Piscataway: IEEE Press, 2022: 4103-4112.

WANG C R, DENG W H. Representative forgery mining for fake face detection[C]//Proceedings of the 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Piscataway: IEEE Press, 2021: 14918-14927.

LIU H G, LI X D, ZHOU W B, et al. Spatial-phase shallow learning: rethinking face forgery detection in frequency domain[C]//Proceedings of the 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Piscataway: IEEE Press, 2021: 772-781.

BINH L M, WOO S. ADD: frequency attention and multi-view based knowledge distillation to detect low-quality compressed deepfake images[J]. Proceedings of the AAAI Conference on Artificial Intelligence, 2022, 36(1): 122-130.

YI J Y, WANG C L, TAO J H, et al. Audio deepfake detection: a survey[EB ] . arXiv preprint, 2023, arXiv: 2308.14970 .

ALZANTOT M, WANG Z Q, SRIVASTAVA M B. Deep residual neural networks for audio spoofing detection[EB ] . arXiv preprint, 2019, arXiv: 1907.00501 .

CHEN T X, KHOURY E, PHATAK K, et al. Pindrop labs' submission to the ASVspoof 2021 challenge[C]//Proceedings of the 2021 Edition of the Automatic Speaker Verification and Spoofing Countermeasures Challenge. ISCA: ISCA, 2021: 89-93.

TODISCO M, DELGADO H, EVANS N. Constant Q cepstral coefficients: a spoofing countermeasure for automatic speaker verification[J]. Computer Speech & Language, 2017, 45: 516-535.

HE K M, ZHANG X Y, REN S Q, et al. Deep residual learning for image recognition[C]//Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Piscataway: IEEE Press, 2016: 770-778.

HU J, SHEN L, SUN G. Squeeze-and-excitation networks[C]//Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE Press, 2018: 7132-7141.

AL-QURISHI M, AL-RAKHAMI M, ALRUBAIAN M, et al. Selecting the best open source tools for collecting and visualzing social media content[C]//Proceedings of the 2015 2nd World Symposium on Web Applications and Networking(WSWAN). Piscataway: IEEE Press, 2015: 1-6.

ZUBIAGA A, AKER A, BONTCHEVA K, et al. Detection and resolution of rumours in social media[J]. ACM Computing Surveys, 2019, 51(2): 1-36.

CASTILLO C, MENDOZA M, POBLETE B. Information credibility on twitter[C]//Proceedings of the 20th International Conference on World Wide Web. New York: ACM, 2011: 675-684.

VOSOUGHI S, MOHSENVAND M N, ROY D. Rumor gauge[J]. ACM Transactions on Knowledge Discovery from Data, 2017, 11(4): 1-36.

ZUBIAGA A, LIAKATA M, PROCTER R, et al. Analysing how people orient to and spread rumours in social media by looking at conversational threads[J]. PLoS One, 2016, 11(3): e0150989.

ZUBIAGA A, LIAKATA M, PROCTER R. Learning reporting dynamics during breaking news for rumour detection in social media[EB ] . arXiv preprint, 2016, arXiv: 1610.07363 .

BONDIELLI A, MARCELLONI F. A survey on fake news and rumour detection techniques[J]. Information Sciences, 2019, 497: 38-55.

RUIZ N, BARGAL S A, SCLAROFF S. Disrupting deepfakes: adversarial attacks against conditional image translation networks and facial manipulation systems[M]//Lecture Notes in Computer Science. Cham: Springer International Publishing, 2020: 236-251.

YANG C F, DING L, CHEN Y R, et al. Defending against GAN-based DeepFake attacks via transformation-aware adversarial faces[C]//Proceedings of the 2021 International Joint Conference on Neural Networks (IJCNN). Piscataway: IEEE Press, 2021: 1-8.

白如江, 张玉洁, 赵梦梦, 等. 面向关联推理的智慧情报感知:内涵、组织与路径[J]. 情报理论与实践, 2022, 45(8): 31.

BAI R J, ZHANG Y J, ZHAO M M, et al. Intelligence perception for association and reasoning: connotation,organization and path[J]. Information studies: Theory & Application. 2022, 45(8): 31.

WILLCOX S, GOLDBERG D, VAGANAY J, et al. Multi-vehicle cooperative navigation and autonomy with the bluefin cadre system[C]//Proceedings of IFAC(International Federation of Automatic Control) Conference. Oxford: Elsevier, 2006: 20-22.

BIRK A, ANTONELLI G, PASCOAL A, et al. Cognitive cooperative control for autonomous underwater vehicles[C]//Proceedings of 8th International Conference on Computer and IT Applications in the Maritime Industries. Oxford: Elsevier, 2009: 136-149.

龚胜佳, 张琳琳, 赵楷, 等. 基于区块链技术的虚假新闻检测方法[J]. 计算机应用, 2022, 42(11): 3458-3464.

GONG S J, ZHANG L L, ZHAO K, et al. Fake news detection method based on blockchain technology[J]. Journal of Computer Applications, 2022, 42(11): 3458-3464.

陈晋音, 章燕, 王雪柯, 等. 深度强化学习的攻防与安全性分析综述[J]. 自动化学报, 2022, 48(1): 21-39.

CHEN J Z, ZHANG Y, WANG X K, et al. A survey of attack, defense and related security analysis for deep reinforcement learning[J]. Acta Automatica Sinica, 2022, 48(1): 21-39.

MA F, LI Y, LI Q, et al. Faitcrowd: fine grained truth discovery for crowdsourced data aggregation[C]//Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. New York: Association for Machinery, 2015: 745-754.

易侃, 徐欣. 面向深度伪造的情报可信分析机理[J]. 指挥信息系统与技术, 2023, 14(1): 48-56.

YI K, XU X. Intelligence trustworthiness analysis mechanism for deep falsification[J]. Command Information System And Technology, 2023, 14(1): 48-56.

颜克冬, 徐琳, 宫小泽, 等. 开源情报可信分析系统的关键模型与技术[J]. 指挥信息系统与技术, 2023, 14(1): 57-61.

YAN K D, XU L, GONG X Z, et al. Key models and technologies of open source intelligence trustworthy analysis system[J]. Command Information System And Technology, 2023, 14(1): 57-61.

DU M, LIU N, HU X. Techniques for interpretable machine learning[J]. Communications of the ACM, 2019, 63(1): 68-77.

吴明曦. 智能化战争[M]. 北京: 国防工业出版社, 2020.

WU M X. Intelligent warfare[M]. Beijing: National Defense Industry Press, 2020.

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Cerberus: a cross-site social bot detection system based on deep learning

Related Author

No data

Related Institution

No data

Postal code：100079
Tel：（010）53879206 Email：cjist@bjxintong.com.cn
Technical support is provided by Beijing Founder electronics co., LTD 京ICP备09064830号-19 京公网安备11010802024621
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.
Total Visits：161982 Visits Today：145

⁰