Malicious use of artificial intelligence and challenges to psychological security in China
DOI:
https://doi.org/10.21638/spbu06.2024.201Abstract
Economic problems, institutional degradation, social polarization, rising political tensions, and the interstate conflicts are all occurring alongside rapid AI development, creating extremely favorable grounds for its malicious use. The practice of using AI to destabilize the economy, political institutions and international relations through targeted psychological influence is growing rapidly. This article focuses on the current and future threats to China’s psychological security caused by the malicious use of AI, as well as the response measures taken by the Chinese government. The experience of China is important due to its role in global economy and international affairs, as well the country’s leadership in numerous areas of development and implementation of AI technologies. At the same time, China is facing internal and external challenges that create a fertile ground for malicious use of AI. The article contributors paid special attention to such threats in the field of psychological security of China as malicious use of deepfakes and chatbots, the role of AI in cognitive warfare, phishing and social engineering, etc. The article is written within the framework of the methodology of political science, but it has elements of an interdisciplinary approach, when AI technologies allow obtaining a more accurate, quantifiable answer to some research questions.
Keywords:
China, psychological security, psychological warfare, cognitive warfare, social engineering, malicious use, artificial intelligence, deepfakes, chatbots
Downloads
References
Artificial Intelligence Index Report (2023), Stanford University.
How Artificial Intelligence Changes the Media Industry, Danghong Technology Gives More Possibilities (2023). Аvailable at: https://www.arcvideo.cn/xinwendongtai/454.html (accessed: 12.12.2023).
Wang, D. (2022), Threats and Countermeasures of Malicious Use of Artificial Intelligence. Аvailable at: https://www.cnki.com.cn/Article/CJFDTOTAL-CINS201908008.htm (accessed: 12.12.2023).
White Paper on the Development of Beijing Artificial Intelligence Industry in 2022” is released (2023). Аvailable at: http://www.beijing.gov.cn/ywdt/gzdt/202302/t20230214_2916514.html (accessed: 12.12.2023).
Chinese expert: ChatGPT is AI’s “moon landing” moment, but there are still hidden dangers behind it (2021). Аvailable at: https://new.qq.com/rain/a/20230210A04OXN00 (accessed: 12.12.2023).
Qi, J. (2019), Seize the commanding heights of artificial intelligence technology development. Аvailable at: http://www.81.cn/jfjbmap/content/2019-07/25/content_239260.htm (accessed: 12.12.2023).
Afolabi, O. A. and Balogun, A. G. (2017), Impacts of psychological security, emotional intelligence and self-efficacy on undergraduates’ life satisfaction, Psychological Thought, no. 10 (2), pp. 247–261.
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L. and Stoyanov, V. (2019), A robustly optimized bert pretraining approach. arXiv preprint arXiv:1907.11692.
Barishpolets, V. A. (2013), Informational and psychological security: Main principles. Radioelektronika. Nanosistemy, Informatsionnye tehnologii, no. 2, pp. 62–104.
Barishpolets, V. A. (ed.) (2012), Fundamentals of the psychological security, Moscow: Znanie Publ. (In Russian)
Blauth, T. F., Gstrein, O. J. and Zwitter, A., (2022), Artificial intelligence crime: An overview of malicious use and abuse of AI, IEEE Access, vol. 10, pp. 77110–77122. https://doi.org/10.1109/ACCESS.2022.3191790
Brundage, M., Avin Sh., Clark, J., Toner, H., Eckersley, P., Garfinkel, B., Dafoe, A., Scharre, P., Zeitzoff, Th., Filar, B., Anderson, H., Roff, H., Allen, G. C., Steinhardt, J., Flynn, C., Ó hÉigeartaigh, S., Beard, S., Belfield, H., Farquhar, S., Lyle, C., Crootof, R., Evans, O., Page, M. Bryson, J., Yampolskiy, R. and Amodei, D. (2018), The Malicious Use of Artificial Intelligence: Forecasting, Prevention, and Mitigation, Oxford: Future of Humanity Institute, University of Oxford.
Caldwell, M., Andrews, J. T. A., Tanay, T. and Griffin, L. D. (2020), AI-enabled future crime, Crime Science, no. 9, article 14. https://doi.org/10.1186/s40163-020-00123-8
Malicious Uses and Abuses of Artificial Intelligence (2020), Trend Micro Research, United Nations Interregional Crime and Justice Research Institute (UNICRI), Europol’s European Cybercrime Centre (EC3). Аvailable at: https://documents.trendmicro.com/assets/white_papers/wp-malicious-uses-and-abuses-ofartificial-intelligence.pdf (accessed: 12.12.2023).
Pashentsev, E. (2023), General Content and Possible Threat Classifications of the Malicious Use of Artificial Intelligence to Psychological Security, in: Pashentsev, E. (ed.), The Palgrave Handbook of Malicious Use of AI and Psychological Security, Cham: Palgrave Macmillan, pp. 23–46.
ZAO is hot but destined to be short-lived: face-changing attacks have always existed? (2019). Аvailable at: https://mp.weixin.qq.com/s?__biz=Mzg3MDEwODYzMg==&mid=2247495227&idx=1&sn=38f1cdb890fa05abebe0ef6543feebbc&chksm=ce90728cf9e7fb9adb52183a1a87e5252b39b60957c2d5040decce67a8953-fccea5ba546539crd (accessed: 12.12.2023).
Wang, F. (2023), AI is a double-edged sword. Аvailable at: http://www.bj.xinhuanet.com/fangtan2017/jqrdh2017/wfy.htm (accessed: 12.12.2023).
The State Internet Information Office and other three departments issued the “Regulations on the Administration of Deep Synthesis of Internet Information Services” (2022). Аvailable at: http://www.cac.gov.cn/2022-12/11/c_1672221949318230.htm (accessed: 12.12.2023).
Chinese tech giant Tencent hit by phishing QR codes (2022). Аvailable at: https://www.itsec.ru/news/kitayskiy-technogigant-tencent-podvergsia-atake-s-ispolzovaniyem-fishingovih-qr-kodov (accessed: 12.12.2023).
Dillon, K. and Raasch, J. M. (2022), ‘Can’t tie our own hands’: Presidential candidate warns an AI pause for US means ‘China running with it’. Аvailable at: https://www.foxnews.com/politics/cant-tie-handspresidential-candidate-warns-ai-pause-us-means-china-running (accessed: 12.12.2023).
Bazarkina, D. and Pashentsev, E. (2020), Malicious Use of Artificial Intelligence: New Psychological Security Risks in BRICS Countries, Russia in Global Affairs, vol. 18, no. 4, pp. 154–177. https://doi.org/10.31278/1810-6374-2020-18-4-154-177
Bazarkina, D., Mikhalevich, E., Pashentsev, E. and Matyashova, D. (2023), The Threats and Current Practices of Malicious Use of Artificial Intelligence in Psychological Security in China, in: Pashentsev, E. (ed.), The Palgrave Handbook of Malicious Use of AI and Psychological Security, Cham: Palgrave Macmillan, pp. 419–451.
Watts, W. (2019), Soros blasts China’s Xi as ‘most dangerous opponent’ of open societies. Аvailable at: https://www.marketwatch.com/story/george-soros-blasts-chinas-xi-as-most-dangerous-opponent-ofopen-societies-2019-01-24?siteid=yhoof2&yptr=yahoo (accessed: 12.12.2023).
Nair, C. (2023), Anti-China rhetoric is off the charts in Western media. Аvailable at: https://thediplomat.com/2023/02/anti-china-rhetoric-is-off-the-charts-in-western-media/ (accessed: 12.12.2023).
Wang, P. (2023), Interpreting the National Data Bureau — Digital China construction ushers in significant development opportunities. Аvailable at: https://column.chinadaily.com.cn/a/202303/09/WS-640987b9a3102ada8b232b7a.html (accessed: 12.12.2023).
Bazarkina, D. and Pashentsev, E. (2019), Artificial Intelligence and New Threats to International Psychological Security. Аvailable at: https://eng.globalaffairs.ru/articles/artificial-intelligence-and-new-threatsto-international-psychological-security/ (accessed: 12.12.2023).
Suspected BITTER APT Continues Targeting Government of China and Chinese Organizations (2019). Аvailable at: https://www.anomali.com/blog/suspected-bitter-apt-continues-targeting-government-of-china-and-chinese-organizations (accessed: 12.12.2023).
Anomali discovers phishing campaign targeting Chinese government agencies (2019). Аvailable at: https://www.helpnetsecurity.com/2019/08/12/phishing-chinese-government-agencies/ (accessed: 12.12.2023).
Frank, J. (2023), China is Deleting Hundreds of Thousands of AI-Generated News Accounts and Postshttps. Аvailable at://www.business2community.com/tech-news/china-is-deleting-hundreds-of-thousandsof-ai-generated-news-accounts-and-posts-02692962 (accessed: 12.12.2023).
Top fakes about coronavirus COVID-19 (2021). Аvailable at: https://www.ntv.ru/cards/4321/ (accessed: 12.12.2023).
Sharma, R. (2023), Amazing ChatGPT Statistics for May 2023. Аvailable at: https://contentdetector.ai/articles/chatgpt-statistics (accessed: 12.12.2023).
Education, sales, financial analysis, content generation: Chinese tech companies are rushing to create analogues of ChatGPT (2023). Аvailable at: https://www.ixbt.com/news/2023/02/11/obrazovanie-prodazhifinansovyj-analiz-generacija-kontenta-kitajskie-tehnologicheskie-kompanii-speshno-sozdajut-analogi.html (accessed: 12.12.2023).
GPT-4 System Card (2023). Аvailable at: https://cdn.openai.com/papers/gpt-4-system-card.pdf (accessed: 12.12.2023).
Why Chatbot AI Is a Problem for China (2023). Аvailable at: https://www.theatlantic.com/international/archive/2023/04/chatbot-ai-problem-china/673754/ (accessed: 12.12.2023).
Sadeghi, M. and Arvanitis, L. (2023), Rise of the Newsbots: AI-Generated News Websites Proliferating Online. Аvailable at: https://www.newsguardtech.com/special-reports/newsbots-ai-generated-news-websites-proliferating/ (accessed: 12.12.2023).
Dobberstein, L. (2023), China cracks down on AI-generated news anchors. Аvailable at: https://www.theregister.com/2023/05/16/china_crackdown_on_ai_generated_news/ (accessed: 12.12.2023).
SideWinder militantly masquerades as Pakistani and Chinese government agencies in their latest attacks (2023). Аvailable at: https://www.securitylab.ru/news/538242.php (accessed: 12.12.2023).
Interesse, G. (2022), China’s Debut in the Metaverse: Trends to Watch (Updated). Аvailable at: https://www.china-briefing.com/news/metaverse-in-china-trends/ (accessed: 12.12.2023).
Zhiwei, Z. (2022), Cognitive Domain Operations from the Perspective of Intelligence: Emotional Conflict Becomes a Prominent Attribute of Cognitive Domain Operations. Аvailable at: http://www.81.cn/yw_208727/10204158.html (accessed: 12.12.2023).
Yang, L. (2023), Aiming at future wars and fighting the cognitive “five battles”. Аvailable at: http://www.81.cn/ll_208543/10179953.html (accessed: 12.12.2023).
Yang, C. (2022), Take the pulse of quasi-cognitive domain combat. Аvailable at: http://www.81.cn/jfjbmap/content/2022-08/16/content_322064.htm (accessed: 12.12.2023).
Sun, Z. and Sun, H. (2022), Exploring the way to win the battle in the cognitive domain. Аvailable at: http://www.81.cn/jfjbmap/content/2022-09/01/content_323230.htm (accessed: 12.12.2023).
Pashentsev, E. (2022), Experts on the Malicious Use of Artificial Intelligence and Challenges to Intrnational Psychological Security, Moscow: ICSPSC Publ.
Artificial Intelligence Generated Content (AIGC) White Paper (2022). Аvailable at: http://www.caict.ac.cn/english/research/whitepapers/202211/P020221111501862950279.pdf (accessed: 12.12.2023).
About AIGC-X (2023). Available at: http://ai.sklccc.com/AIGC-X/ (accessed: 12.12.2023).
AI generated content can be detected (2023). Аvailable at: https://www.163.com/dy/article/HUOPFFAG0514R9M0.html (accessed: 12.12.2023).
Bohui Technology Educational Product Upgrade Debuts Attracts Attention (2023). Аvailable at: http://www.bohui.com.cn/index/news/news_details.html?id=635 (accessed: 12.12.2023).
Yang, Y., Goh, B. and Gibbs, E. (ed.) (2020), China seeks to root out fake news and deepfakes with new online content rules. Аvailable at: https://www.reuters.com/article/us-china-technology/china-seeks-to-rootout-fake-news-and-deepfakes-with-new-online-content-rules-idUSKBN1Y30VU (accessed: 12.12.2023).
Provisions on the Administration of Internet Information Service Algorithm Recommendations (2022). Аvailable at: http://www.cac.gov.cn/2022-01/04/c_1642894606364259.htm (accessed: 12.12.2023).
Song, S. (2023), The Latest Draft Measures on the Management of Generative AI. Аvailable at: https://www.lexology.com/library/detail.aspx?g=9779b7fa-64dd-472a-8b7d-39149b4d3a21 (accessed: 12.12.2023).
Position Paper of the People’s Republic of China on Strengthening Ethical Governance of Artificial Intelligence (2022). Аvailable at: https://www.fmprc.gov.cn/mfa_eng/wjdt_665385/wjzcs/202211/t20221117_10976730.html (accessed: 12.12.2023).
Downloads
Published
How to Cite
Issue
Section
License
Articles of "Vestnik of Saint Petersburg University. International relations" are open access distributed under the terms of the License Agreement with Saint Petersburg State University, which permits to the authors unrestricted distribution and self-archiving free of charge.
