자율살상무기(Lethal Autonomous System)와 인간 인식론의 동기화: AI-LAWS에 대한 윤리적 문제와 다면적책임체제(Multi-faceted Responsiblity System) = Synchronizing AI and Human Epistemology: E thical Issues and Multi-faceted Responsibility System in the Use of AI Lethal Autonomous Weapons

국문 초록 (Abstract)

본 연구는 신기술 발전에 따른 자율살상무기시스템 진화가 가져온 전쟁윤리와 국제인도주의법(International Humanitarian Law, IHL) 간의 비대칭성을 살펴보며, 전쟁범죄에 대한 책임체계의 필요성과 그 논의 토대를 구상하는 것을 목적으로 한다.
이를 위해 본 연구는 자율살상무기시스템 발전과 전쟁 윤리와 IHL 비대칭적 발전을 살펴보며, 이를 기반으로 앞으로 AI-LAWS에 대한 규범 및 규제의 토대와 방향성을 구상해 보았다. 이를 통해 인간의 총체적 인식과 AI의 가산적 정의에 기반한 인식의 차이가 결국 국제법 적용의 차이와 한계를 만들어 냈다는 것을 밝혀 냄으로써 이런 변화에 조응하는 다차원적 윤리성과 이에 대한 책임체제 또한 분산되어야 한다는 결론에 도달했다.
본연구는 기계의 인식체계에 기반하여 현행 IHL과 전쟁 윤리 검토해 보았다는 점에서 학문적 유의미성을 찾을 수 있을 것이다. 더불어 이에 기반해 LAWS에 대한 책임 체제를 논의로 일정한 대안의 토대를 검토한 점은 일부 공헌이라 하겠다.

다국어 초록 (Multilingual Abstract)

This study examines the development of Lethal Autonomous Weapon Systems (LAWS) and the asymmetrical development of warfare ethics and International Humanitarian Law (IHL) to envision the foundation and direction of norms and regulatory frameworks for AI-LAWS, as well as a system for imposing accountability. Accordingly, this study develops a discussion around autonomous combat weapons and robots based on AI technology. In this way, the study critically examines how military weapons being developed with emerging technology may conflict with existing international laws such as IHL and the Law of Armed Conflict, and with the ethics of war. In particular, this review analyzes the cognitive system of AI-LAWS from both technical and philosophical perspectives, considering that international laws are constructed with humans at the center of armed conflict situations. The analysis shows that the difference between holistic human perception and perceptions about AI based on coutable definitions creates significant differences and limitations in the application of international laws. In other words, the difference between perception systems and operation systems raises the need for multidimensional ethics, and therefore the accountability system should be decentralized.
The academic significance of this study lies in its scientific and technical review of LAWS as they are deployed and operated in armed conflict, alongside a philosophical examination of their cognitive systems through the lens of current IHL and the ethics of war. Additionally, the study contributes to the field by exploring the foundation of potential alternatives, particularly in discussing the accountability system for LAWS.

참고문헌 (Reference)

• 1 유준구, "파괴적 신기술로서 인공지능의 책임 있는 군사적 이용 논의 동향과 시사점" 국립외교원 2023
• 2 정찬모, "인공지능과 기술적 무역장벽 규범" 27 (27): 2024
• 3 장기영, "인공지능 군사무기화의 국제안보적 영향과 규범화 연구" 25 (25): 2024
• 4 계승균, "법규범에서 인공지능의 주체성 여부" 66 (66): 2017
• 5 Singer, Peter Warren, "Wired for War: The Robotics Revolution and Conflict in the 21st Century" Penguin Books 2009
• 6 Kozlovski, Atay, "When Algorithms Decide Who is a Target: IDF’s use of AI in Gaza" Tech Policy
• 7 Pratt, Simon F, "When AI Decides Who Lives and Dies" Foreign Policy
• 8 Orend, Brian, "War and International Justice : A Kantian Perspective" Wilfrid Laurier University Press 2000
• 9 Crootof, Rebecca, "War Torts: Accountability for Autonomous Weapons" 164 (164): 2016
• 10 Ewin, Robert E, "Virtues and Rights: The Moral Philosophy of Thomas Hobbes" Routledge 2019
• 11 DCDC, "UK Development, Concepts and Doctrine Centre. “Joint Doctrine Note 2/11:The UK Approach to Unmanned Aircraft Systems,” UK MoD"
• 12 Walzer, Michael, "The Triumph of Just War Theory (and the Dangers of Success)" 69 (69): 2002
• 13 Sauer, Frank, "The Routledge Social Science Handbook of AI" Routledge 2021
• 14 Tallberg, Jonas. Erman, "The Global Governance of Artificial Intelligence" 25 (25): 2023
• 15 McMahan, Jeff, "The Ethics of Killing in War" 114 (114): 2004
• 16 Royakkers, Lambér, "The Cubicle Warrior : the Marionette of Digitalized Warfare" 12 : 2010
• 17 Kant, Imanuel, I, "The Critique of Practical Reason" The Floating Press 2009
• 18 Plato, "The Collected Dialogues of Plato" Princeton University Press 1961
• 19 Schwarz, Elke, "Technology and Moral Vacuums in Just War Theorising" 14 (14): 2018
• 20 Álvarez, Jimerna Sofía Viveros, "Symposium on Military AI and the Law of Armed Conflict: Drone Swarms as Weapons of Mass Destruction" Opinio Juris
• 21 Belle, Vaishak, "Symbolic Logic Meets Machine Learning: A Brief Survey in Infinite Domains"
• 22 Buttazzo, Giorgio, "Rise of Artificial General Intelligence : Risks and Opportunities" 6 : 2023
• 23 Alston, P, "Report of the Special Rapporteur on Extrajudicial, Summary or Arbitrary Executions, Addendum: Study on Targeted Killings" UN Human Rights Council
• 24 Erakat, Noura, "Report of the Independent Task Force on the Application of National Security Memorandum-20 to Israel"
• 25 CCW-GGA, "Report of the 2019 Session of the Group of Governmental Experts on Emerging Technologies in the Area of Lethal Autonomous Weapons Systems"
• 26 UKWSC, "Proceed with Caution: Artificial Intelligence in Weapon System"
• 27 USDoS, "Political Declaration on Responsible Military Use of Artificial Intelligence and Autonomy"
• 28 Rickless, Samuel C, "Plato’s Forms in Transition: A Reading of the Parmenides" Cambridge University Press 2006
• 29 Cooper, John. M., "Plato: Complete Works" Hackett Publishing 1997
• 30 Mason, Andrew. S, "Plato Ancient Philosophies" Acumen Publishing 2010
• 31 Hobbes, Thomas, "On the Citizen" Cambridge University Press 1999
• 32 Kumar, Shailendra, "Normative Ethics, Human Rights, and Artificial Intelligence" 3 (3): 2023
• 33 Thurnher, Jeffrey. S, "New Technologies and the Law of Armed Conflict" Springer 2014
• 34 Noorman, Merel, "Negotiating Autonomy and Responsibility in Military Robots" 16 (16): 2014
• 35 Strawser, Bradley Jay, "Moral Predators: The Duty to Employ Uninhabited Aerial Vehicles" 9 (9): 2010
• 36 Øverland, Gerhard, "Moral Obstacles: An Alternative to the Doctrine of Double Effect" 124 (124): 2014
• 37 Searle, Jhon. R., "Minds, Brains, and Programs" 3 (3): 1980
• 38 Searle, Jhon. R, "Mind, Language, And Society: Philosophy In The Real World" Basic books 1998
• 39 Boulanin, Vincent, "Mapping the Development of Autonomy in Weapon Systems" Stockholm International Peace Research Institute 2017
• 40 Hobbes, Thomas, "Leviathan" Hackett Publishing 1994
• 41 Roff, Heather. M, "Lethal Autonomous Weapons and Jus ad Bellum Proportionality" 47 (47): 2015
• 42 Adam, David, "Lethal AI Weapons are Here : How Can We Control Them?" 629 : 2024
• 43 Agenjo, Agenjo, "Lavender Unveiled: The Oblivion of Human Dignity in Israel’s War Policy on Gaza" Opinio Juris
• 44 Trager, Robert, "Killer Robots Are Here—and We Need to Regulate Them" Foreign Policy
• 45 Walzer, Michael, "Just and Unjust Wars : A Moral Argument with Historical Illustrations" Basic Books 1977
• 46 Claude, Inis Lothair, "Just Wars: Doctrines and Institutions" 95 (95): 1980
• 47 Walzer, Michael, "Just & Unjust Targeted Killing & Drone Warfare" 145 (145): 2016
• 48 Blanchard, Alexander, "Jus in bello Necessity, the Requirement of Minimal Force, and Autonomous Weapons Systems" 21 (21): 2022
• 49 Kant, I., "Joint Doctrine Publication 0-30.2: Unmanned Aircraft Systems" UK MoD
• 50 Kant, I, "Joint Concept Note1/18: Human-Machine Teaming" UK MoD
• 51 Szegedy, Christian, "Intriguing Properties of Neural Networks"
• 52 Lloyd, Sally A., "Ideals as Interests in Hobbes’s Leviathan: the Power of Mind Over Matter" Cambridge University Press 2002
• 53 "Human Rights Watch. Losing Humanity The Case against Killer Robots"
• 54 Hobbes, Thomas, "Human Nature and De Corpore Politico" Oxford University Press 1994
• 55 Kavka, Gregory S, "Hobbesian moral and political theory" Princeton University Press 1986
• 56 GFFO, "German Commentary on Operationalizing All Eleven Guiding Principles at a National Level as Requested by the Chair of the 2020 GGE on Emerging Technologies in the Area of LAWS within the Convention on CCW"
• 57 UNGA, "General and Complete Disarmament : Report of the 1st Committee : General Assembly, 78th Session (A/78/409)" UN General Assembly
• 58 Elliot, Christopher, "Expedient or Reckless? Reconciling Opposing Accounts of the IDF’s Use of AI in Gaza" Opinio Juris
• 59 Arkin, Ronald C, "Ethical Robots in Warfare" 28 (28): 2009
• 60 Kang, Michael. Kiseok, "Enemies, Allies, and Artificial Intelligence: Developing Rules and Norms for Lethal Autonomous Weapons Systems" 10 (10): 2023
• 61 Woods, Chris, "Drone Strikes Rise to One Every Four Days"
• 62 Descartes, René, "Discourse on the Method" Hackett Publishing 1998
• 63 Kant, Imanuel, I, "Crtique of Judgement" Oxford University Press 2007
• 64 Kant, Imanuel, "Critique of Pure Reaso" Create Space Independent Publishing Platform 2016
• 65 Herzfeld, Noreen, "Can Lethal Autonomous Weapons be Just?" 11 (11): 2022
• 66 "Campaign to Stop Killer Robots. “Key Elements of a Treaty on Fully Autonomus Weapons,”"
• 67 USDoD, "Autonomy in Weapon Systems" DoD Directive
• 68 Amnesty International, "Autonomous Weapons Systems : Five Key Human Rights Issues for Consideration" Amnesty International Publication 2015
• 69 Schmitt, Michael N., "Autonomous Weapon Systems and International Humanitarian Law: A Reply to the Critics" 2012
• 70 Anderson, James M., "Autonomous Systems: Issues for Defence Policymakers" NATO 2015
• 71 Scharre, Paul, "Army of None: Autonomous Weapons and the Future of War" W. W. Norton 2018
• 72 Lackey, Douglas P, "Applied Ethics: A Multicultural Approach" Routledge 2017
• 73 Heyns, Christof, "A/HRC/23/47: Report of the Special Rapporteur on Extrajudicial, Summary or Arbitrary Executions" UN Human Rights Council
• 74 Chamayou, Grégoire, "A Theory of the Drone" The New Press 2015
• 75 Orend, Brian, "A Just-war Critique of Realism and Pacifism" 26 : 2001
• 76 Schmitt, Michael N., ""Out of the Loop" : Autonomous Weapon Systems and the Law of Armed Conflict" 4 : 2013