Toward a Science of Autonomy for Physical Systems: Defense

Militaries around the world have long been cognizant of the potential benefits associated with autonomous systems both in the conduct of warfare and in its prevention. This has lead to the declaration by some that this technology will lead to a fundamental change in the ways in which war is conducted, i.e., a revolution in military affairs (RMA) not unlike gunpowder, the long bow, the rifled bullet, the aircraft carrier, etc. Indeed the United States has created roadmaps for robotics with ever-increasing autonomous capability that span almost 40 years. These systems span air, sea, sea surface, littoral, ground and subterranean environments. There are serious societal and ethical concerns associated with the deployment of this technology that remain unaddressed. How can sufficient protection be afforded noncombatants? What about civilian blowback, where this technology may end up being used in policing operations against domestic groups? How can we protect the fundamental human rights of all involved? Considerable discussion is being conducted at an international level, including at the United Nations Convention on Certain Conventional Weapons (CCW) over the past two years, debating if and how such systems, particularly lethal platforms should be banned or regulated.

💡 Research Summary

The paper provides a comprehensive examination of autonomous physical systems (APS) in the defense sector, arguing that these technologies represent a potential “revolution in military affairs” comparable to historic breakthroughs such as gunpowder, the longbow, the rifled bullet, and the aircraft carrier. It begins by outlining the evolution of U.S. defense roadmaps that span nearly four decades, detailing how autonomy has been incrementally introduced across all operational domains—air, surface, littoral, ground, and subterranean. The authors categorize autonomy into four levels—tool automation, semi‑automation, tactical autonomy, and strategic autonomy—and describe the technical requirements for each: sensor fusion, real‑time situational awareness, decision‑making algorithms, edge‑AI hardware, and robust human‑machine interfaces (HMI).

In the tactical‑autonomy tier, for example, unmanned aerial vehicles (UAVs) can autonomously detect, classify, and track targets while generating evasive flight paths, yet the final lethal decision remains under human supervision. This “human‑in‑the‑loop” or “human‑on‑the‑loop” paradigm is presented as the minimal safeguard required to satisfy International Humanitarian Law (IHL) and emerging human‑centred weapons principles. The paper also highlights technical challenges—algorithmic bias, data scarcity, cyber‑induced malfunctions—and their implications for civilian protection, emphasizing the need for rigorous verification, validation, and accountability mechanisms.

The discussion then shifts to the international policy arena, focusing on the United Nations Convention on Certain Conventional Weapons (CCW) and the ongoing debate over lethal autonomous weapon systems (LAWS). The United States advocates a responsibility‑based framework that stresses transparency, testing, and post‑deployment accountability rather than outright bans. European nations (e.g., the United Kingdom, France, Sweden) push for binding requirements that guarantee meaningful human control, while Russia and China continue to promote unrestricted development. Current CCW work streams aim to establish technical transparency reports, standardized testing protocols, and traceable accountability chains.

Recognizing a “policy‑technology gap,” the authors propose a multi‑stakeholder approach to bridge it: convening joint forums of military planners, academia, industry, and civil‑society groups; employing high‑fidelity simulation environments for ethical and operational testing; and integrating legal‑technical curricula into defense education programs. They argue that only when autonomous systems are designed with human‑centred values, equipped with auditable decision trails, and aligned with internationally accepted norms can they serve both as deterrents to conflict and as tools that respect fundamental human rights.

In conclusion, the paper asserts that autonomous physical systems hold transformative potential for warfare, but their deployment must be tightly coupled with robust ethical safeguards, transparent governance, and coordinated international regulation. Without such measures, the promise of reduced casualties and enhanced operational effectiveness could be eclipsed by unintended civilian harm, erosion of human dignity, and destabilizing arms races. The authors call for immediate, coordinated action to develop a science of autonomy that is technically sound, ethically responsible, and globally governed.