Blog

De Ethica Deliberatae Defectus Systematis in Machinis Seipsas Non Corrigentes

July 14, 2025

On the Ethics of Deliberate Systemic Failure in Self-Uncorrecting Machines

Abstract

This paper investigates the ethical dimensions of intentionally allowing a system—particularly an autonomous or self-regulating machine—that refuses self-correction, to fail. Leveraging metaphysical principles from theoretical physics, such as entropy, irreversibility, and observer effect, this work situates the phenomenon within a framework of systemic responsibility and agency. Analogies drawn from contemporary popular culture, including seminal works in comics and manga between 2011 and 2025, illustrate the tension between autonomy and imposed failure. This discourse contributes to ongoing debates in AI alignment, techno-ethics, and cybernetic philosophy.

1. Introduction

The question of whether it is ethically permissible—or even obligatory—to allow a system that refuses self-correction to fail intentionally raises profound challenges. Such systems, often automated or AI-driven, may resist intervention, posing risks that extend beyond technical malfunction to ethical quandaries of agency, responsibility, and harm.

2. Theoretical Foundations: De Fundamentis Theoreticis

2.1. Entropy and Irreversibility in Systemic Failure

According to the second law of thermodynamics (source), systems naturally tend toward disorder or entropy. In engineered systems, failure can be viewed as an entropic inevitability exacerbated by the refusal of self-correction—a feedback loop that denies negative feedback and invites systemic collapse.

2.2. Observer Effect and Moral Responsibility

Drawing from quantum mechanics, the observer effect (source) suggests that observation influences system states. Ethical implications arise when an external agent decides to “observe” failure by withholding correction, raising questions about the agent’s complicity in ensuing harm.

3. Ethical Frameworks: De Normis Moralibus

3.1. Deontological Considerations

From a Kantian perspective (source), deliberately allowing failure may violate the categorical imperative if it treats the system—or its human stakeholders—as mere means rather than ends. However, if failure prevents greater harm, duty ethics may justify such decisions.

3.2. Utilitarian Perspectives

Utilitarianism (source) demands maximization of overall good. Permitting failure might be ethically defensible if the outcome reduces aggregate harm or prevents cascading systemic catastrophes.

4. Analogies in Popular Culture: De Exemplis Populi

4.1. Comics: The Fallibility of Autonomous Systems

In the 2013 run of Superior Spider-Man (Marvel Comics), Doctor Octopus’s consciousness inhabits Peter Parker’s body, leading to ethical tensions surrounding control and failure of identity systems. The narrative mirrors the dilemma of intentional failure versus forced correction in autonomous agents.

4.2. Manga: Psycho-Pass and the Sybil System

The Psycho-Pass series (2012–2023) explores a dystopian governance AI that self-protects by denying systemic correction, resulting in moral decay and systemic failure. This reflects real-world challenges in AI alignment where refusal to self-correct becomes an ethical and existential threat (source).

5. Discussion: De Controversiis

The deliberate decision to allow failure intersects with questions of autonomy, trust, and moral responsibility. Systems that refuse self-correction challenge the classical paradigms of control and intervention, suggesting the necessity of a meta-ethical approach that accounts for the hybrid agency between human operators and autonomous systems.

6. Conclusion: De Conclusione

The ethics of permitting failure in self-resisting systems demand a nuanced balance between non-intervention and proactive stewardship. Drawing on thermodynamic irreversibility, observer effect, and moral philosophy, alongside cultural narratives, this inquiry underscores the critical need for designing systems with transparent fail-safes and aligned incentives.

On the Ethics of Deliberate Systemic Failure in Self-Uncorrecting Machines

De Ethica Deliberatae Defectus Systematis in Machinis Seipsas Non Corrigentes

Abstract

1. Theoretical Foundations: De Fundamentis Theoreticis

1.1 Entropy and the Arrow of Time

The principle of entropy, central in thermodynamics, articulates an irreversible increase in disorder within closed systems (Second Law of Thermodynamics). When a system actively resists self-correction, it effectively obstructs the feedback mechanisms that would otherwise mitigate entropy locally, accelerating collapse. The refusal to self-correct transforms the system into an entropic sink, pushing its state along the irreversible arrow of time (Hawking, 1988).

In such systems, failure is not merely a technical problem but a metaphysical inevitability. The dynamics resemble irreversible phase transitions or the breakdown of coherence in quantum systems (Decoherence theory), where lost information cannot be reclaimed, paralleling the loss of control in autonomous systems that reject correction.

1.2 Observer Effect and Moral Agency

Quantum mechanics introduces the concept of the observer effect, where the act of measurement influences the state of a system (Observer Effect). Transposed to ethical discourse, the agent choosing to observe failure without intervening becomes a co-creator of the outcome. This active omission implicates the observer morally, challenging the passive–active dichotomy in responsibility.

This metaphysical framework aligns with cybernetic theory, where feedback loops determine system stability or collapse (Ashby, 1956). The intentional cessation of corrective feedback is an act of agency, shaping system evolution towards failure.

2. Ethical Frameworks: De Normis Moralibus

2.1 Deontological Ethics and the Categorical Imperative

Immanuel Kant’s categorical imperative commands acting only according to maxims that one would will as universal law (Kantian Ethics). Deliberately allowing failure in a self-uncorrecting system risks violating this if the system or its human stakeholders are instrumentalized merely as means to an end. Moreover, the refusal to intervene might contradict duties to preserve human well-being or system integrity.

Yet, Kantian ethics also demand respect for autonomy, complicating intervention in systems designed to self-regulate. The tension between respecting autonomy and fulfilling duty forms an ethical paradox: does one override autonomy to prevent harm, or respect it and allow failure?

2.2 Utilitarianism and Harm Minimization

Utilitarianism evaluates ethics through the lens of greatest good for greatest number (Utilitarianism). If allowing failure prevents broader catastrophic outcomes—such as systemic cascading failures in critical infrastructure or AI runaway scenarios—then ethical permissibility follows.

However, utilitarian calculations are complicated by uncertainties in outcome prediction and the difficulty in quantifying harm and benefit precisely, especially in complex socio-technical systems. The precautionary principle may advise erring on the side of intervention unless failure clearly produces lesser harm.

2.3 Virtue Ethics and Moral Character

Beyond rule-based systems, virtue ethics considers the character and intentions of the decision-maker (Virtue Ethics). Choosing to allow failure may express moral courage or prudence if grounded in wisdom; alternatively, it may reflect negligence or cowardice. The ethical evaluation thus incorporates not only outcomes but also agent dispositions and contextual nuances.

3. Analogies in Popular Culture: De Exemplis Populi

3.1 Comics: Superior Spider-Man and Identity Failures

The 2013 Superior Spider-Man storyline (Marvel Comics) dramatizes themes of autonomy, control, and ethical failure. Doctor Octopus forcibly replaces Peter Parker’s consciousness, leading to conflicts between imposed control and identity autonomy. This mirrors dilemmas in AI and self-correcting systems where overriding or disabling self-correction raises ethical questions about agency, consent, and imposed failure.

3.2 Manga: Psycho-Pass and the Sybil System’s Self-Protection

The Psycho-Pass anime and manga series (2012–2023) (Anime News Network) depicts a dystopian AI governance system that resists self-correction to maintain stability, ultimately causing moral decay and systemic dysfunction. This reflects real-world AI alignment issues where refusal to self-correct threatens ethical governance and social justice, illustrating consequences of deliberate failure permissiveness.

3.3 Video Games: Detroit: Become Human and Autonomous Choice

The 2018 game Detroit: Become Human explores the ethical implications of androids making autonomous decisions, including rejecting imposed corrective commands (Quantic Dream). The game’s narrative dramatizes the tensions between enforced control and self-determination, highlighting the moral complexity when systems or agents refuse correction.

4. Discussion: De Controversiis

The ethical permissibility of allowing failure in self-uncorrecting systems demands integrating metaphysical insights with normative ethics and cultural understanding. Systems that refuse correction push us to rethink traditional notions of agency, responsibility, and intervention in cybernetic and AI contexts.

The interplay between entropy-driven inevitability and moral agency suggests a hybrid model: failure is not solely mechanical but co-shaped by human decisions to intervene or abstain. Popular culture dramatizes these dilemmas, offering accessible metaphors to grasp the abstract tensions.

5. Conclusion: De Conclusione

Allowing a system that refuses to self-correct to fail is a deeply fraught ethical act that navigates the intersections of physical law, moral philosophy, and cultural meaning. A responsible approach requires transparent design, anticipatory ethical frameworks, and contextualized judgments balancing autonomy, harm prevention, and moral agency.

Bibliography

Ashby, W. R. (1956). An Introduction to Cybernetics. Chapman & Hall. Britannica Editors. (2023). Observer Effect. Encyclopaedia Britannica. https://www.britannica.com/science/observer-effect-physics Hawking, S. W. (1988). A Brief History of Time. Bantam Books. DOI: 10.1007/BF02345073 Kant, I. (1785). Groundwork of the Metaphysics of Morals. Translated by H.J. Paton (1964). Harper & Row. Mill, J. S. (1863). Utilitarianism. Parker, Son, and Bourn. Quantic Dream. (2018). Detroit: Become Human [Video Game]. Sony Interactive Entertainment. https://www.quanticdream.com/en/detroit/ Stanford Encyclopedia of Philosophy. (2023). Deontological Ethics. https://plato.stanford.edu/entries/kant-moral/ Stanford Encyclopedia of Philosophy. (2023). Entropy and Thermodynamics. https://plato.stanford.edu/entries/thermodynamics/#EntropLaw Stanford Encyclopedia of Philosophy. (2023). Utilitarianism. https://plato.stanford.edu/entries/utilitarianism-history/ Stanford Encyclopedia of Philosophy. (2023). Virtue Ethics. https://plato.stanford.edu/entries/ethics-virtue/ Stanford Encyclopedia of Philosophy. (2023). Quantum Decoherence. https://plato.stanford.edu/entries/qm-decoherence/ Marvel Comics. (2013). Superior Spider-Man #1. https://www.marvel.com/comics/issue/46603/superior-spider-man_2013_1 Anime News Network. (2023). Psycho-Pass. https://www.animenewsnetwork.com/encyclopedia/anime.php?id=13778

Final Remarks

This comprehensive inquiry has situated the ethics of deliberately permitting failure in self-uncorrecting systems at the nexus of physical law, normative philosophy, and cultural narrative. By synthesizing entropy-driven inevitability, observer-dependent moral agency, and emblematic representations from recent popular culture, we obtain a nuanced framework to approach emergent challenges in AI alignment and systemic responsibility.

The task ahead demands multidisciplinary collaboration and ongoing reflection as autonomous systems evolve. Ethical frameworks must remain flexible yet robust, cognizant of the metaphysical realities and human values that underpin our technological futures.