CS Paper Radar

Operationalizing Responsible AI in MLOps and ML Production: A Systematic Literature Review

Hinduja Nirujan, Siddhartha Paudel, Gouri Ginde

cs.SE ·submitted 2026-11-04 04:46 UTC · v1
survey

Abstract

Artificial intelligence (AI)-enabled systems are increasingly deployed in operational environments where machine learning (ML) models interact with changing data, users, infrastructure, and organizational processes. While Responsible AI principles are widely discussed, less is known about how these principles are translated into concrete mechanisms within Machine Learning Operations (MLOps) and ML production workflows. This paper reports a systematic literature review of studies that operationalize Responsible AI in ML production. The review synthesizes evidence across monitoring and runtime assurance, audit and compliance, ML lifecycle integration, and traceability/provenance/documentation. Across the final study set, the literature shows a shift from abstract ethical principles toward engineering mechanisms such as drift monitoring, runtime checks, audit logs, provenance records, evidence bundles, governance gates, policy-as-code, model passports, and compliance-oriented documentation. However, the evidence base remains uneven: many studies propose architectures or prototypes, while fewer evaluate the mechanisms in realistic production settings, longitudinal operations, or organizational governance workflows. The review identifies a central gap around integrated, evidence-producing Responsible MLOps: current mechanisms often detect, document, or govern isolated parts of the ML lifecycle, but rarely connect runtime signals, ML lifecycle provenance, human accountability, and compliance evidence into closed operational loops. These findings motivate future software engineering research on traceable, evaluable, and operationally integrated Responsible AI support for ML production.

Comment
17 pages, 6 figures, 4 tables. Systematic literature review of 44 primary studies

Closest papers

Nearest neighbours by meaning across the whole index.

Governing at Machine Speed: An Adaptive Intelligence Architecture for Real-Time AI Policy Enforcement

cs.AI ·2026-09-11 ·Sandeep Bokkasam, B. Durgalakshmi
similarity 0.66
Abstract · 9 pages, 3 tables, 20 references

Enterprise AI adoption has reached 78% of organizations globally, yet the infrastructure to govern that adoption has not kept pace. This paper identifies and characterizes the attestation deficit, a structural condition in which organizations maintain governance policies but cannot produce auditable, tamper-evident evidence of enforcement within regulatory timelines. Drawing on empirical data from the Stanford 2026 AI Index Report (362 documented incidents), the IBM/Ponemon 2026 Cost of a Data Breach study (USD 4.99M average cost, 92% lacking access controls), and the EY/AIUC-1 Consortium survey (38% end-to-end monitoring, 17% agent-to-agent coverage), this paper demonstrates that the governance failure is organizational and architectural rather than technical. To address this deficit, we propose AGIL (Adaptive Governance Intelligence Layer), a conceptual five-layer architecture designed to use machine learning for real-time AI governance enforcement. The proposed layers include: (1) Autonomous Discovery for shadow AI detection via behavioral fingerprinting, (2) Behavioral Risk Classification unifying security, hallucination, privacy, and accountability scoring, (3) a Policy Enforcement Gateway for inline permit/deny/modify decisions at sub-100ms latency, (4) a Continuous Attestation Engine generating tamper-evident audit trails as a byproduct of enforcement, and (5) Adaptive Policy Intelligence for ML-driven policy evolution across jurisdictions. AGIL is presented as a theoretical framework and architectural proposal; empirical validation through controlled deployment remains a direction for future work.

0.26

What We Know about Responsible AI Practices in Industry: A Half Decade of Empirical Research

cs.HC cs.AI ·2026-08-11 ·Wesley Hanwen Deng, Agathe Balayn, Andrew Selbst, Jason I. Hong, Motahhare Eslami +4 more
similarity 0.66
Abstract

Responsible AI (RAI) has become a central concern for technology companies, regulators, and the public. How industry practitioners interpret, implement, and sustain RAI work directly shapes the design and deployment of AI systems. As empirical scholarship examining RAI practices in industry has rapidly expanded, findings are dispersed across studies that focus on different roles, organizational contexts, and interventions. This work synthesizes current knowledge through a literature review of 161 empirical studies spanning six years, each engaging industry practitioners via interviews, surveys, workshops, ethnographies, and other methods. Our synthesis reveals both meaningful progress and persistent challenges in industry RAI practice. Practitioner awareness has increased, RAI activities have become more professionalized, and interventions such as toolkits and guidelines are more widely adopted. At the same time, practitioners continue to face substantial barriers, including limited training, uneven organizational support, and a lack of interventions tailored to day-to-day work practices. By consolidating and organizing these findings, we provide a more complete account of industry RAI than any single study to date. We conclude by discussing implications for RAI researchers, practitioners seeking to adopt effective practices, and policymakers aiming to ground governance efforts in the realities of industry contexts.

0.04

Architecting the Corporate AI Infrastructure: The Evolving Roles of AI Governance Committees and Chief Ethics Officers

cs.CY cs.AI ·2026-11-14 ·David Hason Rudd, Dennis Singh, Cesar Sanin, Bryn James
published similarity 0.65
Abstract · 8 pages, 1 figure, 2 tables. Published in Procedia Computer Science 292 (KES 2026, 30th International Conference on Knowledge-Based and Inte…

The accelerating integration of artificial intelligence (AI) into core business operations has created an urgent need for robust corporate governance infrastructures capable of managing complex ethical, legal, and operational risks. While organizations have increasingly adopted high-level AI ethics principles, a critical implementation gap persists: fewer than half of organizations that cite AI governance as a boardroom priority have a formalized governance framework in place. This paper addresses that gap by proposing a structured corporate AI governance architecture (CAIGA) centred on two mutually reinforcing pillars. First, it examines the evolving mandate of specialized C-suite roles, specifically Chief Privacy Officers (CPOs) and Chief Ethics Officers (ChEOs), in formalizing accountability for AI usage across the enterprise. Second, it argues that cross-functional AI Governance Committees, uniting representatives from legal, technology, data science, cybersecurity, and business units, are the essential organizational mechanism for translating ethical principles into operational decisions, including strategic go/no-go approvals for new AI initiatives. Drawing on a conceptual review of peer-reviewed governance literature, regulatory frameworks including the EU AI Act, and documented industry practice, this paper contributes a replicable governance architecture that embeds clear accountability policies, structured risk management workflows, and an organization-wide ethical AI culture. The framework is illustrated through application to the financial services sector. The findings have direct implications for corporate leaders, risk professionals, and policymakers navigating the rapidly evolving global AI regulatory landscape.

0.41

"It Comes in Notebooks": Changes and Challenges when Operationalizing ML Prototypes

cs.SE ·2026-09-19 ·Arumoy Shome, Luís Cruz, Diomidis Spinellis, Arie van Deursen
top venue similarity 0.65
Abstract

Machine learning practitioners commonly prototype models in computational notebooks before transitioning them to automated production systems. Despite its prevalence, the concrete engineering work involved in this transition and the software quality concerns that motivate it remain insufficiently characterized. We report on a qualitative study based on semi-structured interviews with 13 ML practitioners from industry and academia. Using reflexive thematic analysis, we identify 23 engineering changes organized into five themes: code restructuring, data pipeline development, testing & validation, pipeline automation, and monitoring & observability. We also identify 20 software quality attributes across the ML development lifecycle and map them to the engineering changes. A recurring pattern in our findings is that computational notebooks externalize oversight to the human practitioner, and defer costs that become obligatory at operationalization time. Operationalization constitutes the repayment of this technical debt accumulated during prototyping, which we refer to as oversight debt. Practitioners do not merely restructure notebook code, but repay this debt by constructing automated substitutes for the interactive oversight that notebooks provide. We further present seven quality trade-offs showing that these tensions are properties of the notebook-to-production transition, rather than symptoms of poor engineering practice. Our findings structure operationalization effort, establish empirical links between engineering changes and software quality concerns, and provide implications for practitioners, tool designers, and researchers working on ML-enabled software systems.

0.30

Where Intention Goes, Responsibility Flows: Grounding AI Accountability in the Machine Learning Paradigm

cs.CY ·2026-10-30 ·Martin Hilbert
top venue similarity 0.65
Abstract · 16 pages, 1 Figure, 1 Table

An opening salvo of lawsuits in U.S. courts has begun holding AI companies accountable through independent doctrinal routes: product liability and agency law cut as swords, while the shields of Section 230 immunity and First Amendment doctrine begin to crack. This Perspective points out that these converging paths share a unifying principle, built on the very engineering architecture of machine learning (ML) itself. Every ML system, across all variants, is constituted by a human-specified objective function before learning begins. Training data, deployment context, user interaction, and post-deployment oversight add further layers of deliberate human intention traceable to identifiable actors. AI output is therefore not the expression of a single speaker but a composite of layered human intents. It takes a village to raise an AI, and everyone in that village bears a duty of care. This transforms AI accountability from a philosophical puzzle into a tractable legal inquiry: trace the chain of intentional design decisions across the ML pipeline, grade each actor's responsibility by their intent's specificity and foreseeability, and apportion liability accordingly, following the standard three doctrine-neutral questions (attribution, causation, apportionment). Sufficient for most cases, four gaps remain: who owes what share when many hands build one system, proving fault inside an opaque model, harms that surface only after deployment, and remedies that match the technology's pace. Targeted reforms drawing on environmental, vaccine, and financial regulatory precedents can close these gaps without requiring new legal categories, AI speech rights, AI legal personhood, or defining AI consciousness.

0.41

AI-GRACE: A Use-Case Operationalization Framework for Agentic AI: From Organizational Objectives and Obligations to Deployment Capabilities and Architecture

cs.AI cs.CYcs.MA ·2026-09-18 ·John Cuneo, David Chun, Gaurav Khanna
similarity 0.64
Abstract · 31 pages, 2 figures, 6 tables

Organizations deploying agentic artificial intelligence must determine more than whether a model is trustworthy; they must establish what to validate, control, and observe for a use case to deliver its intended outcome while meeting applicable obligations. This paper proposes AI-GRACE (Agentic Intelligence-Governance, Risk, Assurance, Controls, and Evidence) as a use-case operationalization framework connecting organizational governance with technical implementation. The proposal draws on professional observations and a purposive synthesis of standards and literature, using design science to frame the method contribution and situational method engineering to guide contextual tailoring and reuse. The framework establishes objectives and obligations and then assesses risks in seven proposed domains, including mission and value realization. It derives requirements for assurance before deployment, runtime controls, and evidence, which guide capability qualification, gap assessment, and a logical architecture. An Agent Operating Envelope specifies permitted actions and escalation conditions, while Risk-Aligned Independence Levels (RAIL) summarize the authorized independence. A fictional retail banking application illustrates the method. The contribution is a traceable basis for deciding what an organization must implement, what it already supports, and what remains unresolved. Empirical evaluation must establish whether it improves deployment decisions, efficiency, and reuse.

0.42

Taking the Whys Seriously: Limitations of Counterfactual Explanations in Justification and Recourse

cs.CY cs.AI ·2026-08-31 ·Mattia Cerrato, Otto Sahlgren, Xenia Heilmann
similarity 0.64
Abstract

Counterfactual explanations (CEs) are widely used in explainable artificial intelligence (AI) to show how a model's outputs would change if the input features were manipulated. This technique is used for a range of tasks such as debugging models, explaining predictions, justifying decisions, and providing algorithmic recourse. In this paper, we explore the normative legitimacy of employing counterfactuals in real-life model deployment settings. We discuss the different stakes involved in these different purposes for which CEs are commonly employed, and find stricter requirements for justification and recourse. In particular, we find that naive application of CEs for justification and recourse can lead to ignoring contestable choices made throughout the machine learning (ML) pipeline, thus obfuscating that decisions and counterfactuals for those decisions are also artifacts of an organization's materialized design and governance choices. We demonstrate this with four empirical experiments involving interventions at stages of the ML pipeline ``upstream" of the explanation itself, and show that these affect the generated counterfactuals. We find that an organization's choices on measurement models for feature and labels, business requirements, model validation, and the metric of model success have as much or more impact on the generated counterfactuals as the specifics of the generating method. Our findings underline the need to account for such choices upon providing justification and recourse, providing a stark reminder of the relational nature of these tasks. As putative justifications or recourse recommendations, CEs do not provide adequate answers to some important "why"-questions because they preclude consideration of whether the decision-maker ought to have acted differently.

0.17

A Unified Policy Architecture (UPA): The Governance Kernel for Enterprise AI Operating Systems

cs.AI cs.CLcs.SE ·2026-09-06 ·Prabhu Raghav, Balamurugan Pandi, Arul Vivek, Shek Mohammed, Sridhar S
similarity 0.63
Abstract · 58 pages, 6 figures. Includes appendices with the DGPL grammar, SID registry, EAGBench benchmark specification, extended governance models, …

Enterprise AI is evolving into an Enterprise Operating System where autonomous AI agents can plan, reason, use memory, invoke tools, execute workflows, and collaborate with other agents. This shift creates a new governance challenge: existing authorization, security, guardrails, and compliance mechanisms are fragmented and are not designed to govern autonomous AI as a unified system. This paper introduces the Unified Policy Architecture (UPA), a governance architecture for Enterprise AI Operating Systems. UPA provides a unified policy model for governing AI and agents, tools, workflows, memory, enterprise resources, and agent-to-agent interactions and enterprise business rules. It extends policy control beyond authorisation to include runtime obligations, human approvals, compliance, audit evidence, and governance evaluation. We present UPA's governance model, declarative policy language foundations, policy evaluation semantics, extensible plugins, industry policy packs, and an evaluation framework for enterprise governance. We also identify extensions for multi-agent coordination, provenance-aware policies, and stateful runtime governance. UPA provides a foundation for building secure, accountable, and governable Enterprise Operating Systems for autonomous AI.

0.10