For 30 years, enterprise software had a narrow job description: record what happened and stay out of the way of the decision. It observed. It stored. It reported. The human made the call. That arrangement is dissolving, and most governance structures inside enterprises have not caught up to what replaces it.
Artificial intelligence, particularly agentic AI, does not just process information anymore. It recommends, decides, and increasingly acts, often across systems that were never designed with an autonomous actor in mind. This is not a future problem to plan for. It is a present one, and the gap between how fast organizations are adopting these systems and how ready they are to govern them has become the defining security question of this period.
Industry research points to the same pattern from different angles: organizations are moving quickly to adopt generative and agentic AI across multi-model environments, while governance structures, security skills, and a clear understanding of AI-specific data exposure risks lag behind. Fast adoption paired with slow governance maturity is the core tension every enterprise leader sits with.
According to IBM’s Cost of a Data Breach Report 2026, one in four malicious breaches were AI-enabled, up 56% from the previous year, and these incidents cost an average of $6 million, compared with a global average of $4.99 million. A large majority of organizations affected by an AI-related breach lacked basic access controls on their AI models and data. The technical weaknesses behind AI-related breaches are not exotic. They are compromised APIs and plugins, cloud misconfigurations, and access control gaps that have existed in enterprise security for years, now showing up in an AI context. The security problem is rarely the model on its own. It is the permissions granted to it, the systems it connects to, and the data it can reach.
The risk sits in what the model can touch
Much of the public conversation about AI risk still circles around accuracy, fabrication, and bias. Those are real concerns. But what actually keeps me up at night is not what a model gets wrong in isolation. It is what that model, or an agent built on top of it, can access and carry out once its judgment has quietly drifted from what it was set up to do.
Traditional enterprise software stayed neutral for 30 years because it never had to exercise judgment. It logged events and handed the interpretation to a person. Agentic systems break that pattern because they often train on their own prior outputs and operate with permissions delegated across applications, APIs, and connected services. Their behavior can shift over time through feedback loops, changing context, updated prompts, new tool integrations, or permission changes that accumulate without a single obvious failure point. The exact mechanism varies by system, but the risk is the same either way: what an agent judges to be a reasonable action today may not match what it was scoped to do originally.
What matters is not the “judgment drift” itself so much as what an agent can do with it. A document gets pulled from a system it should not have touched. A customer record gets updated without the usual approval chain. A workflow gets waved through. A message goes out under someone’s name before anyone has had the chance to review it. This shift can be difficult to catch while it’s happening.
Treating human-in-the-loop as the primary safeguard is insufficient for high-consequence actions. Human review works well when there is time and visibility before an action occurs. It works far less well when an agent can chain three or four small actions together on its own, faster than a reviewer could reasonably follow.
OWASP’s guidance on large language model applications describes this pattern as “excessive agency” – meaning a system granted more autonomy or permission than the task actually calls for. It sits alongside other recognized risks like prompt injection and sensitive information disclosure, and it is a useful frame for enterprise teams because it points to a fixable problem: scope.
None of this argues for removing human oversight. It argues against relying on it as the only line of defense. What organizations need instead are guardrails that scale scrutiny to the weight of the action, and that check an action before it runs rather than reviewing it after the fact.
Guidance from CISA and NSA on deploying AI systems securely emphasizes that safe deployment depends on strong identity and access management, careful data governance, and continuous monitoring across a system’s lifecycle, not just at launch. NIST’s AI Risk Management Framework and its Generative AI Profile point in the same direction from a governance angle: risk management as a continuous, measurable, lifecycle activity rather than a one-time certification.
This matters because agentic AI has created a category of identity that most access frameworks were never built to handle. These are non-human, semi-autonomous identities that reach enterprise systems through APIs, service accounts, and integration protocols. The risk is what happens after that connection is made, when an agent inherits permissions broader than the task in front of it actually requires, often because no one scoped access down to begin with.
Once an agent can write, modify, or move data across systems it was never explicitly authorized to touch, an organization’s real attack surface stops matching its org chart. The exposure isn’t abstract. It runs through specific identities, the privileges attached to them, the data those privileges can reach, and the actions an agent is able to take once it’s inside a system, whether that identity belongs to a human or not.
Regulation is beginning to reflect this shift. The EU AI Act sets out risk-based obligations tied to how AI systems are used, and DORA sharpens expectations around operational resilience and accountability for financial entities and their technology dependencies. Neither should be treated as a compliance checkbox. They reflect a broader shift toward continuous accountability rather than periodic audits.
Digital sovereignty belongs in this same conversation, and not only through a geographic lens. It is a question of control: who governs your data, who controls the infrastructure you depend on, what jurisdictional exposure you are carrying, and what happens to continuity of operations if a critical AI dependency sits outside your reach.
New threats rarely break a security posture outright. More often, they expose gaps that were already there: in identity governance, in data access controls, in the assumption that a human would always be watching before something consequential happened.
The organizations that manage AI risk well won’t be the ones with the most policies on paper. They’ll be the ones that move from periodic assessment to continuous visibility and validation, with clear accountability for what their AI systems, and the agents connected to them, are actually allowed to do. In practical terms, that means:
● Zero trust for AI. Scoping agent permissions to the specific task, not the broadest access convenient at setup.
● Treating non-human identities (service accounts, API integrations, agent-to-system connections) with the same access governance rigor applied to human employees, including regular access review and revocation.
● Building pre-execution checks for high-consequence actions, rather than relying on after-the-fact human review alone.
● Monitoring AI system behavior continuously across its lifecycle, not just at deployment.
● Mapping data exposure and dependency for every AI system and vendor relationship, as part of a broader sovereignty and continuity review.
Technology will keep moving quickly. The organizations that hold up under pressure will be the ones whose governance moved just as fast.
Pankit Desai is the Co-Founder and CEO of Sequretek, an AI-powered cybersecurity company. An entrepreneur with a background in technology and business leadership, he co-founded Sequretek in 2013 along with Anand Naik.
Google has announced a new set of Android security protections designed to stop mobile scams…
Hackers are exploiting flaws in Plex Media Server to install cryptocurrency mining malware, with a…
Microsoft has confirmed that Windows Server security updates released on October 13, 2026, can disrupt…
OpenCode has disclosed a security breach affecting 1.4% of its Console users, warning that third-party…
Anthropic says an internal Claude research model has traced the origins of five NSA-supplied elliptic…
Hackers used a stolen ConnectWise Cloud Backup credential to sign in to 173 Microsoft 365…