AI Infrastructure

AI Agents in Live Network Infrastructure: Audit Trails, RBAC, and the MCP Gateway Approach | John Capobianco, Itential | TFiR

0

AI agents capable of reasoning over live network infrastructure create an immediate governance problem. Without explicit control over which tools an agent can call, who authorized the action, and what the model reasoned at each step, no enterprise security or compliance team will approve production deployment. The trust gap is not a capability gap. It is an architecture gap.

In this interview on TFiR, John Capobianco, Head of AI and Developer Relations at Itential, breaks down how FlowAI addresses that architecture gap by combining build-time tool selection, role-based access control, OAuth2-secured MCP gateway routing, and a full audit trail into a single agentic platform purpose-built for enterprise network operations.

Guest: John Capobianco, Head of AI and Developer Relations at Itential
Show: TFiR

Here is what every network operations engineer, platform architect, and enterprise infrastructure leader needs to know.

Technical Deep Dive

Q: What is FlowAI and what problem does it solve for enterprise network operations?

John Capobianco, Head of AI and Developer Relations at Itential, describes FlowAI as the agentic platform for enterprise operations. It makes it easy to build and execute AI agents alongside deterministic workflows such as Ansible playbooks, Python scripts, and Terraform jobs. The platform addresses the core enterprise blocker: giving AI agents safe, governed access to real network systems without losing operational control.

“The real blocker is not building a smart agent. It is giving them safe access to real systems without losing control.” — John Capobianco, Head of AI and Developer Relations, Itential

Q: What are the two interface options for building agents in FlowAI?

FlowAI offers a spec-driven development path through an Anthropic skill, where operators describe in natural language the agent they want to build and the outcomes they want to achieve. Alternatively, a traditional GUI builder lets users configure the agent persona, define outcomes, and select tools explicitly at build time. Both paths enforce guardrails including role-based access control and OAuth2 through MCP servers before the agent ever reaches execution.

“At build time we get to select the tools. So it is very safe, it is very full of guardrails.” — John Capobianco, Head of AI and Developer Relations, Itential

Q: Why should AI agents start with read-only tasks in network operations?

A study conducted by one of Itential’s customers found that 64% of network operator activities are read-only: troubleshooting, change planning, and information gathering from infrastructure. Capobianco argues that agents should be onboarded exactly like a new team member, starting with documentation, compliance reporting, source-of-truth validation, and ticket triage before any write operations are introduced. This approach delivers immediate value with minimal risk while building the operational trust required to expand agent autonomy over time.

“Why not hand that task off to an agent that you are in control of and let the agent take care of 60% of your job, summarize that data, and give you root cause analysis.” — John Capobianco, Head of AI and Developer Relations, Itential

Q: What are the main challenges of introducing AI agents into network operations teams?

The challenges mirror those of onboarding a new human team member: ensuring agents follow standards, methods of procedure, and change management requirements. Beyond agent behavior, organizations need an AI governance board, an approved LLM strategy, and a data governance framework before agents can operate safely. Capobianco notes that data quality and tool binding decisions made outside the platform are significant variables that Itential works with customers to address directly.

“Organizations need to have their own AI governance board, approved LLMs, data governance, quality of data. There are a lot of things that go into making a quality agent that are outside of our control.” — John Capobianco, Head of AI and Developer Relations, Itential

Q: Is the core bottleneck for AI in network operations a capability problem, a cost problem, or a trust problem?

Capobianco is direct: the bottleneck is trust. Network infrastructure touches every system in the enterprise, which makes operators and leaders more hesitant to extend autonomy to agents than their counterparts in software development. Itential’s response is a structured trust roadmap: human in the loop, human on the loop, and ultimately human in the lead, supported by role-based access control, AAA audit trails, and full visibility into LLM reasoning steps and tool payloads at every stage.

“Networks take a little while to adopt. But I do not think enterprises are going to wait 10 years to adopt AI for network infrastructure.” — John Capobianco, Head of AI and Developer Relations, Itential

Q: How does Itential’s approach to combining the reasoning layer and execution layer differ from build-only agent platforms?

By keeping the reasoning and execution layers under a single governance model, Itential enables centralized tool hosting, reuse across multiple agents, and asynchronous multi-session spawning from a shared MCP gateway. As an example, Capobianco describes bringing a PyATS MCP server onto the gateway so that multiple agents can call network state tools concurrently without each agent managing its own connection. MCP servers for source-of-truth systems like Netbox, Nautobot, and Opsmill can be attached deterministically to agents at build time, creating composable, auditable pipelines.

“You could bring those tools onto our platform and attach them deterministically to agents at build time. You and I could have built that and run it and have results at Netbox before the end of this conversation.” — John Capobianco, Head of AI and Developer Relations, Itential

Q: How does FlowAI address shadow AI and sprawling automation scripts in regulated enterprise environments?

Capobianco frames shadow AI as the agentic equivalent of distributed, unversioned automation scripts: engineers using personal API tokens, unapproved models, or rogue agents with no audit trail. FlowAI provides a centralized platform with version control and source control, functioning as what Capobianco calls the GitHub for your agents. The bring-your-own-model and bring-your-own-provider architecture means teams in air-gapped environments or those with data sovereignty requirements can run local models via Ollama, LM Studio, or Microsoft Foundry on-premises, keeping network data fully within the organization’s control.

“Think of our platform as that sort of GitHub for your agents. There is version control, there is source control.” — John Capobianco, Head of AI and Developer Relations, Itential

Q: How do Flow Agent, Flow Agent Builder, and Flow MCP Gateway work together for infrastructure teams managing role-based agents?

The Flow Agent Builder is the interface through which any operator with domain knowledge can define an agent, either through the GUI or via Claude Code and the Anthropic skill. The Flow MCP Gateway is where both public and internal enterprise MCP servers are hosted and made available for binding, allowing in-house tooling to be attached to agents in a controlled way. The execution runtime environment is where agents actually run: access is strictly limited, and a full audit trail captures every reasoning step, tool call, tool payload, token count, and execution duration for compliance review.

“In terms of compliance over time, you can audit these agents. You can hand over exactly what happened, how it solved the problem, how it came to the conclusion that a certain problem needed to be resolved.” — John Capobianco, Head of AI and Developer Relations, Itential

Q: Why does Itential enforce governance at build time rather than at runtime, and how do human-in-the-loop checkpoints fit into that model?

Runtime-only governance allows the LLM to reason over its full tool inventory, which increases the probability of the model selecting an incorrect or unrelated tool. Itential’s philosophy is that the agent’s exact tool set is fixed at build time, so at execution the agent can never call a tool it was not explicitly authorized to use. Teams start with read-only tools, and write-capable tools are added deliberately as trust is established. This build-time constraint directly limits blast radius in the event of unexpected agent behavior.

“At build time, when you build the agent, that is when you get to pick what exact tools the agent has access to. When the agent executes, it will never call the wrong tool.” — John Capobianco, Head of AI and Developer Relations, Itential

Q: What advice does Itential give to enterprise leaders who want to start with agentic operations without introducing new operational risk?

Capobianco recommends three concrete starting points. First, establish an AI governance board before deploying anything. Second, give teams access to local, private, open-source models so they can experiment in virtual labs without touching production systems. Third, identify available MCP servers and integrate them into existing tools like Claude Code or a copilot environment to begin learning tool composition in a low-risk context. He also recommends engaging colleagues in software development, who have already worked through the organizational and security challenges of getting models and tools approved.

“Through virtual labs and physical labs and access to private open source models, look for certain MCPs, integrate them into your copilot or your Claude code. It is more about accepting some of the risk and learning the lessons from your colleagues in the software development department.” — John Capobianco, Head of AI and Developer Relations, Itential

Q: What real-world FlowAI use cases are resonating most with enterprise network teams today?

Ticket triage via ServiceNow is among the highest-adoption use cases: an agent reads an incoming ticket through an MCP integration, gathers supporting data from infrastructure sources, and delivers a root cause hypothesis with supporting evidence before a human operator ever touches the ticket. Source-of-truth reconciliation, confirming that offline records in systems like Netbox or Nautobot match actual network state, is another high-value pattern. Port turn-up and turn-down automation is also in production at large customers managing high interface volumes across 24-hour windows, a task Capobianco identifies as low-risk and well-suited for early agent ownership.

“The ticket just tells you: we believe this is the root cause of the issue. We could be wrong. But here is our evidence, here is what we gathered.” — John Capobianco, Head of AI and Developer Relations, Itential

Resources & Documentation

  • Itential FlowAI Platform, agentic automation platform for enterprise network operations combining agent builder, MCP gateway, and deterministic workflow execution
  • Model Context Protocol (MCP), open protocol for connecting LLMs to external tools and data sources, referenced as the integration standard for FlowAI’s gateway
  • Anthropic Claude, LLM provider used for FlowAI’s spec-driven agent building via Claude Code and Anthropic skill integration
  • Netbox, open-source network source-of-truth platform with MCP server support, cited as a primary integration target for reconciliation agents
  • Nautobot, network source of truth and automation platform with MCP server support, positively referenced as a tool binding target
  • Opsmill, network automation and source-of-truth platform cited as having an available MCP server for agent integration
  • Ollama, local LLM server recommended for air-gapped and data-sovereign enterprise environments as a bring-your-own-model option
  • LM Studio, local model hosting tool cited as a supported bring-your-own-model option for on-premises deployments
  • Microsoft Foundry, local model server cited as a supported option for enterprises hosting models on-premises

***

👇 Click to Read Full Raw Transcript

Swapnil Bhartiya: As we all know, AI agents are moving very fast. But when it comes to enterprise infrastructure, speed means nothing without trust. The real blocker is not building a smart agent, it is giving them safe access to real systems without losing control. And when it comes to agents and controls, these things are like oil and water. They’re hard to mix. That is exactly what FLOWAI is built to solve. And today we have with us John Copy Bianca, head of AI and developer relations at Initial to unpack how enterprises can bring AI agents into network operations with governance built in from start so you don’t lose their capabilities or their trust and get full advantage of AI. John, it’s great to have you on the show, so thank you so much for the introduction.

John Capobianco: And you’re right, we are entering a very exciting time. I would argue a time of opportunity and a time, I think a Cambrian period. I think that, you know, I don’t want to get too technical too quick, but things like the model context protocol is maturing on two years. Open Claw is maturing on to almost a year. Things have moved very fast in the agentic space and from individual contributors all the way to large enterprises. So I want to thank you for having me here today and I think it’s an important discussion and you know, I like to think of agents almost as a brand new member of your team. Now my team was network operations and architects and you know, designers and security people and everyone who would make up the team that would manage a network infrastructure. Imagine a new member of the team comes along. My very first task is not going to be a write activity of complexity on some critical piece of infrastructure. I think the same roadmap can be followed with these agents in that they can be given read only access. They can be given day one, day two tasks as if they were a junior or a new member of the team. You know what, let’s document the network. Let’s, let’s test the network, let’s do some compliance reporting. Let’s make sure that our, you know, if we have a source of truth offline, that it’s accurate and up to date and reflects the reality of the network. Let’s maybe intercept tickets and try to triage them and add some summary, some analysis without making changes. So the agents have to earn our trust, much like a new member of the team kind of earns the trust over time we can introduce those change right activities where the agent takes on more risk and takes on more autonomy. You know, a study was done recently by one of our customers and they found that 64% of their operators are doing read only activities. 64% of a network engineer’s job more or less is doing read only information gathering. They’re trying to troubleshoot a problem. They’re to trying, trying to plan for a change. They’re simply gathering information out of the infrastructure. So why not hand that task off to an agent that you’re in control of and let the agent take care of 60% of your job, you know, and actually summarize that data and give you root cause analysis. I think we can take huge leaps forward.

Swapnil Bhartiya: Swapnil can you quickly tell our audience a bit about your it is the

John Capobianco: agentic platform for enterprise operations. We make it easy to build and execute agents as well as deterministic workflows such as ansible playbooks or Python scripts or terraform jobs.

Swapnil Bhartiya: What exactly is flowai and how does it help enterprises move from deterministic workflows to AI agents in network operations?

John Capobianco: Our FlowAI platform has two different interfaces. You can interface through a skill from Anthropic and do this through spec driven development where you describe in natural language the agent you’d like to build and the outcomes you want to achieve. And there’s a traditional GUI builder system that lets you input, you know, the Persona of your agent, the outcomes of the agent and what’s neat is at build time we get to select the tools. So it’s very safe, it’s very full of guardrails. There’s role based access control, there’s OAuth 2 through IMCPs. So we’re really excited about the FlowAI platform.

Swapnil Bhartiya: When we look at network operations, what roles do AI agent play or what kind of problems they create. So talk a bit about AI workflows, the challenges and the opportunities they create in network operations.

John Capobianco: So the challenge is like introducing a new human onto your team, right? We have to make sure that they’re following standards and methods of procedures and that they’re following specifically change requirements. And I see agents very similar where you’re going to incorporate them through read only safe human in the loop activities. You know, almost 65% of what a network engineer does is read only activities. So we see a nice safe onboarding experience for our customers to start incorporating agents immediately with huge value but very, very low risk. Over time we start to increase the risk and start maybe introducing write operations. But some of the challenges are that organizations need to have their own AI governance board and own AI strategy approved LLMs. Data governance, quality of data. There’s a lot of things that go into making a quality agent that are outside of our control. But we work with our customers to make sure they’re binding the right tools, they’re binding determinism and have a really clean pathway to success.

Swapnil Bhartiya: How is network operation different when it comes to AI and network especially, what is the real bottleneck? Is it AI’s capability? Is it cost and token consumption? Or is it more about trust? And how does FlowAI address the safety and security concerns that keep agents stuck in sandboxes and chat box because they cannot be trusted enough to actually take actions?

John Capobianco: I think it does boil down to trust. It really does come down to trust. So we feel that we have a track record and we can earn that trust again. A roadmap through read only activities, human in the loop, human on the loop and then ultimately human in the lead. We want humans to lead these agents and we have things like role based access control, things like AAA and audit and audit trails. So we can show you when and what the LLM reasoned as well as the tool and the tool payload that it called. You’re in full control as a customer over the model you use and the provider you use. And it’s also governed through things like OAuth2. If you’re talking about our model context protocol server with bearer tokens and fine grained access control. I know none of this sounds very sexy to the operator, but it sounds appealing to the leader of the enterprise. These are the things people care about. They’re not going to just turn any agent loose that someone has made from an open source project on their network. Network is critical. Network touches everything. Maybe that’s why it’s a little, I don’t want to say slower, but more. It’s a little more hesitant, a little more prudent. Networks take a little while to adopt. We’ve seen the lack of adoption of basic network automation for the last 10 years, but I think this is different. I don’t think enterprises are going to wait 10 years to adopt AI for network infrastructure. The only advice I can give network operators and network leaders is talk to your peers in the software department that you work in. They have gone through this. They have gone through the pain of getting approved models and getting approved tools and getting access to these tools in a safe, confined way. So bridge that gap. It’s just like the network automation story. You talk to the developers about Python and how to learn Python and apply it to networks. Now we’re doing the same thing, except ask those developers the pitfalls, the gotchas, what they’ve learned how to use models, how to distribute tokens and access to AI. So I think that there’s parallels here that we can learn from.

Swapnil Bhartiya: Can you talk about the architectural difference between build only platform and initials approach of building the reasoning layer and execution layer together under the same governance model?

John Capobianco: So it actually lets us centralize and allows for a lot of reuse and a lot of, you know, multi tiered projects. Meaning you can bring, let’s say the PI ETS MCP server onto the gateway and now that server is able to host tools that are spawned asynchronously in separate sessions from various agents. So imagine that, right? Or, or let’s just take for example the Netbox MCP server for a source of truth or Nautobot or opsmill, they all have MCP servers. Now you could bring those tools onto our platform and attach them deterministically to agents at build time and say, listen, I want to use PY ETS to get the state of my network, maybe IP addresses or interfaces, and I want to put them into my source of truth. That could be an agent. You and I could have built that and run it and have results at Netbox before the end of this conversation.

Swapnil Bhartiya: We are living in a phase where there are many geopolitical crises, regulations, governance and of course the whole FUD around AI. At the same time there are movements towards software and AI. Now, as I said, the network is at the very center of all this movement. What role does flow AI play in better governance for regulated industries, compliance, heavy industries?

John Capobianco: Well, I think it plays a big space in, let’s say combating shadow AI, where AI is sort of distributed and people are using their own tokens and their own keys or different models that haven’t been approved, we provide that platform and that ease of platform so people have a nice GUI experience they can log into, they can use chat, GPT or cloud code. Excuse me, to chat with our platform through our MCP server or other mechanisms like our skill. It plays a critical role because we don’t want just rogue agents. Imagine the sprawl of automation scripts for the past 10 years. Distributed scripts, my script, your script, last versions of script, no version control, no source control. So think of our platform as that sort of GitHub for your agents. There’s version control, there’s source control. The other thing is, is that the model itself, we have a bring your own model approach and bring your own provider approach. So for those air gapped environments, for those environments that may be are a little bit concerned about the political overreach and models being maybe withdrawn or access to certain models or they don’t maybe trust the cloud hyperscalers to handle their network information. You can bring your own Olama Server, LM Studio Server, Microsoft Local Server, Foundry Server, and host your own local model in your own data center on your premises. And our agents are more than happy to make the API calls and use those models. So right, we want to, we want to be Switzerland here and let people bring their own tools, bring their own models, bring their own providers, so that way they can start building agents and start seeing the benefits of artificial intelligence in production.

Swapnil Bhartiya: Let’s go back to Flow AI and its three core pieces, Flow Agent, Flow Agent Builder and Flow MCP Gateway. Can you talk about how they work together for infrastructure teams that are managing role based agents?

John Capobianco: Right, so the builder is going to be the seamless building process that anyone can follow. Anyone can dump their domain specific knowledge into this builder experience either through the skill and CLAUDE code or through our gui. The gateway for MCP is going to allow you to bring your own MCP server. And MCP servers aren’t necessarily just public facing a lot of enterprises internally starting to make a lot of MCP servers available. So imagine bringing your in house tools into a platform that then can be bound to the agent. And then we have that execution runtime environment where everything is secure and extremely limited access, where the actual agents are executing. In terms of audit and compliance, like I said, there is an audit trail that shows you every decision or reasoning step that the agent may have made as well as the tools that they called. It has the token count and the execution runtime in terms of how long it took to run. So in terms of compliance over time, right, these agents are. You can audit these agents, you can hand over exactly what happened. Maybe if there was, you know, if you wanted to see how it solved the problem, how it came to the conclusion of a certain problem needed to be resolved, all of that information is available to the operators.

Swapnil Bhartiya: If I’m not wrong, you folks maintain the position that governance has to be built in at build time, not later at runtime. What does that mean in practice? And where do humans in loop checkpoints fit in?

John Capobianco: So what we mean by that is sometimes so mc, the, the, the LLM is going to reason and try to pick the best tool, but if it has access to too many tools or the wrong tools, there’s more of an opportunity for it to, I don’t want to say hallucinate, but for it to pick the wrong tool or, or be confused about the the selection of tools or use a tool that that has nothing to do with its, its tasks. Right. So at runtime some solutions with agents just let the agent reason and decide what tools to use. We have a different philosophy over the governance of this and the guardrails that at build time when you build the agent, that is when you get to pick what exact tools from MCPs or existing workflows or emails or Slack or whatever you want for your communication stack. It’s all at build time. So when the agent executes, it will never call the wrong tool. And if you want to be very careful and do just read only activities you provide it read only tools. When you earn trust and want to add a write capable tool, that’s when you can do so. Right. So there’s a lot of governance in the actual building of the agents. We have a lot of faith that they will do what they’re supposed to do when they run. But we can limit the blast radius, we can limit the exposure exposure to our networks if at build time we actually select the right tools.

Swapnil Bhartiya: For those enterprise leaders who are looking at agentic operations right now, what advice do you have? What is the best place to start without creating new operational risk and be ready for the future since things are moving so fast.

John Capobianco: So I would recommend that first establish an AI governance board. Right. That’s the first thing I would recommend to leaders if you do not have one. The other thing is I would strongly recommend you give your team access to local open source free models that are private and local and let them start experimenting in labs. Experimenting with virtual labs. Stay away from production. There’s a long way to go. There’s a lot to learn. But through virtual labs and physical labs and access to private open source models, I would look for certain MCPs. I would try to integrate them into your copilot or your Claude code. Right. So it’s more about accepting some of the risk and looking at the right tools and seeing how they can be applied and learning the lessons from your colleagues in the software development department.

Swapnil Bhartiya: As flow AI reaches general availability, what kind of real world use cases or deployment patterns are you seeing that resonate most with enterprise teams today?

John Capobianco: Right, So I did mention a few of them. We have customers doing a lot of ticket triage seems to be very popular. So a ticket come in through ServiceNow and through the MCP the agent can read the ticket and then through other MCPs it can gather information and come to a much like a triage like an early assessment before it goes to a human operator. So now that human operator maybe is saving hours of work work doing the research into what the problem’s root cause is. And the ticket just tells you we believe this is the root cause of the issue. Right? We could be wrong. But here’s our evidence, here’s what we think, here’s what the information we gathered. Other things like testing documentation are very popular sources of truth reconciliation to make sure that your offline records match the reality of your network. And then even things like port turn up. Some of our customers are very large and have a lot of interfaces that have to be turned up or turned down over 24 hours. That’s a perfect opportunity, a low hanging fruit, low risk opportunity for an agent to step in and handle those port turn ups and turn downs.

Swapnil Bhartiya: John, thank you so much for joining us and sharing these insights on what it takes to make AI agents operationally safe for real enterprise infrastructure. Thank you so much for your time today and I look forward to chat with you again.

John Capobianco: Thank you for having me, I really appreciate it.

One-Size-Fits-All GPU Clusters Are Failing AI Workloads | Dr. Robert Blumofe, Akamai | TFiR

Previous article