Most internal developer platforms fail their first real internal customer. Teams over-abstract early, ship a rigid one-size-fits-all experience, and then spend months retrofitting flexibility they should have designed in from the start. At enterprise scale, that mistake compounds: every team waiting on platform changes is a team not shipping product.
In this interview on TFiR, Corey McGalliard, Engineering Manager at Akamai Cloud, walks through how his team is building a modular, cloud-native internal platform on the CNCF stack, what went wrong early, how they scoped AI agents safely inside Kubernetes, and why the hardest problems in platform engineering are never the technical ones.
Guest: Corey McGalliard, Engineering Manager at Akamai Cloud
Show: TFiR
Here is what every platform engineer and internal developer platform team needs to know.
Technical Deep Dive
Q: What is the core job of a platform engineering team?
Corey McGalliard, Engineering Manager at Akamai Cloud, frames the job as complexity transfer rather than complexity elimination. You cannot destroy the complexity inherent in change safety, security, and compliance, but you can move it from product developers onto the platform team. That shift lets product engineers focus entirely on delivering well-built software instead of managing infrastructure concerns.
“You can’t really destroy the complexity, but you can shift that from the developers who are building the products and services to a team who is building the platform that enables them to go faster.” — Corey McGalliard, Engineering Manager, Akamai Cloud
Q: How does Akamai approach platform engineering for its cloud infrastructure?
McGalliard’s team is applying CNCF tooling to Akamai Cloud the same way Akamai’s external customers would use it, building cloud-native practices on top of Kubernetes. Clusters are provisioned cheaply and handed to individual product teams, but those clusters are not vanilla. Each one ships with a defined security posture, observability tooling, and policy enforcement already configured. The goal is a faster, safer path to production without making product teams responsible for infrastructure decisions.
“You don’t just get a cluster. We have expectations of what that cluster looks like, who can communicate with it, and you have all of these capabilities built into it that we then hand to the engineer.” — Corey McGalliard, Engineering Manager, Akamai Cloud
Q: What is the CNCF open source stack that Akamai Cloud uses internally for platform engineering?
The Akamai Cloud internal platform is built on Kubernetes, with Crossplane and Argo CD handling cluster provisioning. The observability stack follows the standard CNCF pattern: OpenTelemetry for instrumentation, Prometheus for metrics, Grafana for visualization, and Loki for log aggregation. Kyverno handles policy enforcement, ensuring that any actor interacting with a cluster, whether an intern, a senior engineer, or an AI agent, is operating within defined guardrails.
“It doesn’t matter whether it’s an intern, a senior engineer, or an AI agent interacting with these clusters. How do we make sure that what is applied against the cluster is safe to go out into production.” — Corey McGalliard, Engineering Manager, Akamai Cloud
Q: What is the biggest mistake teams make when starting platform engineering?
McGalliard’s team fell into the abstraction trap: building a platform so simplified that it assumed too much and left no room for legitimate flexibility. Their first large internal customer immediately surfaced requirements the platform could not accommodate. The lesson was that platforms need modularity, not just simplicity, so that users can contribute back and domain experts from across the organization can extend the platform rather than waiting on a central team.
“You can’t immediately make a one-size-fits-all solution, but you can build a more modular way and give the ability to make the system flexible.” — Corey McGalliard, Engineering Manager, Akamai Cloud
Q: How is AI changing platform engineering, and what should teams be cautious about?
McGalliard is direct that no one has a definitive answer yet. What is becoming clear is that AI is accelerating exposure of practices teams should have had in place for years: policy as code, appropriately scoped RBAC, and hardened cluster configurations. The platforms that have invested in these fundamentals are the ones that can safely introduce AI agents. Teams that skipped those foundations are now exposed.
“Having policy as code in your stack, having appropriately scoped RBAC, these are what’s going to allow us to feel comfortable enabling AI agents and MCP servers inside of our stacks.” — Corey McGalliard, Engineering Manager, Akamai Cloud
Q: How is Akamai Cloud using AI internally within its platform engineering workflows today?
McGalliard’s team has deployed AI in two concrete workflows. First, AI code review provides an additional pass on every change going out, reducing the chance that issues reach production. Second, when end-to-end platform tests fail, AI reads the resulting log output and surfaces the root cause, cutting the time engineers spend manually searching through thousands of log lines. Both are practical, scoped, and already delivering measurable time savings.
“We have AI reading these logs and kicking it out to us. That’s really cut down a lot of time of my engineers going, where’s the error?” — Corey McGalliard, Engineering Manager, Akamai Cloud
Q: What is K Agent and how is Akamai using it to bring AI into Kubernetes operations?
McGalliard describes K Agent as an agent gateway: a service that lets AI agents and models running outside the cluster interact with it through a controlled interface, including integration with MCP servers. The practical use case is enabling support personnel to ask natural language questions about cluster state without requiring deep Kubernetes expertise. At Akamai, K Agent is being implemented with read-only access, giving teams visibility without granting write permissions to any automated system.
“We don’t want it to touch the cluster. We just want it to be able to give us information out of the cluster. Let’s get the benefit out of visibility and then we can grow and learn as the industry does.” — Corey McGalliard, Engineering Manager, Akamai Cloud
Q: What is the right posture for granting AI agents access to Kubernetes clusters?
McGalliard draws a deliberate line between read access and read-write access for AI agents. He acknowledges that some teams are moving quickly toward giving agents full controller-level access inside clusters, but his position is to start with read-only visibility, extract value from observability, and let permissions expand only as the industry develops clearer best practices. The mental model is the same as onboarding any human: scope access to the minimum needed for the current role.
“Some people are really bullish and they’re like, let’s go ahead and put controllers and agents inside the cluster and let it have read-write access. I’m more conservative: let’s have read access. Let’s get the benefit out of visibility.” — Corey McGalliard, Engineering Manager, Akamai Cloud
Q: What is the hardest challenge in platform engineering at enterprise scale?
McGalliard is unambiguous: the hardest problems are interpersonal, not technical. Building relationships with internal teams, understanding their actual needs, and earning the trust required for them to adopt and contribute to a shared platform takes more sustained effort than selecting the right toolchain. The technology choices, while important, are the easier part of the equation.
“Technology helps us care for a neighbor well. The harder piece of all of this is working with people.” — Corey McGalliard, Engineering Manager, Akamai Cloud
Q: What advice would you give a team just starting its platform engineering journey?
McGalliard’s top recommendation is to get into the CNCF Platform Engineering technical community group immediately. Attending community calls exposes teams to how organizations across industries, including banks, enterprises, and cloud providers, are solving the same problems. It breaks the internal echo chamber and provides both validation that your direction is sound and exposure to approaches you have not considered. Conference attendance compounds that benefit.
“I step out and go to these community calls and hear how a bank in Scotland is doing their stuff. We’re all working together, driving the same direction. It encourages me to know that I’m making sane decisions.” — Corey McGalliard, Engineering Manager, Akamai Cloud
Q: What in the CNCF ecosystem is most exciting for platform engineering right now?
McGalliard points to eBPF-powered observability as the most technically significant development in the space. The ability to pull kernel-level telemetry without granular manual instrumentation is reshaping how teams approach networking and visibility inside clusters. Beyond specific tools, he sees a broader maturation happening in the platform engineering community itself: conversations are shifting from which technologies to use toward how to frame and solve harder organizational problems.
“The work being done with eBPF and observability has really impacted the way we do networking. The fact that we can move into a situation where we don’t have to instrument things as granularly but just get information from the kernel, that’s super interesting.” — Corey McGalliard, Engineering Manager, Akamai Cloud
Resources and Documentation
- Akamai Cloud, cloud computing platform from Akamai powering the internal platform discussed in this interview
- Crossplane, CNCF project for infrastructure provisioning via Kubernetes-native APIs
- Argo CD, declarative GitOps continuous delivery tool for Kubernetes
- Kyverno, Kubernetes-native policy engine used for cluster governance at Akamai
- OpenTelemetry, vendor-neutral observability framework for traces, metrics, and logs
- Grafana, open source visualization and observability platform
- Loki, horizontally scalable log aggregation system from Grafana Labs
- Prometheus, open source metrics and alerting toolkit for Kubernetes environments
- eBPF, Linux kernel technology enabling high-performance networking and observability without code instrumentation
- CNCF Platform Engineering Working Group, technical community group for platform engineering practitioners
***
👇 Click to Read Full Raw Transcript
Swapnil Bhartiya: If you look at platform engineering today, it has become or is becoming the backbone of how modern software is getting built and being deployed. And when you look at companies size of Akamai, that’s not a small feat. Today we have with us Corey McAlliard, engineering manager at Akamai Cloud. When we look at platform engineering it’s very well defined. But when we look at Akamai and the scale at you folks were also people may not know that when it comes to cdn, Akama is a pioneer. You know, you folks kind of, you know, your founder invented it in a way. From your perspective, how do you see platform engineering?
Corey McGalliard: The most critical aspect of when I think about what we’re doing as a team is the fact that we’re taking complexity and you can’t really destroy the complexity, but you can, you can shift that from the developers who are building the products and services that we sell sell to our customers, to a team who is building the platform that enables them to go faster. Right. And so the goal of what we’ve been doing is to take the change safety, security, compliance expectations that the company has and shift them to my team so that we’re concerned about that and then gives developers the ability to just focus on delivering well built products.
Swapnil Bhartiya: So what does platform Engine look like within Akamai?
Corey McGalliard: So I’m in a very interesting position to where I get to kind of work with my team to think about how do we do this in a cloud native fashion. So historically Akamai has been around for a long time and they were actually somewhat pioneers of platform engineering. We’ve been doing this on the CDN side for years. We have practices that are over there. And now that Akamai cloud is starting to grow, we’re trying to look at how the CNCF and their tools are thinking about platforms and applying it to ourselves in the same way our customers would use lke and apply platforms on top of that or use that platform stuff that we have available for us.
Swapnil Bhartiya: Since you mentioned CNCF tool. So I would also love to know what does the CNCF or open source stack looks like inside Akamai and Akamai cloud.
Corey McGalliard: So the stack that we’re working on is obviously built on kubernetes, right? Right now we’re using a combination of crossplane, Argo CD to kind of provision clusters internally. And the way we approach it, clusters are cheap so we hand them to teams and the teams are able to build on top of that. But the core of what we’re looking at is like so you don’t just get a cluster, right. We have expectations of what that cluster looks like, allow us to get against it. Like who can communicate with it. You have the ability to focus on the observability aspects of it. Like so if you’re just going to vanilla cluster, but you get a position to where you have all of these capabilities built into it that we then hand to the engineer. Right. And so we’re trying to give you a faster time to delivery, like a faster path to production. And that’s kind of, kind of the goal. So that looks like again, Argo Crossplane. You ask me about the things we’re using. Cross plane. The observability stack is pretty typical. So Open Telemetry, Grafana, Loki, Prometheus. I’m trying to think of some of the. Oh Kyberno as a policy agent. Like so again we need to be very aware of kind of what’s happening in our cluster and write policies so that it doesn’t matter whether it’s an intern, a senior engineer or an AI agent that’s thinking about like interacting with these clusters. How do we make sure that what is applied against the cluster is like safe, safe to go out into production.
Swapnil Bhartiya: When we look at teams, you know, maybe your teams or other teams that you know because Akamai also serve a lot of customers and you partner a lot. Where do you see they are doing platform engineering wrong? Where you like they don’t fully grasp the concept of where you’re like this is how it should be done. So let’s focus first on what people are doing wrong. When it comes to platform engineering.
Corey McGalliard: That’s a really hard question. One thing that a trap that we fell into, and I’m sure other people have done this as well, is right, you try to abstract away everything, you try to make it to where it’s as simple as possible for someone to pick it up. So in kind of the way you think about this, you have the idea of, of like having all the bells and whistles, having a very like configurable flat platform. And then you have on the other side something that’s more closer to a PAAS or like a software as a service kind of mentality, right. And a lot of us when we start looking at this, oh, we just want to give it so that build it so that you can just hand us a container. There’s a lot of assumptions that go into the way that that works. It’s really complex, right. And what we fell into, we started to go down this path and our first large customer just immediately started saying, well, I need this flexibility or that flexibility. So we learned that not only do we need to kind of consider flexibility in the platform, but we also need to extend almost like modularity to our users so they can contribute back to us and that we can also pull in other expertise within the organization. It’s not all on one team, but it’s more about pulling in the expertise you have throughout the organization to build the platform. Right. So you can’t, you can’t immediately make this like one size fits all solution, but you can build a more modular way and give the ability to make the system flexible. Right. Does that make sense?
Swapnil Bhartiya: It does make sense and thanks for sharing that also. Now, one thing that I’m going to ask is, which may not make sense too much is AI, you know, so talk a bit about how is AI changing, transforming, whether for better or for worse, the whole platform engineering discipline right now.
Corey McGalliard: I think if anyone tells you they know the answer to this, they’re not being truthful. And tell me the answer. Sure. I think more of it is like, what am I seeing in the industry? And the reality of it is during the keynote yesterday here, they talked about like what AI and like the zero day findings that we’ve seen over the last few months really highlights the practices that we need and reliability and resilience that we’ve done for, should have been doing for 20 years are just getting highlighted, right? And so this is true in platform engineering, right? So having policy as code in your, in your stack, right? Having appropriately scoped rbac, these things are what’s going to allow us again to, to basically feel comfortable allowing AI agents, MCP servers inside of our stacks, pushing changes to it, right? Because everything’s appropriately scoped. It’s no different than giving an intern access to your cluster, no different than giving a senior developer access or an SRE access to your cluster. Right? And so that’s kind of the mentality is having the appropriately scoped system so that when you start enabling these services, you can feel comfortable.
Swapnil Bhartiya: How are you folks using AI, you know, internally to build a platform or of course Akamai serves a lot of customers. So how are you also building the platform to serve AI workloads?
Corey McGalliard: So today my team, I’ll speak from a today standpoint, right, because there’s some ideas we have that are kind of propagating, that are going to improve things. But today we have AI code reviews validating what we’re doing. It gives us a second or a fourth set of eyes on everything we’re pushing out. We have the ability to see if we see failures in our testing stack. We have AI review those logs. And so we test our platform end to end. We’re able to build a cluster and tear it down. And the goal is to have a very clear understanding of what failed during our testing cycle. We have AI reading these logs and kicking it out to us. That’s really cut down a lot of time of my engineers going, where’s the error? Because you have thousands of lines of lines of logs and then it helps them find exactly kind of what’s. What’s going on. So those are two really practical examples of where AI is working. And then the thing that we’re working on is using a service called K Agent. I’m not sure if you’re familiar with this, right. To extend the ability to have an agent interact with a Kubernetes cluster and have someone in a more of a support role be able to ask you questions, hey, what’s wrong with this cluster? Can you give me feedback to this cluster? And that’s all really, really new and very, very well. And the challenge we worry about is being well scoped, having appropriate rbac, right? We don’t want it to touch the cluster. We just want it to be able to give us information out of the cluster at this point. And I think that’s kind of where a lot of people are sitting, right? Like some people are really bullish and they’re like, let’s go ahead and put controllers and agents inside the cluster and let it have read write access. I’m more conservative in saying let’s have read access. Let’s get the benefit out of visibility and then we can grow and learn as the industry does and what is key.
Swapnil Bhartiya: Agent permission.
Corey McGalliard: K agent. How do I explain this? It’s basically, I want to call it an agent gateway, right? It gives you the ability to interact with agents, give it access to the cluster it’s running on and also tie into MCP servers. So it gives you a chat interface to be able to ask it questions about the cluster.
Swapnil Bhartiya: It’s kind of becomes a bridge between agents and MCP server so that the agents and the models all run outside the cluster. And it just gives you the ability to like say, here are my logs, go look at it.
Corey McGalliard: Yeah, I’m probably explaining that poorly. I’ve got very, very smart group of people who work with me and day after Kubecon last year they demoed this and it was amazing. And so we’ve been working on implementing it.
Swapnil Bhartiya: When it comes to platform engineering and companies size of a combined, what is the hardest challenge?
Corey McGalliard: I think it’s the same in any organization and it’s communication and it’s more interpersonal than it is technical tools. Everybody’s in the industry kind of understands this, that you have technology available to us. Right. With AI, it’s growing even faster. The problem is the interpersonal pieces. Right. Like so building their relationships with all the internal teams, understanding their needs. Right. And ultimately that’s what technology does. It helps us care for a neighbor well. And that’s why I’m excited about what I get to do because I get to work with this whole group of people and we get to think about what they’re building and help them do that faster and we’re able to care for them all. And that’s actually the harder piece of all of this is working with people.
Swapnil Bhartiya: People is the hardest no matter what. So the only difference is that the size of more people doing training, we have just plenty versus more. If there is an organization, teams are is starting their platform journey, platform engineering journey. What is your advice to them?
Corey McGalliard: Get involved in community. Right. So I attend the CNCF as a platform, a technical community group for platform engineering. I’m involved in this. There are like some brilliant people. And honestly the biggest benefit of coming to conferences like this and then being involved in the community group is being in a position to where I get outside of the echo chamber that I live in inside of Akamai. We all experience this. We all like live in a bubble at work. Right. And then I step out and I go to these community calls and I hear how a bank in Scotland is doing their stuff right. How like we’re all working together, driving the same direction. Right. And it encourages me to know that I’m making sane decisions. But it also gets me to think about problems differently and start there and then learn from people who’ve gone down this path and then start implementing things.
Swapnil Bhartiya: Excellent. Thank you. And if you look at CNCF landscape or CNCF ecosystem, right now, what are some of the things if you just narrow. Because they do a lot of things, narrow it down to platform engineering. What do you think that gets you excited today?
Corey McGalliard: Things that get me excited about what’s happening at CNCF today. So the observability space has always been very interesting to me. Having visibility into what’s going on inside of our systems. The work that’s being done specifically with EBPF and observability in that space, I mean, it’s really impacted the way we do networking. Right. And I have some friends who work in the observability and so the strides that I’m seeing there, the fact that we can move into a situation to where we don’t have to instrument things as granularly, but you just get information from the kernel. That’s super interesting to me. And then yeah, man, like just overall, like conversations that I’m having with people in the platform engineering space about how like it’s less focused about technology, but more focused on like a higher level of how we solve a problem. Right. And I’ve been in this space for a while and I’m really seeing as an industry we’re really coming around to like solving hard problems.
Swapnil Bhartiya: Corey, thank you so much for joining me. And not only sharing your insights on what is platform engineering, how Akamai is leveraging it, but also sharing your insight, how other teams should do it better and also focus was more on people that is also critical and also share some of the mistakes that people made that they should avoid. It was a great, insightful discussion. I would love to have you back on the show, but I really appreciate it.
Corey McGalliard: Thank you. Thanks for having me.





