- Why AI workloads are rewriting the edge playbook
- The density problem: more kW per rack than ever
- Cooling options for AI edge sites
- Power: the real bottleneck
Why AI workloads are rewriting the edge playbook
AI workloads aren't just living in hyperscale clouds anymore. Increasingly, they're running where the data is generated—factories, hospitals, retail hubs, even cell towers. That shift is redrawing the map for edge data center demand, and it's not just about adding more racks. It's about density, latency, and the physics of heat.
Think about an autonomous vehicle testing site or a smart hospital running real-time diagnostics. You can't wait 50 milliseconds for a round trip to a central cloud. The compute has to be local, which means edge facilities are getting bigger AI footprints—and bigger problems with power and cooling.
The density problem: more kW per rack than ever
Traditional edge cabinets ran at 5–10 kW per rack. AI inference nodes, even at the edge, often need 20–40 kW per rack. Training clusters in regional edge hubs can push 100 kW or more per rack. That's not a linear jump—it's a step change in how you design the room.
Higher density means more heat. A 30 kW rack can reject around 100,000 BTU/h. If you're still using perimeter CRAC units designed for 8 kW racks, you're going to have hot spots and equipment failure. The short answer is that edge facilities need cooling that scales with density—either row-based or rack-based systems.
Here's a concrete example: a retail chain deploying AI for inventory tracking might put a small edge site in each distribution center. Each site might have four racks at 25 kW. That's 100 kW of IT load in a room that used to handle 30 kW. Without rethinking airflow and cooling capacity, you'll bake the servers.
Cooling options for AI edge sites
Air cooling still works up to a point. For racks under 25 kW, well-designed hot-aisle containment and precision air conditioning can handle it. But above that, you start looking at liquid cooling—direct-to-chip or rear-door heat exchangers. Liquid is more efficient at moving heat away from the processor.
That said, liquid cooling adds complexity. You need piping, manifolds, and leak detection. For a small edge site without dedicated facilities staff, that can be a headache. Some operators are choosing a hybrid: air cooling for most racks, liquid for the few AI-heavy ones.
| Cooling approach | Max rack density | Typical PUE | Best for |
|---|---|---|---|
| Perimeter CRAC | 10 kW | 1.5–2.0 | Legacy, low-density |
| Row-based precision AC | 25 kW | 1.3–1.5 | Moderate AI inference |
| In-row with containment | 35 kW | 1.2–1.4 | High-density edge |
| Direct-to-chip liquid | 100+ kW | 1.1–1.2 | AI training hubs |
PUE isn't the only metric, but it's a useful shorthand. A drop from 1.5 to 1.2 on a 100 kW load saves about 30 kW of overhead—that's real money over a year. Worth checking your local climate too; free cooling works better in cooler regions.

Power: the real bottleneck
Cooling is only half the story. AI workloads are power-hungry, and edge sites often have limited utility feed. A typical edge facility might have 200 kVA of capacity. If you're adding 100 kW of AI compute, you're near the limit. You need to think about UPS capacity, generator sizing, and power distribution.
Redundancy matters too. An AI inference node for a hospital can't go down. That means N+1 UPS and possibly dual power paths. But you can't just oversize everything—cost and space are tight at the edge. You need modular systems that scale with demand.

One trend is using DC power for AI racks. Some GPU vendors are pushing 48V or even 400V DC distribution to reduce losses. That's still early, but it's worth watching. For now, most edge sites stick with AC, but the conversation is shifting.

What this means for edge data center demand
So what's the net effect? Edge data center demand is growing, but not for the old reasons. It's not just about latency for video streaming. It's about AI inference at the source. That means more sites, but also more capacity per site.
Some analysts predict edge AI infrastructure will grow at over 30% annually through 2030. That's a lot of new builds. But the bigger opportunity might be retrofitting existing edge sites. Many are underpowered and undercooled for AI workloads. Upgrading them is often cheaper than building new.
There's also a supply chain angle. The memory shortage that started in 2025 is still affecting server availability. AI servers need high-bandwidth memory, and that's in short supply. So even if you have the power and cooling, you might wait months for equipment. Plan ahead.
Practical steps for operators
If you're running an edge site and expecting AI workloads, here are a few things to check:

- Audit your current rack density and cooling capacity. Know your limits before you add AI.
- Check your utility feed and UPS headroom. Can you handle a 20 kW jump per rack?
- Consider modular cooling. You can add row-based units as needed, rather than replacing everything.
- Think about liquid cooling early. Even if you don't need it now, design for it. Retrofitting is messy.
- Talk to your power provider. Edge sites often face long lead times for new transformers.
Don't forget the basics. Airflow management is cheap and effective. Seal bypass airflow, install blanking panels, and you might gain 10–15% cooling capacity without spending a cent.

The role of VERHI in AI edge deployments
VERHI provides precision air conditioning, UPS power, and micro-module data center solutions that fit the edge. Our systems are designed for high-density, variable loads—the kind AI workloads throw at you. We work with operators to match cooling and power to actual demand, not just nameplate ratings.
That said, every site is different. Specifications, availability, and installation details can change. Buyers should confirm current options with VERHI or an official source before ordering.
Frequently Asked Questions
What is driving edge data center demand in 2026?
AI workloads are the main driver. Real-time inference for autonomous vehicles, smart manufacturing, and healthcare requires low latency, so compute moves closer to the data source. That increases the number of edge sites and the power density per site.
How many kW per rack do AI edge workloads typically need?
It varies. AI inference at the edge often runs 20–40 kW per rack, while training clusters can exceed 100 kW. Traditional edge racks were 5–10 kW. The jump is significant and affects cooling and power design.
Can air cooling handle AI workloads at the edge?
Yes, up to about 25 kW per rack with proper containment and precision cooling. Above that, liquid cooling is more efficient. Many operators use a hybrid approach: air for most racks, liquid for the AI-heavy ones.
What is the typical PUE for an AI edge data center?
With efficient cooling, you can achieve PUE around 1.2–1.3. Older designs run 1.5 or higher. Lower PUE means lower operating costs, but it depends on climate and cooling technology.
How can I prepare my edge site for AI workloads?
Start with an audit of your power and cooling capacity. Look at modular cooling options, consider liquid cooling readiness, and talk to your utility about lead times. Also, plan for server availability issues due to the ongoing memory shortage.
Planning an AI edge deployment? VERHI can help you size power and cooling for your specific workloads. Contact our team today.
Based on VERHI's engineering experience in precision cooling and modular data center solutions for edge and AI applications.
