Lessons › Data centre networking
Leaf-spine: how modern data centres are wired
▶ Start the interactive lesson
An older office network looks like a tree: a core switch, some distribution switches, lots of access switches below. Traffic mostly goes up to the internet and back down. Your new data centre is different. Thousands of servers talk to each other constantly. Sam draws two rows of boxes on the…
Why the old tree struggles
The classic three-tier design (core, distribution, access) was built for north-south traffic: users going out to the internet.
Leaf and spine
Leaf switches sit at the top of each rack (often called top-of-rack, ToR). Servers plug into leaves.
All links active: ECMP
Instead of blocking links with Spanning Tree, leaf-spine networks usually run routing (often BGP) between leaves and spines.
Growing and oversubscription
Need more servers? Add a leaf and cable it to every spine.
Key points
- Data centres are mostly east-west traffic: server to server.
- Leaves (top of rack) connect servers. Every leaf connects to every spine; leaves never connect to each other.
- Any server reaches any other in leaf → spine → leaf. Routing plus ECMP uses all links at once.
- Oversubscription = down vs up bandwidth. AI clusters aim for 1:1 non-blocking.
Words you'll learn
Leaf / ToR (top of rack) · Spine · North-south · East-west · ECMP (equal-cost multi-path) · Oversubscription ratio · Non-blocking (1:1) · Fabric / Clos network