chiplet interconnect

**Chiplet Interconnect Standards and Architecture** encompasses the **physical interface, protocol, and packaging technologies that enable multiple semiconductor dies (chiplets) to communicate within a single package** — with UCIe (Universal Chiplet Interconnect Express) emerging as the industry standard for die-to-die communication, defining electrical specifications, protocol layers, and packaging requirements to enable a plug-and-play chiplet ecosystem. **Why Chiplet Interconnects Matter:** The chiplet model disaggregates monolithic SoCs into smaller, specialized dies (compute, I/O, memory, accelerator) that are assembled in a package. This requires die-to-die (D2D) links that are: - **High bandwidth**: >1 TB/s aggregate for AI accelerators - **Low latency**: <2ns for cache-coherent communication - **Energy efficient**: <0.5 pJ/bit (100× better than off-package links) - **Standardized**: Enable mixing chiplets from different vendors/processes **UCIe (Universal Chiplet Interconnect Express):** UCIe 1.0 (2022) and UCIe 2.0 (2024) define a layered architecture: ```svg UCIe: an open, PCIe-like standard for die-to-die linksA layered stack over standard or advanced packages lets chiplets from any vendor or node snap together in one package1 · Layered like PCIeDie ADie BProtocol layerPCIe / CXL / raw streamingDie-to-die adapterlink state · CRC · retry · arbitrationPhysical layerbumps · lanes · clock · sidebandUCIe stacks like PCIe: a physical layer,a die-to-die adapter, and a protocol layerthat just carries PCIe, CXL, or raw streams.Existing software works across the die edge.A sideband channel trains and repairslanes; CRC + retry keep the link reliable.Buy an I/O die from one vendor, a computedie from another — they interoperate.2 · Pick your packagestandard package (organic)reach 10–25 mmcoarse pitch · lower density · cheaperadvanced package (2.5D interposer)~2 mmfine pitch · high density · sub-0.5 pJ/bitThe same UCIe stack runs on both. Youpick the package for your cost-versus-bandwidth target.Reach trades against bandwidth density.3 · What it's really forFigures of merit• bandwidth per mm of die edge• energy per bit (adv: <0.5 pJ/bit)• die-to-die latency < ~2 nsNot raw speed — edge is scarce, so it'sbandwidth and energy per bit that count.Ends the proprietary linksInfinity Fabric, EMIB/AIB and NVLink-C2Ceach stitch one vendor's dies. UCIe isopen, so dies from different vendors andprocess nodes mix in one package.→ a marketplace of composable dies.Crossing a die edge feels almost on-die.Layered like PCIePhysical layer, D2D adapter, protocollayer — and the top reuses PCIe/CXL, sosoftware crosses the die edge unchanged.Two package classesStandard organic for reach and low cost;advanced 2.5D for density and pJ/bit —one stack, two cost/bandwidth points.Open beats proprietaryOne standard link turns chiplets from aone-vendor trick into an ecosystem ofmix-and-match, composable dies. ``` **UCIe Physical Layer Options:** | Package Type | Bump Pitch | Data Rate | BW Density | Reach | |-------------|-----------|-----------|------------|-------| | Standard (organic) | 100-130μm | 4-32 GT/s | ~28 GB/s/mm | <10mm | | Advanced (Si interposer) | 25-55μm | 4-32 GT/s | ~165 GB/s/mm | <2mm | Advanced packaging with 25μm bump pitch provides ~6× the bandwidth density of standard packaging. **Protocol Options:** - **PCIe streaming**: For standard I/O communication (NIC chiplets, storage controllers) - **CXL**: For cache-coherent memory expansion and memory pooling chiplets - **Custom/Raw**: Proprietary protocols for vendor-specific high-bandwidth communication (e.g., AMD's Infinity Fabric, Intel's EMIB-connected tiles) **Existing Proprietary D2D Links:** | Interface | Company | BW/Link | Latency | Application | |-----------|---------|---------|---------|-------------| | Infinity Fabric | AMD | 600 GB/s | ~2ns | MI300X chiplet mesh | | EMIB | Intel | >100 GB/s | <5ns | Meteor Lake, Ponte Vecchio | | NVLink-C2C | NVIDIA | 900 GB/s | ~5ns | Grace-Hopper | | Lipincon | TSMC | 1.6 TB/s | <1ns | CoWoS chiplets | | BoW (Bunch of Wires) | OCP standard | Variable | ~3ns | Open standard | **Signal Integrity Challenges:** D2D links at 16-32 GT/s across microbumps face: **crosstalk** between closely spaced signals (~25μm pitch), **power supply noise** coupling through shared substrate, **impedance discontinuities** at bump transitions, and **thermal effects** on signal propagation. Solutions include: shielding ground lines between signal lanes, equalization (CTLE + limited DFE), and careful power distribution network design on the interposer. **Chiplet interconnect standardization through UCIe is the technical foundation enabling a heterogeneous chiplet ecosystem** — allowing the semiconductor industry to transition from monolithic SoC design to a modular, multi-vendor chiplet assembly paradigm where compute, memory, I/O, and accelerator dies from different companies and process nodes can be combined in a single package.

Go deeper with CFSGPT

Get AI-powered deep-dives, save terms, and run advanced simulations — free account.

Create Free Account