memory stacking
Memory stacking **vertically bonds multiple memory dies** into a single package to increase storage density and bandwidth without increasing the package footprint. The technology behind **HBM** and **3D NAND** packages.
**Stacking Technologies**
**Wire bond stacking**: Dies stacked with spacer film between layers, wire bonds connect each die to the substrate. Up to **8-16 dies**. Used in standard DRAM/NAND packages. **TSV stacking (HBM)**: Through-silicon vias connect dies vertically with thousands of parallel connections. Provides massive bandwidth (**256-1024 GB/s**). Used in HBM2E and HBM3. **Hybrid bonding**: Direct Cu-Cu bonding between dies with sub-1μm pitch. Highest connection density. Emerging for next-generation memory.
**HBM (High Bandwidth Memory)**
**Stack**: **4-12 DRAM dies** + 1 base logic die, connected by TSVs. **Bandwidth**: HBM3 delivers **819 GB/s per stack** (vs. ~50 GB/s for DDR5). **Interface**: **1024-bit wide** data bus (vs. 64-bit for DDR). **Used in**: AI accelerators (NVIDIA H100/H200, AMD MI300), HPC, data center GPUs.
**Challenges**
**Thermal**: Heat dissipation through multiple die layers is difficult. Bottom dies can overheat. **Known Good Die (KGD)**: Every die in the stack must be tested and verified good before stacking. One bad die scraps the entire stack. **Yield**: Stack yield = (individual die yield)^N. For 8-die stack at **99%** per die: 0.99⁸ = **92.3%** stack yield. **Warpage**: Differential thermal expansion between stacked dies causes warpage during processing.