memory interface design
**Memory Interface Design** is the **specialized discipline of designing the physical interface (PHY) and controller logic that connects a processor or SoC to external DRAM memory** — requiring precise timing calibration, signal integrity management, and protocol compliance to achieve the multi-gigabit-per-second data rates that define system memory bandwidth and directly determine application performance.
**Memory Interface Components**
| Component | Function | Location |
|-----------|---------|----------|
| Memory Controller | Schedules read/write commands, manages refresh | Digital logic on SoC |
| PHY (Physical Layer) | Drives/receives signals, handles timing calibration | Analog + digital on SoC |
| Package/PCB | Signal traces from SoC to DRAM | Board-level |
| DRAM | Stores data | Separate chip(s) |
**DDR Generations and Data Rates**
| Standard | Data Rate | Voltage | Prefetch | Use Case |
|----------|----------|---------|----------|----------|
| DDR4 | 1600-3200 MT/s | 1.2V | 8n | Desktop/server |
| DDR5 | 3200-8800 MT/s | 1.1V | 16n | Latest desktop/server |
| LPDDR4X | 2133-4266 MT/s | 0.6V | 16n | Mobile |
| LPDDR5/5X | 3200-8533 MT/s | 0.5V | 16n | Mobile, automotive |
| HBM3/3E | 4800-9600 MT/s | 1.1V | varies | AI accelerators |
**PHY Design Challenges**
- **Timing calibration**: Read data arrives with unknown skew — PHY must train DQS-to-DQ alignment.
- Write leveling: Align DQS to CK at DRAM.
- Read leveling: Center DQS within DQ data eye.
- Per-bit deskew: Each data bit has its own delay calibration.
- **Signal integrity**: At 4800+ MT/s, reflections, ISI, and crosstalk dominate.
- Equalization: DFE (Decision Feedback Equalizer) in the receiver.
- Impedance calibration: ZQ calibration matches driver impedance to PCB trace.
- **Voltage references**: VREF training determines optimal receive threshold.
**Memory Controller Design**
- **Command scheduling**: Minimize latency while respecting DRAM timing parameters (tRCD, tRP, tRAS, tFAW).
- **Bank management**: Interleave accesses across banks/bank groups for bandwidth.
- **Refresh management**: Schedule refresh commands without blocking too many accesses.
- **Reordering**: Out-of-order command scheduling to maximize DRAM page hits.
- **QoS**: Priority-based scheduling for latency-critical vs. bandwidth requestors.
**Power Management**
- DDR power states: Active → Idle → Power-Down → Self-Refresh.
- LPDDR: Deep Sleep → full memory contents retained at < 5 mW.
- Controller manages state transitions to minimize power while meeting performance.
Memory interface design is **one of the most critical subsystems in any SoC** — the memory bandwidth wall is the primary performance limiter for modern workloads from AI inference to gaming, making PHY design quality and controller scheduling efficiency direct determinants of system-level performance.