2,221 technical terms and definitions
kv cache, kvcache, attention cache, paged attention, gqa, mqa, context length
KV cache is the memory buffer storing previously computed key and value tensors during autoregressive LLM inference — avoiding redundant computation by caching intermediate…
conversation history, context
Memory Systems for LLM Applications Why Memory? LLMs are stateless by default. Memory systems maintain context across conversation turns and sessions, enabling coherent multi-turn…
long term, persist
Long-Term Memory for AI is the architectural capability enabling AI systems to retain, organize, and retrieve information across sessions, conversations, and time — achieved not…
memory access batching and coalescing, memory access batching, access batching coalescing, memory access, access batching, batching coalescing
Memory Access Batching and Coalescing Introduction & Motivation Memory Access Batching and Coalescing addresses a central problem in performance-optimization process control…
memory access pattern clustering and spatial correlation, memory access pattern, access pattern clustering, pattern clustering spatial, clustering spatial correlation, memory access
Memory Access Pattern Clustering and Spatial Correlation Introduction & Motivation Memory Access Pattern Clustering and Spatial Correlation addresses a central problem in memory…
memory access pattern optimization, memory access pattern, access pattern optimization, memory access, access pattern, pattern optimization
Memory Access Pattern Optimization Introduction & Motivation Memory Access Pattern Optimization addresses a central problem in memory-optimization process control…
memory access pattern prediction and prefetch effectiveness, memory access pattern, access pattern prediction, pattern prediction prefetch, prediction prefetch effectiveness
Memory Access Pattern Prediction and Prefetch Effectiveness Introduction & Motivation Memory Access Pattern Prediction and Prefetch Effectiveness addresses a central problem…
memory alignment padding, memory alignment, alignment padding
Memory Alignment Padding Introduction & Motivation Memory Alignment Padding addresses a central problem in systems process control and alignment-requirement-performance…
sram cache design, memory hierarchy chip, embedded memory compiler, register file design
On-Chip Memory Architecture is the design discipline that organizes the hierarchy of registers, SRAM caches, and embedded memories within a processor or SoC — where memory access…
hbm stacking tsv, wide io memory interface, hbm bandwidth density, hbm thermal management, hbm
High-bandwidth memory (HBM) is DRAM stacked vertically and connected to its host through an interface thousands of bits wide, running beside the processor on an interposer rather…
memory array leakage prediction, memory array leakage, array leakage prediction, memory array, array leakage, leakage prediction
Memory Array Leakage Prediction with Machine Learning Introduction & Motivation Memory Array Leakage Prediction with Machine Learning addresses a central problem in memory array…
Memory-Augmented Autoencoder for Anomaly Detection Introduction & Motivation Memory-Augmented Autoencoder for Anomaly Detection addresses a central problem in anomaly detection…
video understanding
Memory-augmented video models are the architectures that attach explicit read-write memory to video encoders so context from earlier clips can influence current predictions - this…
hardware
Memory bandwidth—the rate of data transfer between processor and memory—is often the primary bottleneck limiting AI inference performance. Modern accelerators achieve hundreds…
memory wall, hbm bandwidth, gddr bandwidth, ddr5 bandwidth, bandwidth bound
Memory bandwidth is the sustained rate at which useful bytes move between a processor and a memory level. It sets the performance ceiling for workloads whose arithmetic units…
memory bandwidth allocation and qos, memory bandwidth allocation, bandwidth allocation qos, memory bandwidth, bandwidth allocation, allocation qos
Memory Bandwidth Allocation and QoS Introduction & Motivation Memory Bandwidth Allocation and QoS addresses a central problem in soc-design process control…
memory bandwidth asymmetry and direction-dependent performance, memory bandwidth asymmetry, bandwidth asymmetry direction-dependent, asymmetry direction-dependent performance
Memory Bandwidth Asymmetry and Direction-Dependent Performance Introduction & Motivation Memory Bandwidth Asymmetry and Direction-Dependent Performance addresses a central problem…
hbm2 memory, advanced packaging, memory stacking
High-bandwidth memory (HBM) is DRAM stacked vertically and connected to its host through an interface thousands of bits wide, running beside the processor on an interposer rather…
hbm3 memory, advanced packaging, memory stacking
High-bandwidth memory (HBM) is DRAM stacked vertically and connected to its host through an interface thousands of bits wide, running beside the processor on an interposer rather…
hbm memory, gpu memory, vram, inference bottleneck, a100, h100
High-bandwidth memory (HBM) is DRAM stacked vertically and connected to its host through an interface thousands of bits wide, running beside the processor on an interposer rather…
hbm memory, memory stacking, 3d memory, dram stacking
High-bandwidth memory (HBM) is DRAM stacked vertically and connected to its host through an interface thousands of bits wide, running beside the processor on an interposer rather…
hbm strategy, business strategy, memory market
High-bandwidth memory (HBM) is DRAM stacked vertically and connected to its host through an interface thousands of bits wide, running beside the processor on an interposer rather…
hbm stacking, hbm process, wide io memory, hbm3
High-bandwidth memory (HBM) is DRAM stacked vertically and connected to its host through an interface thousands of bits wide, running beside the processor on an interposer rather…
bandwidth bound kernel, memory throughput, dram bandwidth, bandwidth efficiency, roofline memory
High-bandwidth memory (HBM) is DRAM stacked vertically and connected to its host through an interface thousands of bits wide, running beside the processor on an interposer rather…
memory bandwidth saturation and contention scaling, memory bandwidth saturation, bandwidth saturation contention, saturation contention scaling, memory bandwidth, bandwidth saturation
Memory Bandwidth Saturation and Contention Scaling Introduction & Motivation Memory Bandwidth Saturation and Contention Scaling addresses a central problem in memory process…
shared memory bandwidth efficiency in heterogeneous systems, shared memory bandwidth, memory bandwidth efficiency, bandwidth efficiency heterogeneous, shared memory
Shared Memory Bandwidth Efficiency in Heterogeneous Systems Introduction & Motivation Shared Memory Bandwidth Efficiency in Heterogeneous Systems addresses a central problem…
memory bandwidth sharing and priority allocation, memory bandwidth sharing, bandwidth sharing priority, sharing priority allocation, memory bandwidth, bandwidth sharing
Memory Bandwidth Sharing and Priority Allocation Introduction & Motivation Memory Bandwidth Sharing and Priority Allocation addresses a central problem in memory process control…
memory bandwidth utilization efficiency prediction, memory bandwidth utilization, bandwidth utilization efficiency, utilization efficiency prediction
Memory Bandwidth Utilization Efficiency Prediction with Machine Learning Introduction & Motivation Memory Bandwidth Utilization Efficiency Prediction with Machine Learning…
memory bandwidth utilization prediction, memory bandwidth utilization, bandwidth utilization prediction, memory bandwidth, bandwidth utilization, utilization prediction
Memory Bandwidth Utilization Prediction with Machine Learning Introduction & Motivation Memory Bandwidth Utilization Prediction with Machine Learning addresses a central problem…
self-supervised learning
Memory Bank is a data structure used in contrastive self-supervised learning to store a large collection of negative sample representations — enabling effective contrastive…
memory fence, memory ordering
Memory Barrier / Fence — a CPU instruction that enforces ordering of memory operations, preventing the hardware from reordering reads and writes in ways that break concurrent…
memory barrier synchronization, memory barrier, barrier synchronization
Memory Barrier Synchronization Introduction & Motivation Memory Barrier Synchronization addresses a central problem in systems process control and barrier-overhead-latency-cost…
advanced test & probe
Memory BIST is specialized built-in self-test for embedded memories using programmable march and stress algorithms - MBIST controllers run memory-specific test sequences to detect…
design & verification
Design-for-test architectures, automatic test pattern generation, and structural fault modeling constitute the digital verification and manufacturing test disciplines engineered…
mbist, built in self test memory, sram bist, memory test pattern
Design-for-test architectures, automatic test pattern generation, and structural fault modeling constitute the digital verification and manufacturing test disciplines engineered…
built in self test, mbist, memory test, sram bist, repair analysis
Design-for-test architectures, automatic test pattern generation, and structural fault modeling constitute the digital verification and manufacturing test disciplines engineered…
mbist controller algorithm, march test pattern memory, bist repair analysis, sram bist test coverage
Design-for-test architectures, automatic test pattern generation, and structural fault modeling constitute the digital verification and manufacturing test disciplines engineered…
memory bist fault coverage prediction, memory bist fault, bist fault coverage, fault coverage prediction, memory bist, bist fault, fault coverage, coverage prediction
Memory BIST Fault Coverage Prediction with Machine Learning Introduction & Motivation Memory BIST Fault Coverage Prediction with Machine Learning addresses a central problem…
mbist architecture controller, mbist march algorithm, mbist repair analysis, mbist self test memory
Design-for-test architectures, automatic test pattern generation, and structural fault modeling constitute the digital verification and manufacturing test disciplines engineered…
memory bist repair analysis prediction, memory bist repair, bist repair analysis, repair analysis prediction, memory bist, bist repair, repair analysis, analysis prediction
Memory BIST Repair Analysis Prediction with Machine Learning Introduction & Motivation Memory BIST Repair Analysis Prediction with Machine Learning addresses a central problem…
memory-bound, bandwidth bound, arithmetic intensity, roofline bandwidth ceiling
Memory bound describes a workload whose elapsed time is limited primarily by data supply rather than arithmetic capability. It explains why enormous advertised FLOPS can remain…
model optimization
Memory-Bound Operations is operators whose performance is limited mainly by memory bandwidth rather than arithmetic throughput - They often dominate latency in real inference…
continual learning
A memory buffer in continual learning is a fixed-size storage that holds representative examples from previously learned tasks, enabling rehearsal and preventing catastrophic…
memory bus architecture, memory bus, bus architecture
Memory Bus Architecture Introduction & Motivation Memory Bus Architecture addresses a central problem in memory-architecture process control and bus-bandwidth-gb-per-sec…
memory bus signal integrity prediction, memory bus signal, bus signal integrity, signal integrity prediction, memory bus, bus signal, signal integrity, integrity prediction
Memory Bus Signal Integrity Prediction with Machine Learning Introduction & Motivation Memory Bus Signal Integrity Prediction with Machine Learning addresses a central problem…
memory cell retention time prediction, memory cell retention, cell retention time, retention time prediction, memory cell, cell retention, retention time, time prediction
Memory Cell Retention Time Prediction with Machine Learning Introduction & Motivation Memory Cell Retention Time Prediction with Machine Learning addresses a central problem…
memory cell variability modeling, memory cell variability, cell variability modeling, memory cell, cell variability, variability modeling
Memory Cell Variability Modeling with Machine Learning Introduction & Motivation Memory Cell Variability Modeling with Machine Learning addresses a central problem in memory cell…
memory design characterizing and predicting cell-to-cell variability in memory arrays, memory design characterizing, design characterizing predicting, characterizing predicting cell-to-cell
Memory Design: Characterizing and predicting cell-to-cell variability in memory arrays Introduction & Motivation Memory Design: Characterizing and predicting cell-to-cell…
characterizing and predicting cell-to-cell variability in memory arrays, characterizing predicting cell-to-cell, predicting cell-to-cell variability, cell-to-cell variability memory
Characterizing and predicting cell-to-cell variability in memory arrays Introduction & Motivation Characterizing and predicting cell-to-cell variability in memory arrays addresses…
processing in memory, near data processing, computational memory units, data movement reduction
Memory-Centric Computing Architectures — Design paradigms that place memory at the center of computation, minimizing data movement by bringing processing capabilities closer…