2,221 technical terms and definitions
mixture of experts (moe), moe, moe architecture, sparse moe, expert routing, gating network, conditional computation, switch transformer, mixtral
Mixture of Experts (MoE) is the sparse-activation architecture that scales a neural network to trillions of parameters while keeping per-token compute fixed — each input activates…
moe, sparse moe, gating network, expert routing
Mixture of Experts (MoE) is the model architecture that uses a gating network to dynamically route each input to a sparse subset of specialized "expert" sub-networks — enabling…
Mixture of Experts for Anomaly Detection Introduction & Motivation Mixture of Experts for Anomaly Detection addresses a central problem in anomaly detection and {target} scoring…
mixture of experts conditional computation, mixture experts conditional computation, mixture experts, experts conditional, bleu muse, mixture experts conditional, experts conditional computation
Mixture of Experts - Conditional Computation Introduction & Motivation Mixture of Experts: route tokens to specialized experts. Conditional computation for efficiency.…
moe expert selection, sparse expert routing, expert cache management, moe deployment serving
MoE Inference Optimization: Sparse Expert Activation — achieving throughput scaling without proportional latency increase Mixture of Experts (MoE) models like Mixtral 8x7B…
multi-task learning
Mixture-of-experts for multi-task is a multi-task architecture that routes inputs to specialized expert subnetworks while sharing a common backbone - A gating mechanism selects…
mixture of experts gating, mixture experts gating, mixture experts, experts gating
Mixture of Experts Gating Introduction & Motivation Mixture of Experts Gating addresses a central problem in timeseries process control and mixture-expert-specialist-network…
moe architecture hierarchical, multi-stage moe, moe routing
Hierarchical MoE is the multi-stage routing architecture that selects expert groups first and individual experts second - it scales sparse expert systems by reducing routing…
sparse moe gating, switch transformer, expert routing token, moe load balancing
Mixture of Experts (MoE) Language Models is the sparse routing architecture where each token is routed to subset of experts through learned gating — achieving high parameter count…
sparse moe transformer, expert routing, moe load balancing, switch transformer gating
Mixture of Experts (MoE) is the sparse architecture paradigm where each input token is routed to only a small subset (typically 1-2) of many parallel "expert" sub-networks within…
sparse moe, expert routing, moe gating, switch transformer moe
Mixture of Experts (MoE) is the sparse model architecture that replaces each dense feed-forward layer with multiple parallel "expert" sub-networks and a learned gating function…
sparse moe, expert routing, gating network moe, conditional computation
Mixture of Experts (MoE) is the neural network architecture that routes each input token through only a subset of specialized sub-networks (experts) selected by a learned gating…
sparse moe model, expert routing gating, conditional computation moe, switch transformer expert
Mixture of Experts (MoE) is the neural network architecture that routes each input token to a subset of specialized "expert" sub-networks through a learned gating function…
sparse moe routing, expert selection gating, moe load balancing, conditional computation moe
Mixture of Experts (MoE) is the conditional computation architecture that routes each input token to a subset of specialized expert sub-networks rather than processing through all…
sparse moe models, expert routing mechanism, moe scaling efficiency, conditional computation moe
Mixture of Experts (MoE) is the neural architecture pattern that replaces dense feedforward layers with multiple specialized expert networks, activating only a sparse subset…
moe load balancing, sparse mixture experts, switch transformer moe, expert parallelism routing
Mixture of Experts (MoE) Routing and Load Balancing is an architecture paradigm where only a sparse subset of model parameters is activated for each input token, with a learned…
moe routing, expert routing, top k routing, expert parallelism, load balancing, router collapse, expert capacity
Mixture of experts routing is the gating process that assigns each token to a small subset of expert feed-forward networks inside a sparse model. Routing lets total parameter…
mixture of experts sparse model scaling, mixture experts sparse model scaling, mixture experts, sparse model scaling, arc gsm8k math mbpp mmlu, mixture-of-experts & sparse model scaling, sparse model
Mixture-of-Experts & Sparse Model Scaling Introduction & Motivation Mixture-of-Experts (MoE) architectures address a fundamental tension in scaling large neural networks: model…
moe training, expert parallelism, load balancing moe, switch transformer training
Mixture of Experts (MoE) Training is the specialized training methodology for sparse conditional computation models where only a subset of parameters (experts) are activated per…
blend, regularize
Mixup is a data augmentation and regularization technique that creates synthetic training examples by taking weighted linear combinations of pairs of existing examples and their…
data augmentation
Mixup is a data augmentation technique that creates new training samples by linearly interpolating between pairs of existing samples and their labels — encouraging the model…
Mixup Data Augmentation Introduction & Motivation Mixup Data Augmentation addresses a central problem in vision processing and label-smoothing-benefit prediction: how to Build…
mixup convex combination and inter-sample learning, mixup convex combination, convex combination inter-sample, combination inter-sample learning, mixup convex, convex combination
Mixup Convex Combination and Inter-Sample Learning Introduction & Motivation Mixup Convex Combination and Inter-Sample Learning addresses a central problem in mixup data…
data augmentation
Mixup and CutMix blend training examples to improve model robustness and generalization. Mixup: Create virtual training examples by linear interpolation. x̃ = λx₁ + (1-λ)x₂, ỹ =…
computer vision
Mixup is the pixel- and label-space interpolation that blends two images and their targets so Vision Transformers learn smoother decision boundaries — each training sample becomes…
Mixup Augmentation Semi-Supervised Learning Introduction & Motivation Mixup Augmentation Semi-Supervised Learning addresses a central problem in semisupervised…
advanced training
Mixup text is a text-training strategy that interpolates representations or labels between sample pairs - Mixed examples encourage smoother decision boundaries and reduce…
neural network circuit sizing, ai mixed signal optimization, automated analog layout, machine learning op amp design
Machine Learning for Analog/Mixed-Signal Design is the application of ML to automate the traditionally manual and expertise-intensive process of analog circuit design — where ML…
machine learning ci cd, mlops pipeline, model deployment pipeline, continuous integration ml, continuous delivery ml
ML CI/CD (Machine Learning Continuous Integration and Continuous Delivery) is the engineering discipline of continuously testing, packaging, validating, and safely releasing ML…
neural network cts, ai clock distribution, automated clock tree optimization, ml clock skew minimization
Clock Tree Synthesis constitutes the physical design automation methodology engineered to distribute synchronous clock reference signals from a single phase-locked loop source…
ai test pattern generation, neural network fault coverage, automated dft insertion, machine learning atpg
ML for Design for Test is the application of machine learning to automate test pattern generation, optimize DFT insertion, and improve fault coverage — where ML models learn…
ai technology porting, neural network node migration, automated design conversion, machine learning process porting
ML for Design Migration is the automated porting of designs across technology nodes, foundries, or IP vendors using machine learning — where ML models learn mapping rules between…
machine learning placement, ai driven pnr, neural network floorplanning, deep learning physical design
Machine Learning for Place and Route is the application of deep learning and reinforcement learning algorithms to automate and optimize the physical design process of placing…
neural network rc extraction, ai capacitance prediction, machine learning resistance modeling, fast parasitic estimation
ML for Parasitic Extraction is the application of machine learning to predict resistance, capacitance, and inductance from layout 100-1000× faster than field solvers — where ML…
neural network power analysis, ai driven power reduction, machine learning leakage prediction, power hotspot detection ml
Machine Learning for Power Optimization is the application of ML models to predict, analyze, and optimize power consumption in chip designs 100-1000× faster than traditional power…
neural network aging prediction, ai electromigration analysis, machine learning btbt prediction, reliability simulation ml
ML for Reliability Analysis is the application of machine learning to predict and prevent chip failures from aging mechanisms like BTI, HCI, electromigration, and TDDB — where ML…
neural network crosstalk prediction, ai si analysis, machine learning noise analysis, deep learning coupling
ML for Signal Integrity Analysis is the application of machine learning to predict and prevent signal integrity issues like crosstalk, reflection, and power supply noise — where…
neural network defect prediction, ai parametric yield, machine learning process variation, yield learning ml
ML for Yield Optimization is the application of machine learning to predict, analyze, and improve manufacturing yield through defect pattern recognition, parametric yield…
universal, compile
MLC LLM (Machine Learning Compilation LLM) is a universal deployment framework that compiles language models to run natively on any device — using Apache TVM compilation…
ml derating prediction
Vapor Chamber Fill Quality Prediction with Machine Learning Introduction & Motivation Vapor Chamber Fill Quality Prediction with Machine Learning addresses a central problem…
mlcc capacitor termination defect prediction machine learning, mlcc capacitor, termination defect prediction, mlcc, mlcc capacitor termination defect prediction
MLCC Capacitor Termination Defect Prediction with Machine Learning Introduction & Motivation MLCC Capacitor Termination Defect Prediction with Machine Learning addresses a central…
mlcc termination defect prediction machine learning, mlcc termination, defect prediction machine, mlcc, mlcc termination defect prediction, mlcc termination defect, defect prediction
MLCC Termination Defect Prediction with Machine Learning Introduction & Motivation MLCC Termination Defect Prediction with Machine Learning addresses a central problem…
mlops
MLflow is the open-source MLOps platform for experiment tracking, model packaging, and model registry governance - it helps teams maintain reproducibility and controlled model…
experiment, log
MLflow Tracking is the open-source experiment logging system that records parameters, metrics, code versions, and model artifacts for every ML training run — solving…
compiler, intermediate, dialect, lowering, xla
MLIR (Multi-Level Intermediate Representation) is an extensible compiler infrastructure for building domain-specific compilers — developed by Google and now part of LLVM, MLIR…
mlir, infrastructure
MLIR (Multi-Level Intermediate Representation) is the compiler infrastructure framework from the LLVM project that provides a unified, extensible system for building…
mlir and compiler-based code generation, mlir compiler-based code, compiler-based code generation, mlir compiler-based, compiler-based code, code generation
MLIR and Compiler-Based Code Generation Introduction & Motivation MLIR and Compiler-Based Code Generation addresses a central problem in compiler-optimization process control…
model registry, rollback
MLOps and Model Registry What is MLOps? MLOps (Machine Learning Operations) applies DevOps practices to ML systems: versioning, testing, deployment, and monitoring of ML models…
MLOps (Machine Learning Operations) applies DevOps principles to ML systems, covering deployment, monitoring, and lifecycle management. Core practices: Version control…
mlops champion-challenger model promotion prediction, mlops champion-challenger model, champion-challenger model promotion, model promotion prediction
MLOps Champion-Challenger Model Promotion Prediction with Machine Learning Introduction & Motivation MLOps Champion-Challenger Model Promotion Prediction with Machine Learning…