104421
model parallelism layer distribution prediction machine learning, model parallelism layer distribution and device placement, model parallelism layer, parallelism layer distribution, layer distribution device, distribution device placement
14,989 technical terms and definitions
model parallelism layer distribution prediction machine learning, model parallelism layer distribution and device placement, model parallelism layer, parallelism layer distribution, layer distribution device, distribution device placement
pipeline parallelism stage distribution prediction machine learning, pipeline parallelism stage distribution and bubble minimization, pipeline parallelism stage, parallelism stage distribution, stage distribution bubble, parallelism stage
gradient accumulation effective batch size prediction machine learning, gradient accumulation effective batch size and memory efficiency, gradient accumulation effective, accumulation effective batch, effective batch size, batch size memory
synchronous asynchronous update prediction machine learning, synchronous asynchronous update and communication efficiency, synchronous asynchronous update, asynchronous update communication, update communication efficiency
inception network multi scale prediction machine learning, inception network multi-scale feature extraction and parallel paths, inception network multi-scale, network multi-scale feature, multi-scale feature extraction, inception network
resnet residual connection depth prediction machine learning, resnet residual connection depth and deep network training, resnet residual connection, residual connection depth, connection depth deep, depth deep network, resnet residual
densenet dense connection prediction machine learning, densenet dense connection and feature reuse, densenet dense connection, dense connection feature, connection feature reuse, densenet dense, dense connection, connection feature
mobilenet lightweight architecture prediction machine learning, mobilenet lightweight architecture and depthwise separable convolution, mobilenet lightweight architecture, lightweight architecture depthwise, architecture depthwise separable
efficientnet resource constrained prediction machine learning, efficientnet resource-constrained scaling and compound scaling, efficientnet resource-constrained scaling, resource-constrained scaling compound, scaling compound scaling
squeezenet compression architecture prediction machine learning, squeezenet compression architecture and fire modules, squeezenet compression architecture, compression architecture fire, architecture fire modules, squeezenet compression
shufflenet channel shuffle prediction machine learning, shufflenet channel shuffle and group convolution, shufflenet channel shuffle, channel shuffle group, shuffle group convolution, shufflenet channel, channel shuffle, shuffle group
mnasnet neural architecture search prediction machine learning, mnasnet neural architecture search and mobile optimization, mnasnet neural architecture, neural architecture search, architecture search mobile, search mobile optimization
nasnet automated architecture design prediction machine learning, nasnet automated architecture design and cell replication, nasnet automated architecture, automated architecture design, architecture design cell, design cell replication
onnx model interoperability prediction machine learning, onnx model interoperability and framework agnostic representation, onnx model interoperability, model interoperability framework, interoperability framework agnostic, onnx model
tensorrt inference optimization prediction machine learning, tensorrt inference optimization and gpu acceleration, tensorrt inference optimization, inference optimization gpu, optimization gpu acceleration, tensorrt inference
quantization aware training prediction machine learning, quantization-aware training and fixed-point representation, quantization-aware training fixed-point, training fixed-point representation, quantization-aware training
knowledge distillation model compression prediction machine learning, knowledge distillation model compression and student learning, knowledge distillation model, distillation model compression, model compression student, distillation model
pruning weight sparsity prediction machine learning, pruning weight sparsity and network compression, pruning weight sparsity, weight sparsity network, sparsity network compression, pruning weight, weight sparsity, sparsity network
neural architecture search nas prediction machine learning, neural architecture search (nas) and automated design space exploration, neural architecture search, architecture search (nas), search (nas) automated, (nas) automated design
hyperparameter optimization bayesian search machine learning, hyperparameter optimization bayesian search and surrogate modeling, hyperparameter optimization bayesian, optimization bayesian search, bayesian search surrogate, bayesian search
grid search exhaustive parameter prediction machine learning, grid search exhaustive parameter exploration and systematic tuning, grid search exhaustive, search exhaustive parameter, exhaustive parameter exploration, grid search
random search sampling parameter prediction machine learning, random search sampling parameter exploration and statistical coverage, random search sampling, search sampling parameter, sampling parameter exploration, random search
genetic algorithm evolutionary optimization prediction machine learning, genetic algorithm evolutionary optimization and population evolution, genetic algorithm evolutionary, algorithm evolutionary optimization, genetic algorithm
particle swarm optimization collective behavior machine learning, particle swarm optimization collective behavior and swarm intelligence, particle swarm optimization, swarm optimization collective, optimization collective behavior
simulated annealing cooling schedule prediction machine learning, simulated annealing cooling schedule and temperature decay, simulated annealing cooling, annealing cooling schedule, cooling schedule temperature, schedule temperature decay
ant colony optimization pheromone prediction machine learning, ant colony optimization pheromone and collective search, ant colony optimization, colony optimization pheromone, optimization pheromone collective, pheromone collective search
swarm intelligence collective search prediction machine learning, swarm intelligence collective search and agent coordination, swarm intelligence collective, intelligence collective search, collective search agent, search agent coordination
bayesian optimization gaussian process prediction machine learning, bayesian optimization gaussian process and uncertainty quantification, bayesian optimization gaussian, optimization gaussian process, gaussian process uncertainty
successive halving early elimination prediction machine learning, successive halving early elimination and resource efficiency, successive halving early, halving early elimination, early elimination resource, elimination resource efficiency
hyperband bandit feedback prediction machine learning, hyperband bandit feedback and multi-armed bandit framework, hyperband bandit feedback, bandit feedback multi-armed, feedback multi-armed bandit, multi-armed bandit framework
population based training evolution prediction machine learning, population-based training evolution and online hyperparameter tuning, population-based training evolution, training evolution online, evolution online hyperparameter
learning rate scheduling annealing prediction machine learning, learning rate scheduling annealing and adaptive learning decay, learning rate scheduling, rate scheduling annealing, scheduling annealing adaptive, annealing adaptive learning
warm up training initialization prediction machine learning, warm-up training initialization and gradual learning activation, warm-up training initialization, training initialization gradual, initialization gradual learning
curriculum learning difficulty progression prediction machine learning, curriculum learning difficulty progression and sample ordering, curriculum learning difficulty, learning difficulty progression, difficulty progression sample
self paced learning sample weighting prediction machine learning, self-paced learning sample weighting and adaptive sampling, self-paced learning sample, learning sample weighting, sample weighting adaptive, weighting adaptive sampling
imbalanced learning resampling prediction machine learning, imbalanced learning resampling and class weight balancing, imbalanced learning resampling, learning resampling class, resampling class weight, class weight balancing, class weight
hard negative mining difficult sample prediction machine learning, hard negative mining difficult sample and focus learning, hard negative mining, negative mining difficult, mining difficult sample, difficult sample focus, hard negative
metric learning distance optimization prediction machine learning, metric learning distance optimization and embedding space, metric learning distance, learning distance optimization, distance optimization embedding, metric learning
siamese network pair similarity prediction machine learning, siamese network pair similarity and contrastive learning, siamese network pair, network pair similarity, pair similarity contrastive, similarity contrastive learning, network pair
center loss intra class compactness prediction machine learning, center loss intra-class compactness and center regularization, center loss intra-class, loss intra-class compactness, intra-class compactness center, center loss
arcface angular margin loss prediction machine learning, arcface angular margin loss and angular separation, arcface angular margin, angular margin loss, margin loss angular, loss angular separation, arcface angular, angular margin
cosface large margin cosine prediction machine learning, cosface large margin cosine and cosine distance optimization, cosface large margin, large margin cosine, margin cosine cosine, cosine cosine distance, cosine distance optimization
sphereface angular softmax prediction machine learning, sphereface angular softmax and angular constraint embedding, sphereface angular softmax, angular softmax angular, softmax angular constraint, angular constraint embedding
deep metric learning triplet optimization prediction machine learning, deep metric learning triplet optimization prediction, deep metric learning, metric learning triplet, learning triplet optimization, triplet optimization prediction
ranking loss listwise optimization prediction machine learning, ranking loss listwise optimization prediction, ranking loss listwise, loss listwise optimization, listwise optimization prediction, ranking loss, loss listwise
learning to rank point wise prediction machine learning, learning-to-rank point-wise prediction, learning-to-rank point-wise, point-wise prediction
information retrieval relevance prediction machine learning, information retrieval relevance prediction, information retrieval relevance, retrieval relevance prediction, information retrieval, retrieval relevance, relevance prediction
recommendation system collaborative filtering machine learning, recommendation system collaborative filtering prediction, recommendation system collaborative, system collaborative filtering, collaborative filtering prediction
matrix factorization latent factor prediction machine learning, matrix factorization latent factor prediction, matrix factorization latent, factorization latent factor, latent factor prediction, matrix factorization, factorization latent
factorization machine feature interaction machine learning, factorization machine feature interaction prediction, factorization machine feature, machine feature interaction, feature interaction prediction, factorization machine