104371
autoregressive model sequential generation machine learning, autoregressive model sequential generation and factorization order, autoregressive model sequential, model sequential generation, sequential generation factorization
14,989 technical terms and definitions
autoregressive model sequential generation machine learning, autoregressive model sequential generation and factorization order, autoregressive model sequential, model sequential generation, sequential generation factorization
masked autoencoder masked image modeling machine learning, masked autoencoder masked image modeling for self-supervised vision, masked autoencoder masked, autoencoder masked image, masked image modeling, image modeling self-supervised
multi head attention parallel representation prediction machine learning, multi-head attention parallel representation and subspace prediction, multi-head attention parallel, attention parallel representation, multi-head attention
cross attention fusion mechanism prediction machine learning, cross-attention fusion mechanism and modality integration prediction, cross-attention fusion mechanism, fusion mechanism modality, mechanism modality integration
self attention query key value prediction machine learning, self-attention query-key-value projection and similarity prediction, self-attention query-key-value projection, query-key-value projection similarity, query-key-value projection
sparse attention computational efficiency prediction machine learning, sparse attention computational efficiency and sparsity pattern prediction, sparse attention computational, attention computational efficiency, sparse attention
linear attention complexity reduction prediction machine learning, linear attention complexity reduction and feature approximation, linear attention complexity, attention complexity reduction, complexity reduction feature, linear attention
vision transformer patch embedding prediction machine learning, vision transformer patch embedding and image tokenization prediction, vision transformer patch, transformer patch embedding, patch embedding image, embedding image tokenization
swin transformer shifted window prediction machine learning, swin transformer shifted window and hierarchical attention prediction, swin transformer shifted, transformer shifted window, shifted window hierarchical, swin transformer
deit data efficient training prediction machine learning, deit data-efficient training and knowledge distillation prediction, deit data-efficient training, data-efficient training knowledge, training knowledge distillation
timm model zoo architecture selection prediction machine learning, timm model zoo architecture selection and pre-training choice, timm model zoo, model zoo architecture, zoo architecture selection, architecture selection pre-training
bert bidirectional encoding representation machine learning, bert bidirectional encoding representation and masked language modeling, bert bidirectional encoding, bidirectional encoding representation, encoding representation masked
gpt generative pretrained transformer prediction machine learning, gpt generative pre-trained transformer and sequential prediction, gpt generative pre-trained, generative pre-trained transformer, pre-trained transformer sequential
t5 text to text framework prediction machine learning, t5 text-to-text framework and unified task representation, t5 text-to-text framework, text-to-text framework unified, framework unified task, unified task representation, unified task
xlnet autoregressive pretraining prediction machine learning, xlnet autoregressive pre-training and permutation language modeling, xlnet autoregressive pre-training, autoregressive pre-training permutation, pre-training permutation language
roberta robust bert training prediction machine learning, roberta robust bert training and hyperparameter optimization, roberta robust bert, robust bert training, bert training hyperparameter, training hyperparameter optimization
vision language model cross modal prediction machine learning, vision-language model cross-modal alignment and joint representation, vision-language model cross-modal, model cross-modal alignment, cross-modal alignment joint
audio visual learning synchronization prediction machine learning, audio-visual learning synchronization and temporal alignment, audio-visual learning synchronization, learning synchronization temporal, synchronization temporal alignment
text image alignment contrastive learning prediction machine learning, text-image alignment contrastive learning and similarity preservation, text-image alignment contrastive, alignment contrastive learning, contrastive learning similarity
video understanding temporal modeling prediction machine learning, video understanding temporal modeling and action recognition, video understanding temporal, understanding temporal modeling, temporal modeling action, video understanding
prototypical network prototype matching prediction machine learning, prototypical network prototype matching and few-shot classification, prototypical network prototype, network prototype matching, prototype matching few-shot
matching network attention mechanism prediction machine learning, matching network attention mechanism and memory augmentation, matching network attention, network attention mechanism, attention mechanism memory, matching network
model agnostic meta learning maml prediction machine learning, model-agnostic meta-learning (maml) and fast adaptation, model-agnostic meta-learning (maml), meta-learning (maml) fast, (maml) fast adaptation, model-agnostic meta-learning
reptile first order approximation prediction machine learning, reptile first-order approximation and scalable meta-learning, reptile first-order approximation, first-order approximation scalable, approximation scalable meta-learning
adam optimizer adaptive learning rate prediction machine learning, adam optimizer adaptive learning rate and moment estimation, adam optimizer adaptive, optimizer adaptive learning, adaptive learning rate, learning rate moment, rate moment
sgd momentum nesterov acceleration prediction machine learning, sgd momentum nesterov acceleration and gradient history, sgd momentum nesterov, momentum nesterov acceleration, nesterov acceleration gradient, acceleration gradient history
adagrad accumulated gradient scaling prediction machine learning, adagrad accumulated gradient scaling and adaptive features, adagrad accumulated gradient, accumulated gradient scaling, gradient scaling adaptive, scaling adaptive features
rmsprop root mean square propagation prediction machine learning, rmsprop root mean square propagation and second moment estimation, rmsprop root mean, root mean square, mean square propagation, square propagation second, rmsprop root
lamb layer wise adaptive batch normalization machine learning, lamb layer-wise adaptive batch normalization and large-batch training, lamb layer-wise adaptive, layer-wise adaptive batch, adaptive batch normalization, lamb layer-wise
dropout random neuron deactivation prediction machine learning, dropout random neuron deactivation and regularization, dropout random neuron, random neuron deactivation, neuron deactivation regularization, dropout random, random neuron
batch normalization internal covariate shift machine learning, batch normalization internal covariate shift reduction, batch normalization internal, normalization internal covariate, internal covariate shift, covariate shift reduction
layer normalization per sample normalization prediction machine learning, layer normalization per-sample normalization and recurrent stability, layer normalization per-sample, normalization per-sample normalization, layer normalization
weight decay l2 regularization prediction machine learning, weight decay l2 regularization and model complexity control, weight decay l2, decay l2 regularization, l2 regularization model, regularization model complexity, weight decay
early stopping overfitting prevention prediction machine learning, early stopping overfitting prevention and validation monitoring, early stopping overfitting, stopping overfitting prevention, overfitting prevention validation
cross entropy loss classification prediction machine learning, cross-entropy loss classification and probability calibration, cross-entropy loss classification, loss classification probability, classification probability calibration
mean squared error regression prediction machine learning, mean squared error regression and continuous output prediction, mean squared error, squared error regression, error regression continuous, regression continuous output, mean squared
focal loss class imbalance prediction machine learning, focal loss class imbalance handling and hard example mining, focal loss class, loss class imbalance, class imbalance handling, imbalance handling hard, handling hard example
contrastive loss similarity learning prediction machine learning, contrastive loss similarity learning and metric learning, contrastive loss similarity, loss similarity learning, similarity learning metric, learning metric learning
triplet loss metric learning prediction machine learning, triplet loss metric learning and distance embedding, triplet loss metric, loss metric learning, metric learning distance, learning distance embedding, triplet loss, loss metric
accuracy classification metric prediction machine learning, accuracy classification metric and balanced prediction quality, accuracy classification metric, classification metric balanced, metric balanced prediction, accuracy classification
precision recall f1 score prediction machine learning, precision recall f1 score and balance trade-off measurement, precision recall f1, recall f1 score, f1 score balance, score balance trade-off, balance trade-off measurement, recall f1
auc roc curve performance prediction machine learning, auc-roc curve performance and threshold-agnostic evaluation, auc-roc curve performance, curve performance threshold-agnostic, performance threshold-agnostic evaluation, auc-roc curve
mean average precision detection prediction machine learning, mean average precision detection and object recognition evaluation, mean average precision, average precision detection, precision detection object, detection object recognition
intersection over union iou prediction machine learning, intersection over union (iou) prediction and bounding box evaluation, intersection over union, over union (iou), union (iou) prediction, (iou) prediction bounding, intersection over
image augmentation random transformation prediction machine learning, image augmentation random transformation and data diversity, image augmentation random, augmentation random transformation, random transformation data, image augmentation
mixup convex combination prediction machine learning, mixup convex combination and inter-sample learning, mixup convex combination, convex combination inter-sample, combination inter-sample learning, mixup convex, convex combination
cutmix regional dropout prediction machine learning, cutmix regional dropout and spatial augmentation, cutmix regional dropout, regional dropout spatial, dropout spatial augmentation, cutmix regional, regional dropout, dropout spatial
cutout random erasing prediction machine learning, cutout random erasing and attention regularization, cutout random erasing, random erasing attention, erasing attention regularization, cutout random, random erasing, erasing attention
augmentation policy search prediction machine learning, augmentation policy search and automatic transformation optimization, augmentation policy search, policy search automatic, search automatic transformation, augmentation policy
data parallelism batch distribution prediction machine learning, data parallelism batch distribution and gradient synchronization, data parallelism batch, parallelism batch distribution, batch distribution gradient, data parallelism