Data-Centric AI is the paradigm that prioritizes systematic improvement of training data quality, diversity, and labeling consistency over model architecture changes — recognizing that for most practical AI applications, data quality is the primary bottleneck, and that systematic data engineering (cleaning, relabeling, augmenting, curating) yields larger performance gains than model tweaks applied to fixed datasets.

Model-Centric vs. Data-Centric AI

Model-Centric (traditional):     Data-Centric (modern):
  Fix the data                     Fix the data iteratively
  Iterate on model architecture    Use proven model architectures
  Add more data (quantity)         Improve data (quality)
  Result: diminishing returns      Result: systematic improvement

Andrew Ng popularized this framework, arguing that for many industry applications, the model is 'good enough' (standard ResNet, BERT, etc.) but data quality — inconsistent labels, noisy examples, missing edge cases — is the actual limiting factor.

Core Practices

Confident Learning / Cleanlab

Automatically identifies label errors by analyzing model predictions:

# Concept: if a confident model consistently disagrees with a label,
# the label is likely wrong
from cleanlab import Datalab
lab = Datalab(data={"labels": labels})
lab.find_issues(pred_probs=model_pred_probs)
# Returns: label issues, outliers, near-duplicates, class imbalance

Studies show 3-10% label errors exist in major benchmarks (ImageNet, CIFAR, Amazon Reviews). Fixing these errors improves model performance more than architecture changes.

Data Flywheel

Deploy model → Collect user interactions → Identify failure modes →
Label/fix edge cases → Retrain → Deploy improved model → repeat

The data flywheel creates compounding improvement: each deployment cycle generates insights about data gaps, which targeted collection/labeling fixes, improving the next model iteration. Companies like Tesla (autopilot), Spotify (recommendations), and Google (search) operationalize this at massive scale.

Data Quality Metrics

• Label consistency: Inter-annotator agreement (Cohen's kappa >0.8 target)
• Coverage: Distribution over important attributes (demographics, edge cases)
• Freshness: How current the data is relative to deployment distribution
• Completeness: Missing features or metadata that could improve models
• Balance: Class distribution and representation of tail categories

Advanced Data Augmentation

Beyond basic transforms: generative augmentation using diffusion models or LLMs to create synthetic training data; counterfactual augmentation modifying specific attributes to test model invariances; mixup/CutMix creating interpolated training examples.

Data-centric AI represents the maturation of applied machine learning — recognizing that systematic data quality improvement yields more reliable, predictable performance gains than architecture search, and that the organizations with the best data pipelines and flywheels — not just the best models — achieve lasting competitive advantage.