Object Detection Architectures are the neural network systems that simultaneously localize and classify multiple objects in images — outputting bounding boxes with class labels and confidence scores, evolving from two-stage detectors (R-CNN family) to single-stage detectors (YOLO, SSD) and modern anchor-free approaches that achieve real-time performance.
Two-Stage Detectors:
- R-CNN Evolution: R-CNN → Fast R-CNN → Faster R-CNN — progressed from selective search proposals + per-proposal CNN (R-CNN, 49s/image) to shared CNN features + RoI pooling (Fast R-CNN, 2s/image) to end-to-end with Region Proposal Network (Faster R-CNN, 0.2s/image)
- Region Proposal Network (RPN): small CNN sliding over feature map generating k anchor boxes per location — anchors at multiple scales and aspect ratios; RPN outputs objectness score and box refinement for each anchor
- RoI Align: bilinear interpolation-based feature extraction from proposals — replaces RoI Pooling's quantization artifacts with sub-pixel accuracy; critical for pixel-precise tasks like instance segmentation (Mask R-CNN)
- Cascade R-CNN: multi-stage refinement with progressively higher IoU thresholds — each stage refines proposals from previous stage; achieves higher precision at high IoU thresholds
Single-Stage Detectors:
- YOLO (You Only Look Once): divides image into S×S grid, each cell predicts B boxes and C class probabilities — YOLOv1-v8 progression achieves real-time detection (>100 FPS) with accuracy approaching two-stage detectors
- SSD (Single Shot Detector): detects objects at multiple feature map resolutions — uses anchor boxes at each scale to detect objects of different sizes; feature maps from different layers handle different object scales
- RetinaNet: introduced focal loss to address class imbalance (vast majority of anchor boxes are background) — α-balanced focal loss down-weights well-classified examples, focusing training on hard negatives; matches two-stage accuracy with single-stage speed
- YOLO Improvements: CSPNet backbone, PANet feature aggregation, mosaic augmentation, anchor-free heads (YOLOv8) — modern YOLO variants achieve 50+ mAP on COCO at 100+ FPS on modern GPUs
Feature Pyramid and Post-Processing:
- Feature Pyramid Network (FPN): top-down pathway with lateral connections creates multi-scale feature maps — low-resolution high-semantic features combined with high-resolution low-semantic features; standard backbone enhancement for all modern detectors
- Non-Maximum Suppression (NMS): post-processing to eliminate duplicate detections — sorts detections by confidence, keeps highest, removes overlapping detections above IoU threshold (typically 0.5); Soft-NMS decays scores instead of hard removal
- Anchor-Free Detection: FCOS, CenterNet eliminate predefined anchor boxes — predict center point, distances to box edges, and class directly; simpler design with fewer hyperparameters (no anchor sizes/ratios to tune)
- Deformable DETR: Transformer-based detector with deformable attention — attends to sparse set of sampling points around reference points rather than all spatial locations; achieves competitive accuracy without NMS or anchors
Object detection architectures represent one of the most impactful applications of deep learning — powering autonomous driving, medical imaging, surveillance, robotics, and augmented reality with increasingly accurate and efficient real-time multi-object recognition.
Related Topics
Explore 500+ Semiconductor & AI Topics
From EUV lithography to CUDA optimization — search the full knowledge base or chat with our AI assistant.