object detection yolo

**Real-Time Object Detection** is the **computer vision task of simultaneously locating and classifying all objects in an image within milliseconds — where the YOLO (You Only Look Once) family and similar single-shot detectors achieve this by reformulating detection as a single regression problem over a grid of spatial locations, eliminating the region proposal bottleneck of two-stage detectors to enable real-time performance on edge devices and video streams**. **Two-Stage vs. Single-Shot Detectors** - **Two-Stage** (R-CNN, Faster R-CNN): First stage generates region proposals (candidate bounding boxes). Second stage classifies each proposal and refines its coordinates. Higher accuracy but slower (5-20 FPS). - **Single-Shot** (YOLO, SSD, RetinaNet): Directly predicts class probabilities and bounding box coordinates from a dense grid over the feature map in a single forward pass. Faster (30-300+ FPS) with competitive accuracy. **YOLO Architecture (Modern YOLOv8/v9)** - **Backbone**: Feature extraction CNN (CSPDarknet, EfficientRep). Processes the input image into multi-scale feature maps at 1/8, 1/16, 1/32 resolution. - **Neck**: Feature pyramid network (FPN + PAN) that fuses multi-scale features — combining high-resolution spatial detail from early layers with semantic richness from deep layers. - **Head**: Prediction layers at each scale. Each grid cell predicts: bounding box coordinates (x, y, w, h), objectness score, and class probabilities. Anchor-free designs (YOLOv8+) directly predict box center and size without predefined anchor boxes. **Training Innovations** - **Focal Loss** (RetinaNet): Addresses the extreme class imbalance between foreground objects and background grid cells. Down-weights easy negatives, focusing learning on hard examples. Enabled single-shot detectors to match two-stage accuracy. - **CIoU/DIoU Loss**: Bounding box regression loss that considers overlap area, center distance, and aspect ratio — providing better gradients than MSE or standard IoU loss for box coordinate learning. - **Mosaic Augmentation**: Combines 4 random training images into one mosaic tile, exposing the model to more objects and context variation per batch. Introduced in YOLOv4. - **Label Assignment**: Dynamic label assignment (TAL — Task-Aligned Learning) determines which grid cells are responsible for each ground-truth object during training, replacing static IoU-based assignment with learnable assignment that adapts to model predictions. **Deployment Considerations** - **Model Scaling**: YOLO provides nano/small/medium/large/xlarge variants scaling backbone width and depth. YOLOv8-nano achieves 37 mAP at 1.5 ms on a GPU; YOLOv8-xlarge achieves 53 mAP at 8 ms. - **Quantization**: INT8 quantization with TensorRT provides 2-3x speedup on NVIDIA GPUs and enables deployment on edge devices (Jetson, mobile NPUs) at 30+ FPS. - **NMS (Non-Maximum Suppression)**: Post-processing step that removes duplicate detections for the same object. The latency of NMS can dominate total inference time for images with many objects. Real-Time Object Detection is **the technology that gives machines spatial awareness of their environment** — enabling autonomous driving, robotics, video surveillance, industrial inspection, and augmented reality through the ability to identify and locate every object in a scene within a single camera frame cycle.