Ugenz Academy/Tutorial

Objectdetection

15 min read2,834 words

Reading progress

Keep learning

Object Detection

1. Introduction

Object Detection is a computer vision technique used to identify and locate objects in images or videos.

Unlike image classification, which only tells us what is present in an image, object detection tells us:

  • What objects are present
  • Where the objects are located
  • How many objects are present

For example, if an image contains cars and people, an object detection system can identify each car and person and draw a box around them.


2. Definition

Object Detection is a computer vision task that identifies objects in an image or video and determines their locations using bounding boxes.

Simple Definition

Object detection is the process of identifying and locating objects in images or videos.


3. Example

Suppose an image contains:

┌───────────────┐ │ Person │ │ │ └───────────────┘ ┌───────────────┐ │ Car │ │ │ └───────────────┘

The object detection model may produce:

Person → 95% confidence Car → 91% confidence

Here:

  • Person and Car are detected objects.
  • The rectangles are bounding boxes.
  • The percentages represent the model's confidence.

4. Object Detection vs Image Classification

FeatureImage ClassificationObject Detection
PurposeIdentifies image categoryIdentifies and locates objects
LocationNot providedProvided
Multiple objectsUsually gives image-level labelsCan detect multiple objects
OutputClass labelClass + bounding box + confidence
Example"There is a dog""Dog is located here"

Example

Image Classification:

Image → Dog

Object Detection:

Image → Dog + Location

5. Object Detection vs Image Segmentation

Object detection and image segmentation are related but different.

FeatureObject DetectionImage Segmentation
Identifies objectsYesYes
Uses bounding boxesYesNot necessarily
Pixel-level locationNoYes
OutputBoxesPixel regions/masks
ExampleDetect a carIdentify every pixel belonging to a car

6. Important Components

An object detection system generally produces three important types of information.

1. Class

The type of object detected.

Examples:

Car Person Dog Bicycle Bus

2. Bounding Box

A rectangular area surrounding the detected object.

It is commonly represented by coordinates such as:

(x_min, y_min, x_max, y_max)

3. Confidence Score

The model's estimated confidence that a detected object belongs to a particular class.

Example:

Car: 0.94

This represents a confidence score of approximately 94%.


7. How Object Detection Works

A simplified object detection workflow is:

Input Image ↓ Image Preprocessing ↓ Feature Extraction ↓ Object Detection Model ↓ Candidate Objects ↓ Confidence Filtering ↓ Non-Maximum Suppression ↓ Final Detections

8. Step 1: Input Image

The system receives an image or video frame.

Example:

Camera ↓ Video Frame ↓ Object Detection

9. Step 2: Image Preprocessing

Before sending an image to a model, it may need preprocessing.

Common preprocessing operations include:

  • Resizing
  • Normalization
  • Scaling pixel values
  • Converting image formats

Example:

Original Image ↓ Resize ↓ Normalize ↓ Model Input

10. Step 3: Feature Extraction

The model extracts useful patterns from the image.

These patterns may include:

  • Edges
  • Shapes
  • Textures
  • Colors
  • Object parts

Deep learning models often use Convolutional Neural Networks (CNNs) or related architectures to learn these features.


11. Step 4: Object Prediction

The detection model predicts:

  • Object class
  • Object location
  • Confidence score

Example:

Person → 0.96 Car → 0.91 Dog → 0.87

12. Step 5: Confidence Filtering

Detection models can produce predictions with different confidence levels.

For example:

Person → 0.96 Car → 0.91 Dog → 0.25

If the confidence threshold is:

0.50

the dog prediction may be removed because:

0.25 < 0.50

while the person and car predictions remain.


13. Step 6: Non-Maximum Suppression (NMS)

A model may produce several overlapping bounding boxes for the same object.

Non-Maximum Suppression (NMS) helps keep the strongest detection and remove unnecessary overlapping boxes.

Example

Before NMS: ┌───────────────┐ │ ┌───────────┼───┐ │ │ CAR │ │ │ └───────────┼───┘ └───────────────┘ Multiple overlapping boxes ↓ NMS ↓ ┌───────────────┐ │ CAR │ └───────────────┘

14. Bounding Box

A bounding box is a rectangle drawn around an object.

A bounding box can be represented using:

(x_min, y_min, x_max, y_max)

Another common representation is:

(x, y, width, height)

Example

Image ┌──────────────────────────┐ │ │ │ ┌──────────────┐ │ │ │ Person │ │ │ └──────────────┘ │ │ │ └──────────────────────────┘

15. Intersection over Union (IoU)

Intersection over Union (IoU) measures how much a predicted bounding box overlaps with the actual bounding box.

The formula is:

IoU=Area of IntersectionArea of UnionIoU = \frac{Area\ of\ Intersection}{Area\ of\ Union}

Example

If:

Intersection Area = 40 Union Area = 50

Then:

IoU=4050=0.8IoU = \frac{40}{50} = 0.8

So the IoU is:

0.80 or 80%

A higher IoU generally means greater overlap between the predicted and ground-truth boxes.


16. Object Detection Algorithms

Several algorithms and model families are used for object detection.

Important examples include:

  • R-CNN
  • Fast R-CNN
  • Faster R-CNN
  • SSD
  • YOLO
  • RetinaNet
  • DETR

17. R-CNN

R-CNN (Regions with Convolutional Neural Networks) is an early deep-learning-based object detection approach.

Basic idea:

Image ↓ Region Proposals ↓ CNN Feature Extraction ↓ Object Classification ↓ Bounding Boxes

Limitation

The original R-CNN requires significant computation because it processes many region proposals separately.


18. Fast R-CNN

Fast R-CNN improved the original R-CNN approach.

Instead of processing every region independently through the CNN, it processes the image more efficiently and then uses region-specific features.

Basic Workflow

Image ↓ CNN ↓ Feature Map ↓ Region Proposals ↓ Classification + Bounding Box

19. Faster R-CNN

Faster R-CNN further improves region-based detection by using a Region Proposal Network (RPN).

Workflow

Image ↓ CNN Backbone ↓ Feature Map ↓ Region Proposal Network ↓ Object Classification ↓ Bounding Box Refinement

Faster R-CNN is a two-stage detector.


20. YOLO

YOLO (You Only Look Once) is a popular object detection approach designed for fast detection.

It processes the image through a neural network and predicts object locations and classes.

Basic Workflow

Image ↓ YOLO Model ↓ Bounding Boxes + Class Predictions + Confidence Scores

Applications

  • Real-time video analysis
  • Traffic monitoring
  • Security systems
  • Robotics
  • Autonomous systems

21. SSD

SSD (Single Shot MultiBox Detector) is another single-stage object detection approach.

It predicts object classes and bounding boxes at multiple feature-map scales.

Advantages

  • Fast detection
  • Suitable for real-time applications
  • Can detect objects at different scales

22. DETR

DETR (DEtection TRansformer) applies the Transformer architecture to object detection.

It provides a different approach from traditional detection pipelines and can directly predict a set of objects.

Basic Idea

Image ↓ CNN / Feature Extraction ↓ Transformer ↓ Object Predictions

23. One-Stage vs Two-Stage Detectors

FeatureOne-StageTwo-Stage
ProcessDirect predictionRegion proposal + prediction
SpeedGenerally fasterGenerally slower
ComplexityLowerHigher
ExamplesYOLO, SSDFaster R-CNN
Common useReal-time detectionApplications where detailed detection is important

The actual speed and accuracy depend on the model version, implementation, hardware, and dataset.


24. Dataset for Object Detection

An object detection dataset normally contains:

  • Images
  • Object class labels
  • Bounding-box coordinates

Example:

Image: car01.jpg Class: Car Bounding Box: x_min = 100 y_min = 80 x_max = 450 y_max = 300

25. Data Annotation

Data annotation means labeling objects in training images.

For object detection, annotators generally draw bounding boxes around objects and assign class labels.

Example:

Image ↓ Draw Box ↓ Assign Label ↓ Save Annotation

Common annotation formats include:

  • YOLO
  • COCO
  • Pascal VOC

26. Training an Object Detection Model

A simplified training process is:

Collect Images ↓ Annotate Objects ↓ Prepare Dataset ↓ Train Model ↓ Validate Model ↓ Evaluate Model ↓ Deploy Model

27. Training, Validation, and Test Data

A dataset can be divided into:

Dataset ↓ Training Data Validation Data Test Data

Training Data

Used to learn model parameters.

Validation Data

Used to tune the model and make development decisions.

Test Data

Used to evaluate the final model on previously unseen data.


28. Evaluation Metrics

Important object detection metrics include:

1. IoU

Measures overlap between predicted and actual bounding boxes.

2. Precision

Measures how many detected objects are correct.

Precision=TPTP+FPPrecision = \frac{TP}{TP + FP}

3. Recall

Measures how many actual objects were detected.

Recall=TPTP+FNRecall = \frac{TP}{TP + FN}

4. Average Precision (AP)

Measures detection performance for a particular class using a precision-recall relationship.

5. Mean Average Precision (mAP)

The mean of Average Precision values across classes, under a specified evaluation procedure.


29. Example of Object Detection

Suppose an image contains:

3 Cars 2 Persons 1 Bicycle

The model may produce:

Car → 0.96 Car → 0.92 Car → 0.89 Person → 0.94 Person → 0.88 Bicycle → 0.91

The system also provides a bounding box for each detected object.


30. Object Detection Using Python

Modern object detection can be performed using libraries and pretrained models.

A simple example using an Ultralytics YOLO model:

from ultralytics import YOLO # Load a pretrained model model = YOLO("yolo26n.pt") # Run object detection results = model("image.jpg") # Display results results[0].show()

Model names and available versions can change. Use the model version supported by the library installation you are using.


31. Detecting Objects in a Video

Object detection can also be applied to video.

Conceptually:

from ultralytics import YOLO model = YOLO("yolo26n.pt") results = model.predict( source="video.mp4", save=True )

The model processes video frames and produces detections.


32. Real-Time Object Detection

For real-time detection, a camera can continuously provide frames.

Camera ↓ Frame ↓ Object Detection Model ↓ Detected Objects ↓ Display Result ↓ Next Frame

Applications include:

  • Traffic monitoring
  • Security monitoring
  • Robotics
  • Industrial inspection

33. Applications of Object Detection

1. Autonomous Vehicles

Object detection can help identify:

  • Cars
  • Pedestrians
  • Traffic signs
  • Bicycles
  • Other road objects

2. Healthcare

It can assist with detecting objects or regions in medical images.

Examples include:

  • Abnormal regions
  • Medical structures
  • Cells

The actual use depends on the medical task and requires appropriate clinical validation.


3. Security

Object detection can be used for:

  • Person detection
  • Vehicle detection
  • Restricted-area monitoring

4. Traffic Management

It can detect:

  • Vehicles
  • Pedestrians
  • Bicycles

This information can support traffic analysis.


5. Retail

Object detection can assist with:

  • Product recognition
  • Shelf monitoring
  • Inventory analysis
  • Customer behavior analysis

6. Agriculture

It can help detect:

  • Fruits
  • Crops
  • Weeds
  • Agricultural equipment

7. Manufacturing

Object detection can support:

  • Product inspection
  • Defect detection
  • Safety monitoring
  • Equipment monitoring

8. Robotics

Robots can use object detection to identify objects in their surroundings.

Camera ↓ Object Detection ↓ Object Location ↓ Robot Decision ↓ Action

34. Advantages

  1. Automatically identifies objects.
  2. Provides object locations.
  3. Can detect multiple objects.
  4. Can work with images and videos.
  5. Useful for real-time applications.
  6. Reduces manual inspection in suitable tasks.
  7. Can be combined with tracking and other computer vision methods.
  8. Supports automation in many industries.

35. Limitations

  1. Requires suitable training data.
  2. Annotation can be time-consuming.
  3. Complex models may require significant computing resources.
  4. Performance can decrease with poor lighting or image quality.
  5. Small or partially hidden objects can be difficult to detect.
  6. Similar-looking objects can cause confusion.
  7. Model performance depends on the training dataset.
  8. Detection errors can occur in unfamiliar environments.

36. Challenges in Object Detection

1. Occlusion

An object may be partially hidden by another object.

2. Small Objects

Very small objects may contain insufficient visual information.

3. Different Scales

Objects can appear very large or very small.

4. Lighting

Dark or overly bright images can make detection difficult.

5. Background Complexity

Objects may blend into complicated backgrounds.

6. Real-Time Requirements

Some applications require high detection speed while maintaining useful accuracy.


37. Object Tracking vs Object Detection

These are related but different tasks.

Object Detection

Answers:

What objects are present and where are they?

Object Tracking

Answers:

Where is the same object moving across different video frames?

Example:

Frame 1 → Detect Car Frame 2 → Track Car Frame 3 → Track Car Frame 4 → Track Car

A common system combines detection and tracking.


38. Object Detection Workflow

Object Detection ↓ Collect Images ↓ Annotate Data ↓ Prepare Dataset ↓ Train Detection Model ↓ Validate the Model ↓ Evaluate Performance ↓ Deploy ↓ Monitor

39. Object Detection Tools

Common tools and frameworks include:

Tool/FrameworkPurpose
OpenCVComputer vision and image/video processing
PyTorchDeep learning
TensorFlowMachine learning and deep learning
UltralyticsYOLO-based computer vision workflows
Detectron2Object detection and segmentation
RoboflowDataset preparation and computer vision workflows

40. Object Detection in Data Science

Object detection is an important part of Computer Vision, which is a branch of AI and Data Science.

Artificial Intelligence ↓ Machine Learning ↓ Deep Learning ↓ Computer Vision ↓ Object Detection

41. Object Detection vs Classification vs Segmentation

TaskMain QuestionOutput
ClassificationWhat is in the image?Class
Object DetectionWhat and where?Class + Bounding Box
SegmentationWhich pixels belong to the object?Pixel-level mask

Example

For a picture containing a dog:

Classification: Dog Detection: Dog + Bounding Box Segmentation: Dog + Pixel Mask

42. Important Terms

TermMeaning
ObjectItem detected in an image
ClassCategory of object
Bounding BoxRectangle around an object
ConfidenceModel's confidence in a prediction
IoUMeasures box overlap
NMSRemoves redundant overlapping detections
AnnotationLabeling training data
Ground TruthCorrect labeled information
PrecisionCorrectness of positive detections
RecallAbility to find actual objects
APAverage Precision
mAPMean Average Precision
DetectorModel used for object detection

43. Key Points

  • Object detection identifies and locates objects.
  • It is a major computer vision task.
  • Detection usually produces class labels, bounding boxes, and confidence scores.
  • Bounding boxes describe object locations.
  • IoU measures overlap between predicted and ground-truth boxes.
  • NMS helps remove duplicate overlapping detections.
  • YOLO, SSD, Faster R-CNN, and DETR are examples of object detection approaches.
  • Object detection can be used with images and videos.
  • Training requires labeled images.
  • Evaluation can use precision, recall, AP, and mAP.
  • Object tracking is different from object detection.
  • Object detection is used in transportation, healthcare, agriculture, retail, manufacturing, security, and robotics.

44. Conclusion

Object Detection is an important application of Artificial Intelligence and Computer Vision. It enables computers to identify objects and determine their locations in images and videos.

Modern detection systems use deep learning to perform tasks such as vehicle detection, pedestrian detection, product recognition, industrial inspection, and video analysis.

A typical object detection system follows this process:

Image/Video ↓ Preprocessing ↓ Feature Extraction ↓ Object Detection ↓ Bounding Boxes ↓ Class Labels ↓ Confidence Scores ↓ Final Results

Object detection continues to be an important technology for building intelligent computer vision applications.

Keep learning. Keep building. Keep growing.

© 2026 Ugenz Academy