RETAIL SHELF MONITORING SYSTEM

Phase 5 submission

College code:9537

College name:AAA College of Engineering and Technology

Technology:IOT

Total number of students in a group:2

Student’s Details within the group:

S.BHANUMATHI
J.SAMYUKTHA BHARATHI

Submitted By:

S.Bhanumathi
 RETAIL SHELF MONITORING SYSTEM

ABSTRACT:

Empty shelves in retail stores pose significant challenges to inventory management and
customer satisfaction. In this research, we present an innovative computer vision-based
solution using YOLOv8, a state-of-the-art object detection algorithm, and Roboflow, a
powerful data pre-processing platform. Our system leverages existing CCTV cameras to
detect and notify empty shelves in real-time, enabling timely restocking and improving
overall operational efficiency. By training the YOLOv8 model on annotated shelf images,
we achieve remarkable accuracy in identifying empty shelf areas. Roboflow facilitates
seamless data preprocessing, including data augmentation and annotation, ensuring robust
model training. The integration of YOLOv8 and Roboflow creates a powerful framework for
effective empty shelf detection in diverse retail environments. The practical implications of
this research are significant. Our solution offers a cost-effective approach to address the
empty shelf problem, eliminating the need for additional sensors or technologies. By
automating the detection process, retailers can streamline inventory management, reduce
labor costs, and enhance customer satisfaction by ensuring product availability. Furthermore,
this study paves the way for future research in the field of computer vision-based retail
management. Areas of exploration include real-time analytics for dynamic inventory
monitoring, personalized shopping experiences using customer behavior analysis, and
integration with existing retail systems for seamless information exchange.

METHODOLOGY:

Methodology for retail shelf monitoring system Using IoT:

.
**Data Collection**: Utilize cameras or other sensors to capture images of retail shelves at regular
intervals. This data serves as the foundation for analysis.

**Image Processing**: Employ computer vision techniques to analyze the captured images. This
involves tasks such as object detection, segmentation, and classification to identify products on the
shelves.

**Data Analysis**: Process the extracted data to assess various metrics, including product placement,
stock levels, pricing accuracy, and shelf organization. This step may involve comparing current data to
predefined standards or benchmarks.

**Anomaly Detection**: Implement algorithms to identify discrepancies or anomalies, such as out-of-

stock items, misplaced products, or incorrect pricing.

**Reporting and Visualization**: Present the findings in a user-friendly format, such as dashboards or
reports, to enable stakeholders to easily interpret and act upon the insights.

**Feedback Loop**: Incorporate mechanisms for feedback and corrective actions based on the
monitoring results. This could involve alerting store staff to restock shelves, adjust pricing, or rearrange
products to optimize sales and customer satisfaction.

**Continuous Improvement**: Regularly evaluate the effectiveness of the monitoring system and refine
methodologies as needed to enhance accuracy, efficiency, and relevance to business objectives.
 BLOCK DIAGRAM:

PROGRAM CODE:

import cv2
import numpy as np

def detect_items(image):
# Use OpenCV to detect objects on the shelf
# Implement object detection algorithm (e.g., YOLO, SSD, etc.)
# Return coordinates and labels of detected items

# Example placeholder:
detected_items = [("Product A", (x1, y1, x2, y2)), ("Product B", (x1, y1, x2, y2))]
return detected_items

def analyze_shelf(image):
# Analyze shelf image to identify empty spaces or misplaced items
# Implement image processing and analysis algorithms
# Return list of empty spaces or misplaced items

# Example placeholder:
empty_spaces = [(x1, y1, x2, y2), (x1, y1, x2, y2)]
return empty_spaces

def visualize_results(image, detected_items, empty_spaces):

# Draw bounding boxes around detected items and empty spaces
for item, (x1, y1, x2, y2) in detected_items:
cv2.rectangle(image, (x1, y1), (x2, y2), (0, 255, 0), 2)
cv2.putText(image, item, (x1, y1 - 5), cv2.FONT_HERSHEY_SIMPLEX, 0.5, (0, 255, 0), 2)

for (x1, y1, x2, y2) in empty_spaces:

cv2.rectangle(image, (x1, y1), (x2, y2), (0, 0, 255), 2)
cv2.putText(image, "Empty", (x1, y1 - 5), cv2.FONT_HERSHEY_SIMPLEX, 0.5, (0, 0, 255), 2)

# Display the image with results

cv2.imshow("Retail Shelf Monitoring", image)
cv2.waitKey(0)
cv2.destroyAllWindows()

# Main function
if __name__ == "__main__":
# Capture image from camera or load from file
 image = cv2.imread("shelf_image.jpg")

# Detect items on the shelf

detected_items = detect_items(image)

# Analyze shelf for empty spaces

empty_spaces = analyze_shelf(image)

# Visualize results
visualize_results(image, detected_items, empty_spaces)

CIRCUIT DIAGRAM:
Components required:

Hardware Requirements:

 Arduino Uno : Arduino Uno is a microcontroller from Arduino Family, a

friendly board based on the ATmega328..
 DHT11: DHT sensor is used to measure the temperature and humidity. It
uses a capacitive humidity sensor and a thermistor to measure the
surrounding air.
 Flame sensor: it detects the flame and responds to the presence of the
flame. 
 Gas sensor (mq2,mq136): There are many MQ sensors but the best for
alcohol detection is Mq-2,136. This sensor provides both digital and analog
output. 
 Buzzer: The buzzer is an electric-sounding device that generates sounds. 
 LED: A light-emitting diode (LED) is a semiconductor l ight source that
emits light when current flows through it.
Software components:
Arduino IDE : Arduino IDE (Integrated development environment) is
software that is used to dump the program into boards. Arduino- IDE’s primary use
is to build electronics-related projects. Arduino is an open-source platform simple
and easy-to-understand platform for coding.

APPLICATIONS:

 Inventory management

 Planogram compliance

 Customer insights

Simulation output link:

https://www.tinkercad.com/things/hh8OAblNkg3-RETAIL-SHELF-MONITORING system