Title: Face Filter using Facial Detection

Group Members
Mujtaba Azhar 203078
Muzaffar Iqbal 203130
M.Haseeb 203089

Submitted To
Atka Ali
1. Introduction:
This report explores the implementation of face filters using facial detection in Python. Face filters have
become popular in recent years due to their use in social media platforms and video conferencing
applications. These filters enable users to apply various effects, overlays, and modifications to their faces
in real-time. The report will discuss the objective, methodology, and the tools and technologies,
specifically OpenCV and MediaPipe, used to create a face filter system.

2. Objective:
The objective of this project is to develop a face filter system using facial detection techniques in Python.
The system should accurately detect and track facial features in real-time and apply digital effects to
enhance or alter the user's appearance. The project aims to provide an engaging and interactive experience
for users by offering a range of face filters to choose from.

3. Methodology:
The face filter system will be implemented using the following steps:

a. Facial Detection: The first step involves detecting faces in images or video streams using facial
detection algorithms. OpenCV, a popular computer vision library, provides pre-trained models like Haar
cascades and deep learning-based models such as the Single Shot MultiBox Detector (SSD) or You Only
Look Once (YOLO). These models analyze the input frames to identify regions of interest where faces
are present.

b. Facial Landmark Detection: Once a face is detected, the system proceeds to locate specific facial
landmarks, including eyes, nose, and mouth. Accurate landmark detection is crucial for proper placement
of the face filters. MediaPipe, an open-source library, offers pre-trained models like the Face Mesh, which
utilize machine learning techniques to predict and locate facial landmarks accurately.

c. Filter Application: After detecting and locating the facial landmarks, the system applies the desired
digital effects or filters onto the user's face. These filters can range from simple modifications such as
adding accessories like glasses or hats to more complex transformations like applying makeup, changing
facial expressions, or even applying augmented reality effects. OpenCV provides image processing
functions that enable the application of these filters.

d. Real-time Rendering: The face filter system should process video streams in real-time to provide
an interactive experience. This requires efficient algorithms and optimizations to ensure smooth
performance, even on devices with limited resources. OpenCV and MediaPipe provide capabilities for
real-time video processing, enabling the system to process live video streams, apply filters, and render the
output frames in real-time.

4. Tools and Technologies: OpenCV and MediaPipe

The implementation of the face filter system will rely on two key tools and technologies: OpenCV and
MediaPipe.

a. OpenCV: OpenCV is an open-source computer vision library widely used in Python. It offers a
comprehensive set of functions and pre-trained models for face detection, facial landmark detection, and
image processing tasks. OpenCV's features relevant to this project include its face detection models,
facial landmark detection capabilities, and image processing functions.

b. MediaPipe: MediaPipe is another open-source framework that provides customizable machine

learning solutions for various multimedia processing tasks. It offers pre-trained models and pipelines for
tasks such as face mesh, which accurately predicts facial landmarks in real-time. MediaPipe complements
OpenCV by providing advanced facial landmark detection models that can be integrated into the face
filter system.
Conclusion:
This report discussed the concept of creating a face filter system using facial detection in Python. It
covered the objective, methodology, and the tools and technologies used in the implementation. By
utilizing OpenCV and MediaPipe, we can develop a face filter system that accurately detects and tracks
facial features, applies digital effects, and renders the output in real-time. Such a system enhances user
experiences by offering interactive and engaging face filters for various applications.