FAKULTI 

SAINS KOMPUTER DAN MATEMATIK

SARJANA MUDA SAINS (KEPUJIAN) STATISTIK

TITLE

GOOGLE LENS

PROVIDED BY:

CSC583 (AI ALGORITHMS)

SEMESTER 2
SESI 2021/2022
 TABLE OF CONTENT

N CONTENT PAGES
O
1 Google Lens overview 2
2 Google Lens characteristic and component 3-4
3 Google Lens Behaviors 5
4 Google Lens Abilities 6
5 Advantage & Disadvantage of Google Lens 7-9
6 Conclusion 10
7 Reference 11

1
Google Lens Overview

Google Lens is an AI-powered generation that mixes your phone digital digicam and
deep device getting to know no longer simplest become aware of however additionally
interpret an item in the front of the digital digicam lens and offer sports like scanning,
translation, and purchase.
Lens turned into one in every of Google's important bulletins on four October 2017,
but it turned into simplest to be had at the Google Pixel while it released. Google Lens
has since made its way to most Android device. It's accessible from within the Google
Photos app on both Android and iOS.
We can use Google Lens to aim your phone at something, like a certain flower, and
then ask Google Assistant what that object is. You won't just get the answer; you'll also
get recommendations depending on the thing, such as nearby florists in the case of a
flower.

2
Google Lens characteristic and components

Lens utilizes computer vision, machine learning, and Google's Knowledge Graph to
transform what people see in the real world into a visual search Box, letting them become
aware of items including flowers and animals or reproduction and paste textual content
from the actual international into their phone. The Google Knowledge Graph is a
knowledge base used by Google and its services to improve the search engine's results
with data acquired from various sources. Users will see the information in an info box
next to the search results.

Region Proposal Network (RPN)

After Google Lens has captured an image, it must identify the shapes and
characters. This is critical for jobs involving text recognition. As a result, optical
character recognition (OCR) employs a region proposal network (RPN) to detect
character level bounding boxes that can then be combined into lines for text recognition.
RPN is a fully convolutional network that predicts object limits and objectness scores at
each place at the same time. RPN is taught to provide high-quality region proposals,
which are then employed for detection by Fast R-CNN. In a nutshell, it component
instructs the unified network where to look.
Because the photos collected by Google Lens may contain sources such as
signage, handwriting, or papers, a plethora of new issues may develop. The lettering can
be hidden, stylized, or unclear, causing the model to misinterpret words. Lens in uses the
Knowledge Graph to provide contextual clues, such as whether a term is likely a proper
noun and should not be spell-corrected, and other such details, to improve word accuracy.

3
Convolutional Neural Networks(CNNs)

Convolution neural networks (CNNs) became the backbone for many computer
vision applications when massive datasets and compute resources became available. In
consequence, the area of deep learning has mostly shifted toward the building of CNN
architectures for enhancing image identification performance.
Lens use CNNs to detect cohesive text blocks such as columns, as well as text in a
consistent style or colour. Then, within each block, it employs signals such as text
alignment, language, and the geometric relationship of the paragraphs to identify their
ultimate reading order.
Separable convolutional neural networks (CNNs) with an extra quantized long short-term
memory (LSTM) network handle all of these phases, from script detection and direction
identification through text recognition. And the models are trained using data from a
number of sources, including ReCaptcha and scanned images from Google Books.
Neural Machine Translation Algorithm

Neural Machine Translation (NMT)

Translations must be both accurate and relevant in order to present users with the
most useful information. Lens use Google Translate's neural machine translation (NMT)
algorithms to translate full phrases at a time, rather than word by word, to preserve proper
grammar and diction.
To be most useful, the translation must be given in the context of the original text.
German sentences, for example, are typically longer than English sentences. Lens
redistributes the translation into lines of comparable length and selects an appropriate
font size to match in order to achieve this smooth overlay. It also matches the colour of
the translation and its background to the original text using a heuristic that assumes the
background and text differ in luminance and that the background occupies the majority of
the area.

4
Google Lens behaviour

Lens compares the things in your photo to other photos and scores them according to
how similar and relevant they are to the objects in the original photo. Lens also searches
the web for more related results based on the objects in your photo. Lens may also
employ other useful signals to evaluate ranking and relevancy, such as words, language,
and other metadata on the image's host site.

Lens typically creates numerous possible results while evaluating an image and ranks
the likelihood of each result's relevance. Lenses can sometimes reduce these options to a
single outcome. Let's imagine Lens is gazing at a dog that it thinks is 95% German
shepherd and 5% corgi. Lens may only show the result for a German shepherd in this
situation because it is the most visually similar. In some other example, if Lens
acknowledges a barcode or textual content in an image (for example, a product call or a
book title), Lens might also additionally go back a Google Search consequences web
page for the object.

5
Google Lens abilities

 Copy text from real world-

One of the abilities of Google Lens that I utilise the most is its ability to copy text
from the real world. It's a fantastic function that comes in handy quite frequently
(at least to me). It's simple to put this to use. Simply turn on Google Lens and
point your camera at the text you want to copy. Lens will highlight the text if you
tap it. After that, simply drag to pick what you want to copy, then press the 'Copy
text' option. It's as simple as that.

 Detect things-
Google Lens is also capable of recognising flowers, animals, iconic paintings, and
a variety of other objects, such as landmarks. So, the next time you're out for a
walk and come across an unfamiliar flower, try using Google Lens to identify it.
To figure out what the flower, animal (or object) is, simply point your camera at
it. If it doesn't work (which it occasionally does), I find it easier to simply take a
picture of it and utilise Google Lens inside Google Photos. Yes, Lens is a little
picky right now, but we'll give it some time to catch up on its world knowledge.
Unless Google decides to send it down the same path as Hangouts, Google Plus,
or Allo.

6
Advantage & Disadvantage of Google Lens

Advantage

1. You can use it to replicate textual content effortlessly –

Google Lens will assist you to replicate textual content and recognize all unique
statistics to be had in the textual content, including electronic mail addresses,
addresses, dates, and numbers.

2. You can discover comparable merchandise with Google Lens –

Searching for comparable stuff at the net with Google Lens might be a breeze. All
you need to do is take a photo, and Google Lens will cope with the rest. As a result,
you may be capable of discover what you need while not having to work. With
Google Lens, you can get on the spontaneous results. You might be proven the
findings, at the side of hyperlinks to complete your purchase. As a result, you may be
capable of get what you need while not having to strive.

3. Gather Quick Information, Especially Books –

With the assist of Google Lens, collecting short statistics on books becomes a breeze.
If you experience reading, you'll recognize this option. All you need to do is factor
your smartphone's digital digicam to the book's cowl. After that, you could get a
concise synopsis of the book. You can preserve to search for greater statistics
approximately the book in case you need

7
4. Easily Open Links –
Opening hyperlinks might be a smooth component to do with the assist of Google
Lens. When you're surfing for something in your computer, however you encounter
the want to without delay transfer to the smartphone, you can test this option provided
via way of means of Google Lens. All you need to do is to test the hyperlink together
along with your smartphone and use Google Lens. Then you could use your cell
smartphone to preserve surfing. On pinnacle of that, Google Lens can knowledge
hyperlinks which are covered in commercial enterprise cards &posters.

5. You Can Get Reviews on Venues –

Assume which you are searching ahead to touring one of the cafes or eating places on
your nearby area. Before you stroll in, you'll encounter the want to parent out greater
statistics approximately it. This is in which Google Lens can assist. You might be
capable of advantage short get right of entry to critiques approximately that venue in
your cell smartphone. Hence, you could make the selection on whether or not you
cross beforehand or now no longer.

6. You Can Discover Good Music with Google Lens –

When you spot an album cover and you encounter the want to parent out that that
album, you could get the assist of Google Lens. All you need to do is to test the
album cover with Google Lens. You might be capable of advantage get right of entry
to the statistics you need without delay.

7. You Can Scan QR Codes –

You can discover QR codes everywhere. If you need to get extra statistics
approximately QR codes, you can test Google Lens. It will assist you to find all
records associated with the QR code without delay in your cell smartphone with the
assist of the QR code. Hence, you could use it without maintaining any 2d mind in
mind.

8
8. You Can Identify Plants and Animals –
By the usage of Google Lens, you could effortlessly become aware of flora and
animals as properly. You will encounter many special forms of flora and animals in
everyday life. Finding greater statistics approximately them will in no way be a hard
component to do whilst you're the usage of Google Lens. You simply want to snap
shots of the animals and flora which you encounter. Then the AI-primarily totally
based engine of Google Lens will assist you to parent out greater statistics
approximately them.

Disadvantage

1. Google Lens will acquire statistics from you –

If you're worried approximately your statistics being shared with 1/3 parties, you
ought to assume difficult earlier than the usage of Google Lens. Google Lens makes
use of the statistics you offer to offer the excellent provider possible. You may also
count on Google Lens to preserve collecting statistics once you set up it. This does
now no longer take a seat down properly with sure folks. As a result, Google Lens
isn't an alternative for such human beings to consider. You may also find out after
putting in the Google Lens app that it's miles intrusive.

2. Not a 100% accurate –

Even though Google Lens is the excellent device of its kind to be had, it's miles a
long way from flawless. This is due to the fact it's miles not able to offer you with a
hundred percentage correct findings in any respect times. According to statistical
research, Google Lens may also provide as much as 92 percentage correct results. As
a result, you should not depend completely on Google Lens.

9
Conclusion

Google has some of answers which could help people in making their existence easier.
Google Lens is a first-rate instance of a product like this. If you need to make your phone
smarter and do not thoughts the negatives, you can set up Google Lens for your device.

10
Reference

1. Google Lens. (2022). Google Lens. https://lens.google/howlensworks/

2. Pocket-lint. (2022, March 23). Pocket-lint. Pocket-Lint; Pocket-lint. https://www.pocket-

lint.com/apps/news/google/141075-what-is-google-lens-and-how-does-it-work-and-

which-devices-have-it

3. Song, J. (2021, September 16). Google Lens – 10 Significant Pros and Cons. Modern

Catalysts; Modern Catalysts. https://moderncatalysts.com/pros-cons-google-lens/

4. Villas-Boas, Antonio. "Google just showed off 4 major updates to its futuristic Lens
technology that anyone who goes out to restaurants will love". Business Insider.
Retrieved May 11, 2019.

5. Ram Sagar. (2019, September 8) These Machine Learning Techniques Make Google
Lens A Success; https://analyticsindiamag.com/these-machine-learning-techniques-
make-google-lens-a-success/

11