Entity Linking by Given Text Task Guidelines

Last Update: 9/1/2023

➢ The aim of the “Entity linking by Given Text” task is to determine the contextual
connection between the “Information Card” and the “Given Text”.

Sample Task Screen:

➢ Suggested flow to determine the contextual connection between the “Information

Card” and the “Given Text”:

We suggest you to follow such a flow to become succefull on this task type:
1. Please read & understand the “Given Text” content and the “Information Card” topic

2. Decide if the “Given Text” content has connection with the “Information Card” topic

3. If there is a connection between “Given Text” content and the “Information Card”

topic, decide on the degree of connection

 REMARK: DO NOT say “Primary Topic” or “Topic Mentioned” just due to same keywords
appearing in the “Given Text” and in the “Information Card”. Pay attention to their meanings
and purpose of use to decide on your final marking.

PRIMARY TOPIC: If the “Given Text” content and the “Information Card ” topic are matching
well we should use PRIMARY TOPIC label. In other words, if the “Information Card” topic is
also the main content of the “Given Text” we should use PRIMARY TOPIC label. Please note,
“Given Text” may be short but you should select PRIMARY TOPIC if the “Given Text” is
considerably talking about the same topic with the “Information Card”.

PRIMARY TOPIC EXAMPLES

Information Card Title Information Card Given Text Comment & Correct Labeling
The Honda Civic Type R is a series of
high-performance hatchback/sedan
models based on the Civic,
civic type r - The Civic Type R is a high-
developed and produced by Honda
performance version of the Honda Civic The information card is devoted to
since September 1997. The first Civic
compact car. It has exclusive features like specific model of Honda: Honda Civic
Type R was the third model to
the Type R emblem, triple exhaust pipes Type R. The given text is also defining
Honda Civic Type R receive Honda's Type R badge. Type
and a distinctive front grille. It is also the the same model. So, the information
R versions of the Civic typically
most powerful Civic Type R to date, card topic is the primary topic of the
feature a lightened and stiffened
expected to launch in 2023. Are you given text.
body, specially tuned engine, and
interested in buying one?
upgraded brakes and chassis, and
are offered only in five- or six-speed
manual transmission.

Samsung Galaxy Z Fold4 Samsung Galaxy

The Samsung Galaxy Z Fold 4 is a Z Fold4 from Comcast Business Mobile in
The information card is talking about
foldable smartphone that is part of Phantom Black XFINITY Comcast business
Galaxy Z Fold 4 brand of Samsung
the Samsung Galaxy Z series. It was Sign In Save up to $500 on this device and
smartphone. Although, the given text
Samsung Galaxy Z Fold announced at the August 2022 pay over 24 months. Pricing & Other Info
is not a complete paragraph it is totally
4 edition of Galaxy Unpacked Samsung Galaxy Z Fold4 5G Device Color:
talking about the same phone model.
alongside the Galaxy Z Flip 4. It was Phantom Black Storage 256GB 512GB
So, the information card topic is the
released on August 25, 2022. It is the Availability In Stock Payment Pay in full
primary topic of the given text.
successor to the Galaxy Z Fold 3. $1799.99 Pay monthly Estimated monthly
payment $74.99 $54.16

TOPIC MENTIONED: Choose TOPIC MENTIONED if the “Given Text” somehow mentions the
“Information Card” topic, but “Information Card” and “Given Text” topic are NOT strongly
connected to each other.

REMARK: You will face with some cases where the “Information Card” is talking about a broad
topic but the “Given Text” is covering only small part of the “Information Card” topic.

For example, “Information Card” is written for general definition of Microsoft Excel, and
“Given Text” is only for "Protect a sheet in excel". Or, “Information Card” is written for a TV
serials and “Given Text” is only for the specific episode of the same TV serials. Such cases
should be marked as TOPIC MENTIONED.
 TOPIC MENTIONED EXAMPLES

Information Card
Information Card Given Text Comment & Correct Labeling
Title
Toad's Adventure "Thomas & Friends"
Toad's Adventure (TV Episode 2014) -
IMDb All Thomas & Friends S18. E6 All
episodes Cast & crew IMDbPro All topics
Thomas the Tank Engine & Friends is
Toad's Adventure Episode aired May 13,
a children's television series about The information card is talking about the
2015 TV-Y 11 m IMDb RATING 8.0 /10 49
the engines and other characters serial but given text only focus on specific
YOUR RATING Rate Animation Short
Thomas & Friends working on the railways of the Island episode: Toad's Adventure - S18. E6. The
Adventure Toad is bored of listening to
of Sodor, and is based on The Railway topic from information card is only the
Oliver's stories and wants an adventure of
Series books written by the Reverend mentioned topic of the given text.
his own. He gets his wish when some
W. Awdry.
trucks breakaway on Gordon's Hill. Can
Toad stop the trucks before they collide
with Thomas? Director David Stoten
Writers Mark Huckerby Nick Ostler
Robert Francis Kennedy, also known
by his initials RFK and by the
RFK killer Sirhan Sirhan moved to another
nickname Bobby, was an American
prison -- on anniversary of JFK
politician and lawyer. He served as
assassination RFK killer Sirhan Sirhan
the 64th United States Attorney The information card is written for
moved to another prison -- on anniversary
General from January 1961 to Robert F. Kennedy but the given text is
of JFK assassination U.S. RFK killer Sirhan
September 1964 and as a U.S. mainly a news about RFK killer Sirhan
Robert F. Kennedy Sirhan moved to another prison -- on
senator from New York from January Sirhan. Robert F. Kennedy, the main topic
anniversary of JFK assassination Sirhan
1965 until his assassination. Like his of the information card, is just
Sirhan was convicted of assassinating Sen.
brothers John F. Kennedy and Ted mentioned in the given text.
Robert F. Kennedy in 1968. He is shown at
Kennedy, he was a prominent
a parole board hearing in 2011. Parole was
member of the Democratic Party and
denied. Ben Margot / AP file
is viewed by some historians as an
icon of modern American liberalism.
Car number plates starting CP12A All car
Vehicle registration plates are the regs beginning with CP12A - value, MOT
alphanumeric plates used to display history, tax and insurance details Car The information card tells us about
the registration mark of a vehicle, number plates starting CP12A Enter a Vehicle registration plates of the United
and have existed in the United registration number below to find a Kingdom. It is giving general information
Vehicle registration
Kingdom since 1904. It is compulsory vehicle's history I own this car Home on the topic. The given text has a very
plates of the United
for motor vehicles used on public Number Plates C CP CP12 CP12A Please special content for the vehicle plates in
Kingdom
roads to display vehicle registration see below the list of number plates the Swansea region (pay attention it is
plates, with the exception of vehicles registered between Mar 2012 to Sep 2012 also in UK). It is still connected to the
of the reigning monarch used on period, in the Swansea region. Click on the information topic but just mentioned.
official business. registration number you are interested in,
to see all the details about that reg.
GitHub, Inc. is an Internet hosting
resume builder php code github reposI
service for software development
found some GitHub repositories that have
and version control using Git. It The information card is defining the
resume builder php code. Here are some
provides the distributed version GitHub platform. The given text is
of them: - Infogiants/resumebuilder: A
control of Git plus access control, bug specially for some code samples from
script that generates Docx and PDF based
GitHub tracking, software feature requests, GitHub. The topic from information card
on dynamic HTML content. -
task management, continuous the NOT primary topic of the given text
jatinsumai1104/Resume-Generator: A
integration, and wikis for every but still connected. This can be accepted
web app that takes user details and
project. Headquartered in California, as Topic Mentioned case.
creates a resume of the style you like using
it has been a subsidiary of Microsoft
Code Igniter framework.
since 2018.
 NOT MENTIONED: Choose NOT MENTIONED if the “Given Text” does not give any information
about the “Information Card” topic. It is definitely another topic that is mentioned in the
“Given Text” and in the “Information Card”.

REMARK: Sometimes there are two completely different topics sharing the same name, such
as a rock band and a kids' book, an anime and a manga about same heroes, two people named
same. These should be marked as NOT MENTIONED. A given text devoted to a book while
information card is devoted to a film should be labelled NOT MENTIONED too.

NOT MENTIONED EXAMPLES

Information Card
Information Card Given Text Comment & Correct Labeling
Title
An out-of-pocket expense is the direct
out of pocket The term out of
payment of money that may or may not
pocket has more than one
be later reimbursed from a third-party
meaning. One meaning is to have
source. For example, when operating a
lost money in a transaction or to Please be attentive. Your information card
vehicle, gasoline, parking fees and tolls
have paid for something directly. topic is Out-of-pocket expense, and the
are considered out-of-pocket expenses
Another meaning is to be out of primary topic of the given text is
Out-of-pocket for a trip. Car insurance, oil changes, and
reach, absent or unavailable . This definitions of "out of pocket" only. So,
expense interest are not, since the outlay of cash
meaning is mostly used in similar words are not enough, such cases
covers expenses accrued over a longer
American English and British with distinct topics should be marked as
period of time. The services rendered and
English. For example, you can say 'Not mentioned'
other in-kind expenses are not considered
"I'm out of pocket for the next
out-of-pocket expenses; the same goes
hour, please call me later." What
for depreciation of capital goods or
are you looking for specifically?
depletion.
Toad's Adventure "Thomas &
Mr. Toad, of Toad Hall, is one of the main Friends" Toad's Adventure (TV
characters in the 1908 novel The Wind in Episode 2014) - IMDb All Thomas & Please pay attention to full information
the Willows by Kenneth Grahame, and Friends S18. E6 All episodes Cast & card. It is written for a book character but
Mr. Toad
also the title character of the 1929 A. A. crew IMDbPro All topics Toad's the given text is only for similar named
Milne play Toad of Toad Hall based on the Adventure Episode aired May 13, episode of TV serial.
book. 2015 TV-Y 11 m IMDb RATING 8.0
/10

PLEASE CONSIDER:

1. Make sure you understand, what the topic exactly is, by attentively reading the
description. E.g. Topic name 'Harry Potter' Ok, but what's in the description? Film
series? Book series? Videogames? Lego set? That is what you'll be searching on the
given text to define, if it is the primary topic, mentioned topic or not mentioned topic.
2. If the topic is a book author, actor/director, team couch and the given text primary
topic is a book, film, team respectively, be VERY attentive. Mostly these will be marked
not higher than 'Topic mentioned'.
3. There do exist different people with exactly the same name. If you have a scientist
from the 18th century in the information card, the given text about an actor in 2012
with that name, it is definitely about someone different and such pages should be
marked 'Not mentioned'.
4. For TV series, if the topic is the whole series, and the given text is about a season or
episode, but the series name is mentioned (it usually is), These are marked 'Topic
mentioned'.
5. Pay special attention to the locations of the entities in the description and the given
text; it is very likely that they share a similar or even the same name, but are located
at different places. Such entities are marked 'Not mentioned'.

REMARK: Please also see “Some More Examples” tab. It has good cases to digest
complicated cases well.
Last Update: 9/1/2023