Page Recommendations: Judge a webpage abstract

Last updated March 30, 2022

Task Overview
In this task, we will ask you to analyze a source/viewed webpage and to determine, if a user would be
interested in visiting the second web page judging by an abstract of it (on the right).

You may visit the second webpage too, if needed, by clicking on the link to get more context about the
recommended page.

To help complete this task, please use Chrome browser, and install UHRS Chrome Extension. It will help
display some pages in the HitApp properly.
If you see a blank screen please open the page in a new tab by clicking the url. If it does not open in the
new tab either, choose 'Can't judge'.

Judgement Values

Useful
For a given page, the user finds the recommended page is useful or would like to click it to explore
more. Usually, the recommended page and viewed page should be relevant and have shared topics
(Example 1,2,3). Please pay attention to below special situations of “Useful” judgements:
• The given page is about location-sensitive information, like local service, local weather, local
news, etc. If the recommended page is about the same information of bigger area, please rate
“Useful” (Example 3), but not vice versa (Example 5). The same information in different location
is NOT useful (Example 4).
• If there is somehow any connection between recommended page and given page
please mark them as useful. (Examples: 11,12)
• If a user has browsed a certain page, we need to display a page with similar content. For
example, if the user has looked at a page about football news, pages containing football
news or information about football will attract the user's attention. Such situations
should be considered useful. We need to evaluate the given page in general topic, not
specifically. (Example: 13,14)

NOT Useful
The user finds the recommended page is useless and has no interest in clicking it. Usually, it happens
when the recommended page is irrelevant to the viewed page, the main subject and topic different
(Example 6,8,9). Some special situations are as follows:
• The given page is about location-sensitive information, like local service, local weather, local
news, etc. if the recommended page has same content in different/more specific/smaller area,
it is “not useful” (Example 4,5).
• The recommended page’s content is too broad (Example 7).
• If the content of the recommended page is same, almost the same or highly repetitive with the
given page, please rate “Not Useful”.
Can't Judge
Some hits may be impossible to judge in the following situations.
• The source page or recommended page contains inappropriate/illegal content, like drugs, piracy,
pornographic, adult content, malware, malicious content …
• The source page or recommended page could not be viewed (Example 10), even after opening it in
a new tab or incognito window. Situations include pages with 404 or other loading errors, pages
 with content behind privacy warnings from your browser Blockers due to being served from
another country.
• You can’t understand the content of one or both pages. For example, one or more of the pages are
in a foreign language, or spam or excessive advertisements make it so you cannot access the
content.

Judging Examples

# Viewed page Recommended page Judgement

Example 1 http://en2.websudoku https://www.bing.co

Useful.
.com m/fun/sudoku
The recommended page has the same topic of
“Sudoku” and quite related with the viewed page.
Users would find it useful and would like to click it.

Example 2 https://bestlifeonline. https://www.eatthis.c Useful.

com/walmart- om/news- Both the viewed page and recommended page are
closingstores-april- walmartclosing- about Walmart closing stores. They are highly
2022news/ somelocations- related. The recommended page is useful to user
march2022/ viewing the source page.

Example 3 http://gis.hicentral.c http://opala.org/solid Useful.

om/fastmaps/env/e _waste/collection_sch Both are websites for waste collection schedule.
nvDetails.aspx?tmk= edule_search.html The service is location sensitive. The
55001035&lyrLst=1| recommended page has high-level content, which
could be useful to user.
1|0|0|0|lblsaerial2
008&num=&street=
Kam
Example 4 https://www.manches https://www.birmingh Not Useful.
ternh.gov/Department amal.gov/bulktrash The information is location sensitive. Although
s/Highway/Trash- both are websites for waste collection schedule,
andRecycling/Collection- users in Manchester will not interested in the
Schedules waste collection service in Birmingham.

Example 5 http://opala.org/solid https://www.manches Not Useful.

_waste/collection_sch ternh.gov/Department The trash collection service is location sensitive.
edule_search.html s/Highway/Trash- Both are websites for waste collection schedule,
andRecycling/Collection- but the recommended page involves specific
Schedules (Manchester, New Hampshire) area to be useless
to users viewing given page.

Example 6 https://www.apple.co Not Useful.

https://www.amazon.
m/watch/ The viewed page is about electronic product, but
com/Fresh-
the recommended page is about fruit. They are
Apples/b?node=72469
totally irrelevant. The recommended page is
4011
useless.
Example 7 http://na3hl.com/tea
Not Useful.
ms https://www.tripsavvy
Topic of recommended page is too broad and
.com/washington-dcpro-
general for the given page, which is specifically
sports-teams1040323
about Tier III NA Hockey League.

Example 8 http://minecraft.nova https://www.wallpape Not Useful.

skin.me/wallpapers rdirect.com/brands/vil The viewed page’s main topic is “Minecraft”, but
la-nova the recommended page is about decoration
wallpaper. People playing Minecraft game will not
interested in the house decoration. The
recommended page is useless.

Example 9 https://soliditylang.or g/ https://blockgeeks.co Not Useful.

m/guides/solidity/ The viewed page solidity is about programming
language, but the recommended page is about
block chain. They are irrelevant. The
recommended page is useless to user viewing
source page.

Example 10 https://www.natgena https://natgenhealth.c Can't Judge.

gency.com/MainMenu om/ The given page could not be opened.
.aspx

Example 11 http://classic-
solitaire.com/
Useful
https://ourpastimes.co
Main topic of given pages is card games.As we can
m/play-spades-nil-blind-
see that both pages are related to cards games so
nil-4488443.html
there is a shared topic and connection between
given and recommended page.

Useful
Example 12
https://www.insider.com https://www.drugs.com/ Main topic of given page realted to eye.Both pages
/fda-eye-drop-ointment- cdi/eye-drops.html are related to eye so we can say that
recall-delsam-ezricare- recommended page is useful for the user
contaminated-artifical-
tears-2023-2

Useful
Example 13 https://www.msn.com/
https://www.espn.com/t Main topic of given page is tennis user will find
ennis/story/_/id/3551751 en-
recommended pages useful because given page is
3/stefanos-tsitsipas- us/news/technology/te
realted to tennis and recommended page also
invites-margot-robbie- nnis-stars-battle- related to tennis
australian-open pressures-and-each-
other-in-fst-s-the-last-
match/ar-
AA17HEoA?ocid=BingNe
ws
 Useful
Example 14
https://www.usatoday.co https://www.msn.com/e Main topic of given page is about the war in Ukrain
m/story/news/world/202 n-us/news/world/they- os there is connection between recommended
3/01/26/ukraine-russia- got-married-the-day- page and given page
war-live- russia-invaded-it-s-been-
updates/11125605002/ the-longest-year-of-their-
lives/ar-
AA17PYZP?ocid=BingNew
s