Professional Documents
Culture Documents
Conference Tracker: Andy Carlson Vitor Carvalho Kevin Killourhy Mohit Kumar
Conference Tracker: Andy Carlson Vitor Carvalho Kevin Killourhy Mohit Kumar
Conference Tracker: Andy Carlson Vitor Carvalho Kevin Killourhy Mohit Kumar
(project presentation)
Andy Carlson
Vitor Carvalho
Kevin Killourhy
Mohit Kumar
Overview
• Goal: To find and gather salient details about
conferences and workshops.
• Submission Deadline
• Location
• Home page
… and others
• Preliminary results:
• Succeeded in autonomously finding conferences, submission
deadlines, locations, and homepages
… although not without error
… approaches ranged from bootstrapping to focused crawling
Conference Tracker
Module
• Precision:
– All conferences: top1 = 2%, top 3 = 5.8%, events = 13.4%
– More recent conferences: (SIGIR, ICML, KDD, 2003-2006):
• Top 1 = 50%, Top 3 = 75%
Submission Date
• Problems:
– Main conference and workshop/tutorial dates
– Conferences co-located
– Same conference but previous year
– Actual conference event dates
– Change of deadlines
– Hard to evaluate: just couldn’t find the deadline for
some old conferences
Overall Results
• Acronym finder • Location finder
– 100% precision – 21% locations correct
– 38% lists, 30% none
• Name/page finder – 11% wrong
– 49% names correct
– 23% names & URLs • Date finder
– (85% on vetted data) – 2% completely right
– 5.8% in top 3
– 13.4% event dates
Lessons Learned
• If we really are learning, then reconsider
earlier decisions in light of new knowledge
– Pass 1: AAAI = Holger Hoos and Thomas Stuetzle, IJCAI Workshop
– Pass 2: AAAI = National Conference on Artificial Intelligence