Human Computation Workshop (HComp2009)

June 28, 2009



Opening Session (8:30-09:10)

introductions (8:30-8:45)

An Overview of Human Computation 8:45-9:10

    Luis von Ahn (Carnegie Mellon University)


Session 1: Games (9:10-10:00)

Herd It: Designing A Social Game to Tag Music (9:10-9:20)

    Luke Barrington (UC San Diego)

    Douglas Turnbull (Swarthmore College)

    Damien O’Malley (Music Search, Inc)

    Gert Lanckriet (UC San Diego)

KissKissBan: A Competitive Human Computation Game for Image Annotation (9:25-9:35)

    Chien-Ju Ho (Academia Sinica)

    Tao-Hsuan Chang (National Taiwan University)

    Jong-Chuan Lee (National Taiwan University)

    Jane Yung-Jen Hsu (National Taiwan University)

    Kuan-Ta Chen (Academia Sinica)

Community-based Game Design:  Experiments on Social Games for Commonsense Data Collection (9:40-9:55)

    Yen-Ling Kuo (National Taiwan University)

    Kai-Yang Chiang (National Taiwan University)

    Cheng-Wei Chan (National Taiwan University)

    Jong-Chuan Lee (National Taiwan University)

    Rex Wang (National Taiwan University)

    Edward Yu-Te Shen (National Taiwan University)

    Jane Yung-Jen Hsu (National Taiwan University)


Session 2: Human Computation in Practice: Coffee, Demos and Posters (10:00-11:00)

                                             ========== DEMOS =============

 A Demonstration Of Human Computation Using The Phrase Detectives Annotation Game

    Jon Chamberlain (University of Essex)

    Massimo Poesio (University of Essex)

    Udo Kruschwitz (University of Essex)

Picture This: Preferences for Image Search

    Paul Bennett (Microsoft Research)

    Max Chickering (Microsoft Corporation)

    Anton Mityagin (Microsoft Corporation)

Page Hunt: Using Human Computation Games to Improve Web Search

    Hao Ma (The Chinese University of Hong Kong)

    Raman Chandrasekar (Microsoft Research)

    Chris Quirk (Microsoft Research)

    Abhishek Gupta (Georgia Institute of Technology)

TurKit: Tools for Iterative Tasks on Mechanical Turk

    Greg Little (MIT)

    Lydia Chilton (MIT)

    Max Goldman (MIT)

    Robert Miller (MIT)

Search War: A Game for Improving Web Search

    Edith Law (Carneige Mellon University)

    Luis Von Ahn (Carneige Mellon University)

    Tom Mitchell (Carneige Mellon University)

Magic Bullet: A Dual-Purpose Computer Game

    Jeff Yan (Newcastle University)

    Su-Yang Yu (Newcastle University)

Seaweed: A Web Application for End Users to Design Economic Games

    Lydia Chilton (MIT)

    Clayton Sims (MIT)

    Max Goldman (MIT)

    Greg Little (MIT)

    Robert Miller (MIT)

Thumbs-Up: A Game for Playing to Rank Search Results

    Ali Dasdan (Yahoo! Inc)

    Chris Drome (Yahoo! Inc)

    Santanu Kolay (Yahoo! Inc)

    Micah Alpern (Yahoo! Inc)

    Alice Han (Yahoo! Inc)

    Tom Chi (Yahoo! Inc)

    Jamie Hoover (Yahoo! Inc)

    Ivan Davtchev (Yahoo! Inc)

    Sharad Verma (Yahoo! Inc)

Games for Games: Manipulating Contexts in Human Computation Games

    Aneta Takhtamysheva (Est Creativity Rising)

    Robert Porzel (University of Bremen)

    Markus Krause (University of Bremen)

                                             ========== POSTERS =============

From Active Towards InterActive Learning: Using Consideration Information to Improve Labeling Correctness

    Abraham Bernstein (University of Zurich)

    Li Jiwen (University of Zurich)

TagCaptcha: Annotating images with CAPTCHAs

    Donn Morrison (University of Geneva)

    Stephane Marchand-Maillet (University of Geneva)

    Eric Bruno (University of Geneva)

CAPTCHA-based Image Labeling on the Soylent Grid

    Peter Faymonville (UCSD)

    Kai Wang (UCSD)

    John Miller (Calit2)

    Serge Belongie (UCSD)

Designing Crowdsourcing Community for the Enterprise

    Osamuyimen Stewart (IBM Research)

    Juan Huerta (IBM Research)

    Melissa Sader (IBM CHQ, Communications)

    Andrzej Sakrajda (IBM Research)

    Julie Marcotte (IBM GBS)

    David Lubensky (IBM Research)

A Reputation System for Selling Human Computation

    Trevor Burnham (University of Michigan)

    Rahul Sami (University of Michigan)

Session 3: Game Theory (11:00-11:35)

The Role of Game Theory in Human Computation Systems (11:00-11:10)

    Shaili Jain (Harvard University)

    David Parkes (Harvard University)

On Formal Models for Social Verification (11:15-11:30)

    Chien-Ju Ho (Academia Sinica)

    Kuan-Ta Chen (Academia Sinica)


Session 4: Labeling Cost and Efficiency (11:35-12:15)

Efficient Human Computation: the Distributed Labeling Problem (11:35-11:50)

    Ran Gilad-Bachrach (Microsoft Corporation)

    Aharon Bar Hillel (GM Research)

    Liat Ein-dor (Intel Israel)

Financial Incentives and the “Performance of Crowds” (11:55-12:10)

    Winter Mason (Yahoo! Research)

    Duncan J. Watts (Yahoo! Research)

Session 5: Closing Remarks and Discussion (12:15-12:30)