Crowdsourcing and human computation are transforming human-computer interaction: from games with a purpose, to creative uses of Mechanical Turk, to massive volunteer projects like Wikipedia, to new ways to run user studies and new interactive systems powered by crowds. We are just beginning to learn what's possible when we harness the crowd in human-computer interaction. The goal of this workshop is to stake out a research agenda for our field.
This one-day workshop will bring together researchers within and
beyond the CHI community who have demonstrated interest in
crowdsourcing and human computation, in order to lay out a framework
for continued innnovation. We aim to gather researchers who are:
- Studying how to use crowdsourcing as a tool in user-centered design and HCI research, such as
user testing, formative evaluation, or controlled experiments
- Building and studying systems powered by human computation and the contributions of crowds
- Studying crowdsourcing platforms like Mechanical Turk and interested in how to engineer better
In addition to community building, we want to produce several deliverables:
- A research agenda for the field
- A set of requirements for an ideal crowdsourcing platform for HCI work
- A group-edited bibliography drawing together crowdsourcing work from many disciplines (not just HCI)
These deliverables will be posted on this web site and maintained going forward.
Note that this workshop is not intended for presentations of original research work.
After a round of introductory lightning talks, we will spend most of the day
in group discussion.
The times in the schedule below are tentative, depending on exactly when CHI schedules the refreshment breaks in the morning and afternoon.
Introduction and overview by the workshop organizers.
1-minute talk from authors of each position paper, with opportunities for questions and discussion at intervals.
Three-person chats about research interests, rotating every 10 minutes.
Tables for small-group work:
- research agenda
- platform requirements
- ... plus other tables proposed by participants
Continue small-group work, and summarize for closing plenary.
Table leaders summarize their results.
Final discussion and thoughts about what comes next.
In the list below, the authors in boldface will be attending the workshop. Note that this workshop is not archival (unlike workshops in
some non-SIGCHI communities), so work shared in the position papers below can be later submitted to
future archival research venues.
Eytan Adar (University of Michigan)
Benjamin B. Bederson, Alex Quinn (University of Maryland)
Lukas Biewald, Mollie Allick (CrowdFlower)
Jeffrey Bigham, Erin Brady, Samuel White (University of Rochester)
Jenny J. Chen, Natala J. Menezes, Adam D. Bradley (Amazon)
Kuan-Ta Chen (Academia Sinica)
Parmit K. Chilana, Andrew J. Ko, Jacob O. Wobbrock (University of Washington)
Nick DePalma (MIT Media Lab), Sonia Chernova (Worcester Polytechnic), Cynthia Breazeal (MIT Media Lab)
Mira Dontcheva (Adobe), Elizabeth Gerber, Sheena Lewis (Northwestern)
Steven P. Dow, Scott R. Klemmer (Stanford)
Casey Dugan, Werner Geyer (IBM Research)
Thomas Erickson (IBM Research)
Adam Fourney, Michael Terry (University of Waterloo)
Dan Goldman, Joel Brandt (Adobe)
David Alan Grier (George Washington University)
Gary Hsieh (Michigan State University)
Jessica R. Hullman (University of Michigan)
Panagiotis G. Ipeirotis (NYU), John J. Horton (oDesk)
Anand Kulkarni (UC Berkeley)
Ben Lafreniere, Michael Terry (University of Waterloo)
James Landay (University of Washington)
Edith Law (Carnegie Mellon University)
Alison Lee, Richard A. Hankins (Nokia Research)
Greg Little (MIT CSAIL) and Yu-An Sun (Xerox)
Kurt Luther (Georgia Tech)
Adam Marcus, Eugene Wu, David R. Karger, Samuel Madden, Robert C. Miller (MIT CSAIL)
David McDonald (University of Washington)
Robert Morris (MIT Media Lab)
Jeffrey Nichols, Jalal Mahmud (IBM Research)
Jeffrey V. Nickerson, Yasuaki Sakamoto, Lixiu Yu (Stevens Institute of Technology)
Gabriel Parent, Maxine Eskenazi (Carnegie Mellon University)
Sharoda A. Paul, Lichan Hong (Palo Alto Research Center), Ed H. Chi (Google)
Alexander J. Quinn, Benjamin B. Bederson (University of Maryland)
Jakob Rogstadius, Vassilis Kostakos (University of Maderia), Jim Laredo, Maja Vukovic (IBM Research)
Irene Ros, Yannick Assogba, Joan DiMicco (IBM Research)
Jeffrey M. Rzeszotarski (Carnegie Mellon University)
Kate Starbird (University of Colorado)
William Thies, Aishwarya Ratan (Microsoft Research India), James Davis (UC Santa Cruz), Ed Cutrell (Microsoft Research India, participating on behalf of MSR India authors)
Brian E. Tidball, Pieter Jan Stappers (Delft TU)
Anthony Tomasic, John Zimmerman, Aaron Steinfeld, Yun Huang, Daisy Yoo, Chaya Hiruncharoenvate, Ellen Ayoob (Carnegie Mellon University)
Michael Toomim (University of Washington)
Haoqi Zhang (Harvard University), Eric Horvitz (Microsoft Research), Robert C. Miller (MIT CSAIL), David C. Parkes (Harvard University)
As with previous years, workshop attendees are required to register
for at least one day of the full CHI conference, in addition to paying
a fee for the workshop.
rates can be found on the CHI 2011 web site. Only those who have
had position papers accepted can attend the workshop. Accepted
participants will be provided with a registration code by the workshop
organizers, which will allow them to register for the workshop on the
CHI 2011 registration site.