• Accepted Papers

View a full list of accepted papers and the full proceedings.

  • Keynotes

Find detailed information about the keynotes.

  • HCOMP-18 Preliminary Technical Program

Thursday, July 5, 2018

Full or Partial Day Workshops

Friday, July 6, 2018

Sessions location: KOL-F-104

9am-9:10am Opening Remarks: Yiling Chen and Gabriella Kazai, HCOMP-18 Program Chairs

Session 1: Human and Machine AI

Chair: Mark Heath (CloudFactory)
Active Learning with Unbalanced Classes and Example-Generation Queries Christopher H. Lin, Mausam, Daniel S. Weld
EURECA: Enhanced Understanding of Real Environments via Crowd Assistance Sai R. Gouravajhala, Jinyeong Yim, Karthik Desingh, Yanda Huang, Odest Chadwicke Jenkins, Walter S. Lasecki
Towards Accountable AI: Hybrid Human-Machine Analyses for Characterizing System Failure
Honorable Mention Paper
Besmira Nushi, Ece Kamar, Eric Horvitz
Usability of Humanly Computable Passwords Samira Samadi, Santosh Vempala, Adam Tauman Kalai
10:30am-11am Coffee break

Session 2: Crowd Optimization

Chair: Jenn Wortman Vaughan (Microsoft Research)
"A Game without Competition Is Hardly a Game": The Impact of Competitions on Player Activity in a Human Computation Game Neal Reeves, Peter West, Elena Simperl
Skill-and-Stress-Aware Assignment of Crowd-Worker Groups to Task Streams Katsumi Kumai, Masaki Matsubara, Yuhki Shiraishi, Daisuke Wakatsuki, Jianwei Zhang, Takeaki Shionome, Hiroyuki Kitagawa, Atsuyuki Morishima
Capturing Ambiguity in Crowdsourcing Frame Disambiguation Anca Dumitrache, Lora Aroyo, Chris Welty
12pm-12:30pm Poster Madness
12:30pm-2:00pm Lunch break (attendees on their own)

Session 3: Crowd Behavior

Chair: Alex Quinn (Purdue)
Striving to Earn More: A Survey of Work Strategies and Tool Use Among Crowd Workers Toni Kaplan, Susumu Saito, Kotaro Hara, Jeffrey P. Bigham
How do Crowdworker Communities and Microtask Markets Influence Each Other? A Data-Driven Study on Amazon Mechanical Turk Jie Yang, Carlo van der Valk, Tobias Hoßfeld, Judith Redi, Alessandro Bozzon
Towards Quantifying Behaviour in Social Crowdsourcing Communities Khobaib Zaamout, Ken Barker
Social Cues, Social Biases: Stereotypes in Annotations on People Images Jahna Otterbacher
3:20pm-3:50pm Coffee break
3:50pm-5pm Panel on Ethics in Human Computation and Crowdsourcing
5pm-8pm Poster / Demo Session
Location: Lichtof Sud (Foyer), KOL Building, The University of Zurich

Saturday, July 7, 2018

Joint day with Collective Intelligence 2018!
Sessions location: KOL-F-118

9am-10am HCOMP-18 / CI 2018 Joint Keynote Address: Digital Humanitarians: How You Can Make a Difference during the Next Disaster
Patrick Meier (WeRobotics)
Introduction by Gabriella Kazai
Location: KOL-G-201
10am-10:30am Coffee break

Session 4: Quality Assurance in Crowdsourcing

Chair: Edith Law (University of Waterloo)
All That Glitters Is Gold—An Attack Scheme on Gold Questions in Crowdsourcing
Best Paper
Alessandro Checco, Jo Bates, Gianluca Demartini
Your Behavior Signals Your Reliability: Modeling Crowd Behavioral Traces to Ensure Quality Relevance Annotations Tanya Goyal, Tyler McDonnell, Mucahid Kutlu, Tamer Elsayed, Matthew Lease
Permutation-Invariant Consensus over Crowdsourced Labels Michael Giancola, Randy Paffenroth, Jacob Whitehill
WingIt: Efficient Refinement of Unclear Task Instructions V. K. Chaithanya Manam, Alexander J. Quinn
Plexiglass: Multiplexing Passive and Active Tasks for More Efficient Crowdsourcing Akshay Rao, Harmanpreet Kaur, Walter S. Lasecki
An Empirical Study on Short- and Long-Term Effects of Self-Correction in Crowdsourced Microtasks Masaki Kobayashi, Hiromi Morita, Masaki Matsubara, Nobuyuki Shimizu, Atsuyuki Morishima
12:30pm-2pm Lunch break (Joint HCOMP-18 / CI-18 hosted lunch)
2pm-3pm HCOMP-18 / CI 2018 Joint Keynote Address: Optimizing the Human-Machine Partnership with Zooniverse
Lucy Fortson (University of Minnesota)
Location: KOL-G-201
3pm-3:30pm Coffee break

Session 5: Applications

Chair: Chris Welty (Google)
Crowdsourcing Real-Time Viral Disease and Pest Information: A Case of Nation-Wide Cassava Disease Surveillance in a Developing Country Daniel Mutembesa, Christopher Omongo, Ernest Mwebaze
Verifying Conceptual Domain Models with Human Computation: A Case Study in Software Engineering Marta Sabou, Dietmar Winkler, Peter Penzerstadler, Stefan Biffl
Visual Question Answer Diversity Chun-Ju Yang, Kristen Grauman, Danna Gurari
The Role of Novelty in Securing Investors for Equity Crowdfunding Campaigns Emoke-Ágnes Horvát, Johannes Wachs, Rong Wang, Anikó Hannák
Utilizing Crowdsourced Asynchronous Chat for Efficient Collection of Dialogue Dataset Kazushi Ikeda, Keiichiro Hoashi
5:10pm-5:20pm Break
5:20pm-6:20pm HCOMP-18 Town Hall Meeting
7pm-11pm HCOMP-18 / CI 2018 Joint Banquet
Location: Restaurant Commihalle
Stampfenbachstrasse 8, 8001 Zürich
A directional flyer to the reception site is available in onsite registration.

Sunday, July 8, 2018