HCOMP-22 Schedule

   To attend sessions, please visit this Virtual Chair event link. To attend, you will first need to register for HCOMP and you will receive instructions on how to join each session. You may take a look at the welcome material to get familiar with the Virtual Chair platform.


   All times are EST (Eastern Standard Time).


Sunday, November 6, 2022

11:00am - 5:00pm EST Doctoral Consortium

Chairs: Chien-Ju Ho and Alex Williams

 Plenary Room
9:00am - 8:30pm EST CrowdCamp

Chairs: Anhong Guo and Saiph Savage

 Seminar Room

Monday, November 7, 2022

10:30am - 11:00am EST HCOMP Opening

Chairs: Jane Hsu and Ming Yin 		Plenary Room
11:00am - 12:00pm EST Keynote 1: Jenn Wortman Vaughan

Chair: Matt Lease

 Plenary Room
12:00pm - 12:30pm EST

Break

 Lobby
12:30pm - 1:30pm EST

Paper Session 1: Human-Machine Interaction and Augmentation

Chair: Chien-Ju Ho

When More Data Lead Us Astray: Active Data Acquisition in the Presence of Label Bias Yunyi Li, Maria De-Arteaga, and Maytal Saar-Tsechansky
Eliciting and Learning with Soft Labels from Every Annotator
Katherine Collins, Umang Bhatt, and Adrian Weller
Taking Advice from (Dis)Similar Machines: The Impact of Human-Machine Similarity on Machine-Assisted Decision-Making Nina Grgić-Hlača, Claude Castelluccia, and Krishna P. Gummadi
A Human-Centric Perspective on Model Monitoring
Murtuza Shergadwala, Himabindu Lakkaraju, and Krishnaram Kenthapadi
Allocation Schemes in Analytic Evaluation: Applicant-Centric Holistic or Attribute-Centric Segmented? Jingyan Wang, Carmel Baharav, Nihar Shah, Anita Woolley, and R Ravi
Plenary Room
1:30pm - 2:30pm EST Works-in-Progress and Demonstrations (Group A) Poster Room
2:30pm - 3:00pm EST Break Lobby
3:00pm - 4:00pm EST The 10th HCOMP Celebration

Seminar Room

Tuesday, November 8, 2022

10:00am - 11:00am EST Social event: Homemetherapy

Chairs: Nanyi Bi and Ujwal Gadiraju

 Seminar Room
11:00am - 12:00pm EST Keynote 2: Jeff Bigham

Chair: Jahna Otterbacher

 Plenary Room
12:00pm - 12:30pm EST Break Lobby
12:30pm - 1:30pm EST

Paper Session 2: Understanding and Supporting the Crowd

Chair: Atsuyuki Morishima

Gesticulate for Health's Sake! Understanding the Trade-offs of Gestures As An Input Modality for Microtask Crowdsourcing Garrett Allen, Andrea Hu, and Ujwal Gadiraju
SignUpCrowd: Using Sign-Language as an Input Modality for Microtask Crowdsourcing Aayush Singh, Sebastian Wehkamp, and Ujwal Gadiraju
Performance of Paid and Volunteer Image Labeling in Citizen Science — A Retrospective Analysis Kutub Gandhi, Sofia Eleni Spatharioti, Scott Eustis, Sara Wylie, and Seth Cooper
TaskLint: Automated Detection of Ambiguities in Task Instructions V. K. Chaithanya Manam, Joseph Thomas, and Alexander J. Quinn
Goal-setting Behavior of Workers on Crowdsourcing Platforms: An Exploratory Study on MTurk and Prolific Tahir Abbas and Ujwal Gadiraju
Plenary Room
1:30pm - 2:30pm EST Works-in-Progress and Demonstrations (Group B) Poster Room
2:30pm - 3:00pm EST Break Lobby
3:00pm - 4:00pm EST Social event: Homemetherapy

Chairs: Nanyi Bi and Ujwal Gadiraju

 Seminar Room

Wednesday, November 9, 2022

11:00am - 12:00pm EST Keynote 3: Seth Cooper

Chair: Saiph Savage

 Plenary Room
12:00pm - 12:30pm EST Break Lobby
12:30pm - 1:30pm EST

Paper Session 3: Novel Applications of Human Computation

Chair: Jie Yang

Identifying Possible Winners in Ranked Choice Voting Elections with Outstanding Ballots
Alborz Jelvani and Amelie Marian
Crowdsourcing Perceptions of Gerrymandering Benjamin Kelly, Inwon Kang, and Lirong Xia
Comparing Experts and Novices for AI Data Work: Insights on Allocating Human Intelligence to Design a Conversational Agent Lu Sun, Yuhan Liu, Grace Joseph, Zhou Yu, Haiyi Zhu, and Steven P. Dow
Strategyproofing Peer Assessment via Partitioning: The Price in Terms of Evaluators' Expertise Komal Dhull, Steven Jecmen, Pravesh Kothari, and Nihar Shah
Near-Optimal Reviewer Splitting in Two-Phase Paper Reviewing and Conference Experiment Design Steven Jecmen, Hanrui Zhang, Ryan Liu, Fei Fang, Vincent Conitzer, and Nihar Shah
Plenary Room
1:30pm - 2:30pm EST Works-in-Progress and Demonstrations (Group A) Poster Room
2:30pm - 3:00pm EST Break Lobby
3:00pm - 4:00pm EST Social event: Pub Quiz

Chairs: Nanyi Bi and Ujwal Gadiraju

 Seminar Room

Thursday, November 10, 2022

11:00am - 12:00pm EST Panel: Crowdsourcing and Responsible AI

Moderator: Sarah Luger

Panelists: Lora Aroyo, Krzysztof Gajos, Ece Kamar, Adrian Weller

Plenary Room
12:00pm - 12:30pm EST Break Lobby
12:30pm - 1:30pm EST

Paper Session 4: Creating and Evaluating Explanations with the Crowd

Chair: Kenneth Huang

HSI: Human Saliency Imitator for Benchmarking Saliency-based Model Explanations Yi Yang, Yueyuan Zheng, Didan Deng, Jindi Zhang, Yongxiang Huang, Yumeng Yang, Janet H. Hsiao, and Caleb Chen Cao
It is Like Finding a Polar Bear in the Savannah! Concept-level AI Explanations with Analogical Inference from Commonsense Knowledge Gaole He, Agathe Balayn, Stefan Buijsman, Jie Yang, and Ujwal Gadiraju
Connecting Algorithmic Research and Usage Contexts: A Perspective of Contextualized Evaluation for Explainable AI Q. Vera Liao, Yunfeng Zhang, Ronny Luss, Finale Doshi-Velez, and Amit Dhurandhar
CHIME: Causal Human-In-the-Loop Model Explanations Shreyan Biswas, Lorenzo Corti, Stefan Buijsman, and Jie Yang
"If it didn't happen, why would I change my decision?": How Judges Respond to Counterfactual Explanations for the Public Safety Assessment Yaniv Yacoby, Ben Green, Christopher L. Griffin Jr., and Finale Doshi-Velez
Plenary Room
1:30pm - 2:30pm EST Works-in-Progress and Demonstrations (Group B) Poster Room
2:30pm - 3:00pm EST Awards Plenary Room
3:00pm - 4:00pm EST

Townhall

Chairs: Jane Hsu and Ming Yin

Plenary Room
4:00pm - 4:30pm EST HCOMP Closing

Chairs: Jane Hsu and Ming Yin 		Plenary Room

  • Stay CONNECTED: HCOMP COMMUNITY

We welcome everyone who is interested in crowdsourcing and human computation to:

  • Join crowd-hcomp Google Group (mailing list) to post and receive crowdsourcing and human computation email announcements (e.g., calls-for-papers, job openings, etc.) including updates here about the conference. To subscribe send an email to crowd-hcomp+subscribe@googlegroups.com.
  • Check our Google Group webpage to view the archive of past communications on the HCOMP mailing list.
  • Keep track of our twitter hashtag #HCOMP2024.
  • Join the HCOMP Slack Community to be in touch with researchers, industry players, practitioners, and crowd workers around Human Computation and relevant topics.