• Important Dates

  • Conference Location

HCOMP 2023 will be held this year in Delft, the Netherlands. The Faculty of Industrial Design Engineering (IDE) at TU Delft, and the city of Delft, hope to return to in-person engagements by organising a physical HCOMP 2023.

  • Conference Registration

Please visit the registration webpage for more information.

  • Doctoral Consortium

Please visit the Doctoral Consortium section for more information.

  • CrowdCamp

Please visit the Crowdcamp section for more information.

  • Accommodation

There will not be hotels affiliated with the conference - not yet at least. However, you can see a list of hotels below.

Hotel de Plataan Delft
Doelenplein 10, 2611 BP Delft, NL

Best Western | Museumhotels Delft
Phoenixstraat 50A, 2611 AM Delft, NL

WestCord Hotels at Delft
Multiple locations at Delft, NL

Delft Centre | Hampshire Hotels
Koepoortplaats 3, 2612 RR Delft, NL

Hotel De Koophandel Delft
Beestenmarkt 30, 2611 GC Delft, NL

Casa Julia | Fine Hotels
Maerten Trompstraat 33, 2628 RC Delft, NL

  • Workshops

Connecting Tools and Platforms for Human Computation and Crowdsourcing (HCOMP-Connect)

Chairs: Philippe Cudré-Mauroux, University of Fribourg Atsuyuki Morishima, University of Tsukuba


Overview: Since the advent of human computation and crowdsourcing, many tools and platforms have been developed in academia and industry. However, the lack of interconnectivity among them has hindered their full potential. Achieving interoperability would allow our community to provide the infrastructure for human-in-the-loop problem solving on a global scale. In this workshop, we invite people involved in these tools and platforms from both industry and academia to discuss potential ways to improve their interoperability. Our goal is to set a clear road map toward that goal and provide a draft that can serve as a first concrete step.

Responsibly Working with Crowdsourced Data

Chairs: Mark Díaz, Andrew Zaldivar, Rachel Rosen, Remi Denton, Vinodkumar Prabhakaran


Overview: Crowdsourced datasets are commonly used to develop a range of machine learning tools, such as hate speech classifiers and object detection systems. At the same time, scholars have pointed out a range of related ethical concerns, ranging from the conditions in which raters work and data is collected to the role of social experiences in shaping raters’ data judgments. One result of this work is a set of recent frameworks designed to guide data collection and bring increased transparency to crowdsourced dataset development. This half-day workshop will discuss data annotation and crowdsourcing for a variety of goals– including training dataset development, benchmark development, and model finetuning. A panel will kick off a discussion of ethical issues underlying the development and use of crowdsourced datasets and a breakout activity will guide participants in 1) unpacking crowdsourcing tensions in their own domain, 2) identifying the strengths of different dataset development frameworks in addressing these tensions, and 3) identifying tensions that remain to be addressed.

pHAI - prototyping Human-AI interactions

Chairs: Kostas Tsiakas, Mahan Mehrvarz, Dave Murray-Rust


Overview: This half-day tutorial/workshop aims to bring together designers, engineers, and practitioners to explore ways to support the prototyping of interactions between human users and AI/ML models. Through a combination of paper and screen based activities and tools, we will present our modeling approach for designing Human-AI interactions and guide participants in creating their own interactions. Participants will have the chance to present their own use cases and scenarios, and receive feedback, through the group activities and discussions. The goal of this workshop is to get insights towards bridging the gap between engineering and design practices while developing and deploying human-AI interaction systems.

Human and machine annotation of argumentative discourse

Chairs: Dean McHugh, Federica Russo, Jean Wagemans


Overview: Computational argumentation is a rapidly growing field of research at the crossroads of argumentation theory, formal semantics, and computational linguistics. Within this field, there is a pressing need for having available larger corpora of annotated argumentative discourse. The general aim of this workshop is to address this need by exploring ways of combining human and machine annotation of argumentative discourse.
The workshop will take place on Monday 6 November 2023 at Delft University of Technology. It will consist of two parts: (1) presentations and a panel discussion about state-of-the-art methods, frameworks and tools for annotating argumentative discourse and the availability of annotated corpora of argumentative discourse; (2) discussion of research plans and exploration of collaboration between researchers with relevant expertise on argumentation theory, formal semantics, computational argumentation, and corpus linguistics.

wikiKI: Knowledge Integrity in Wikipedia and collaborative projects

Chairs: Cristian Consonni and Julián Vicens


Overview: Wikipedia has been described as "the last best place on the internet" to keep alive the ideals of collaboration of the early web. Its self-correcting mechanisms, lack of advertising, and open nature have earned it the public trust, rivaling even well-established sources. However, several dangers threaten Wikipedia and require constant work from its community: misinformation and fake news broadcasted by reputable sources, undisclosed paid editing, and coordinated efforts to introduce bias in articles all pose significant challenges to the integrity of the project. Recent developments, such as Large Language models and AI image generation, have sparked the community to enact policies to prevent the generation of potentially misleading content. This workshop explores all aspects of knowledge integrity in Wikipedia and other online collaborative projects. Topics of interest include misinformation, disinformation, and manipulation of information, including detection methods and strategies for combating them. Additionally, the workshop will address issues like trust, reputation, handling controversies, fostering a healthy community environment, and identifying destructive or toxic behavior. Furthermore, the significance of cybersecurity in tackling these issues is integral to the workshop's agenda. wikiKI will bring together scientists studying the socio-technical and collaborative aspects of Wikipedia and other online collaborative projects, providing a forum for academics, practitioners, and community members to discuss the problem of knowledge integrity on online collaborative projects from a socio-technical perspective.

  • Scholarships Application

Please complete this form to apply for a student scholarship to HCOMP/CI 2023 at Delft University of Technology November 6-10th, 2023!
Eligibility: You must be a student to be eligible for this scholarship. You do not need to have an accepted paper or poster to be eligible.

Applications are due: Sept 10, 2023
Scholarships announced: Sept 20, 2023

*Please note*: If you are a PhD student, your advisor must send a letter of support to the HCOMP/CI scholarship email directly ( before the application deadline.
Questions? Email the scholarships chairs:


We welcome everyone who is interested in crowdsourcing and human computation to:

  • Join crowd-hcomp Google Group (mailing list) to post and receive crowdsourcing and human computation email announcements (e.g., calls-for-papers, job openings, etc.) including updates here about the conference. To subscribe send an email to
  • Check our Google Group webpage to view the archive of past communications on the HCOMP mailing list.
  • Visit the HCOMP blog where we post about new ideas for ideas related to crowd and social computing research.
  • Keep track of our twitter hashtag #HCOMP2024.
  • Join the HCOMP Slack Community to be in touch with researchers, industry players, practitioners, and crowd workers around Human Computation and relevant topics.