The Seventh AAAI Conference on Human Computation and Crowdsourcing
Oct 28–30, 2019 Skamania Lodge, Stevenson, Washington, USA
The 7th AAAI Conference on Human Computation and Crowdsourcing (HCOMP 2019) will be held Oct 28–30 at Skamania Lodge in Washington State near the Columbia Gorge River, just 45 minutes from Portland, Oregon. This year is the 10-year anniversary of the very first HCOMP workshop in Paris, and to celebrate, there will be special events, talks, and panels throughout the conference.
HCOMP is the premier venue for disseminating the latest research findings on human computation and crowdsourcing. While artificial intelligence (AI) and human-computer interaction (HCI) represent traditional mainstays of the conference, HCOMP believes strongly in inviting, fostering, and promoting broad, interdisciplinary research. The field is particularly unique in the diversity of disciplines it draws upon and contributes to, ranging from human-centered qualitative studies and HCI design, to computer science and artificial intelligence, to economics and the social sciences, all the way to digital humanities, policy, and ethics. We promote the exchange of advances in human computation and crowdsourcing not only among researchers, but also engineers and practitioners, to encourage dialogue across disciplines and communities of practice. Submissions may present principles, studies, and/or applications of systems that rely on programmatic interaction with individual people or crowds, or where human perception, knowledge, reasoning, or physical activity and coordination contributes to the operation of computational systems, applications, or services.
This year, we especially encourage work that generate new insights into the “human computation” side of HCOMP, such as new understandings about human cognition, human-in-the-loop intelligence systems, human-AI interaction and collaboration, algorithmic and interface techniques for augmenting human abilities to perform tasks, and other issues that affect how humans collaborate with AI systems (such as bias, fairness, and interpretability).
Topics of interest include:
Crowdsourcing applications and techniques, including but not limited to: citizen science, collective action, collective knowledge, crowdsourcing contests, crowd creativity, crowd funding, crowd ideation, crowd sensing, crowdsourcing in computer vision, crowdsourcing in health, disaster response and relief, fact verification, gaming and gamification, incentives in crowdsourcing, knowledge bases, microtasks, prediction markets, wisdom of crowds
Techniques that enable and enhance human-in-the-loop systems, making them more efficient, accurate, and human-friendly
Studies that inform our understanding about the future of work, distributed work, the freelancer economy, and open innovation
User studies about how people perform tasks individually, in groups, or as a crowd, including those drawing on techniques from human-computer interaction, social computing, computer-supported cooperative work, design, cognitive and behavioral sciences (psychology and sociology), economics, etc.
Topics at the intersection of HCI and AI, including human-AI interaction, human-AI collaboration, AI interpretability, explainable AI, etc.
Fairness, accountability, transparency, ethics, and policy implications for crowdsourcing and human computation
Edith Law, University of Waterloo
Jennifer Wortman Vaughan, Microsoft Research
Authors are invited to submit papers of up to 8 pages, plus any number of additional pages containing references only. Please see “Publication” below for number of allowed pages in the final proceedings.
All submitted papers must represent original work, not previously published or under simultaneous peer-review for any other peer-reviewed, archival conference or journal.
Papers must be formatted in AAAI two-column, camera-ready style; please refer to the AAAI 2019 Author Kit for details. Papers must be in trouble-free, high-resolution PDF format, formatted for US Letter (8.5″ x 11″) paper, using Type 1 or TrueType fonts. The AAAI copyright block is not required on submissions, but must be included on final accepted versions.
Electronic abstract and paper submission through the HCOMP-19 EasyChair paper submission site is required on or before the deadlines listed above. We cannot accept submissions by e-mail or fax. Authors will receive confirmation of receipt of their abstracts or papers, including an ID number, shortly after submission. HCOMP will contact authors again only if problems are encountered with papers. Inquiries regarding paper receipt must be made no later than June 12, 2019.
All papers must be anonymized (include no information identifying the authors or their institutions) for double-blind peer-review.
Authors are invited, but not required, to include supplemental materials such as executables and data files so that reviewers can reproduce results in the paper, images, additional videos, related papers, more detailed explanations, derivations, or results. These materials will be viewed only at the discretion of the reviewers, who are only obligated to read your paper itself.
At least one author of each accepted paper must register for the conference to present the work or acceptance will be withdrawn.
Accepted full papers will be allocated eight (8) pages in the conference proceedings; up to two (2) additional pages may be used at a cost to the authors of $275 per page. Final papers found to exceed page limits and or otherwise violating the instructions to authors will not be included in the proceedings. Authors will be required to transfer copyright of their paper to AAAI. Accepted full papers will be published in the HCOMP conference proceedings and included in the AAAI Digital Library.
HCOMP workshops are a gathering place for people interested in human computation or crowdsourcing to meet in the context of a focused and interactive discussion. They are an opportunity to move the field forward and build community. Workshops might address basic or applied research, human computation or crowdsourcing in industry, new methodologies, emerging application areas, or other topics of interest. Workshop schedules should encourage lively debates and discussion. Each workshop should generate ideas that will give the HCOMP community a fresh way of thinking about the topic or that suggest promising directions for future work.
If you would like to organize a workshop, please reach out to hcompconference@gmail.com by June 19 with a description of your proposed topic, intended audience, list of potential speakers, and a one-day or half-day schedule, including some time for contributed talks. Workshops are expected to be inclusive, and priority will be given to workshops that include a diversity of speakers, organizers, and viewpoints. Selected workshops will be held on October 28, the day before the main conference begins.
Works-in-Progress. We encourage practitioners and researchers to submit Works-in-Progress as it provides a unique opportunity for sharing valuable ideas, eliciting useful feedback on early-stage work, and fostering discussions and collaborations among colleagues. Accepted submissions will be presented as a poster at the conference. A Work-in-Progress is a concise report of recent findings or other types of innovative or thought-provoking work relevant to the HCOMP community. The difference between Works-in-Progress and other contribution types is that Work-in-Progress submissions represent work that has not reached a level of completion that would warrant the full Refereed selection process. That said, appropriate submissions should make some contribution to the body of HCOMP knowledge, whether realized or promised. A significant benefit of a Work-in-Progress derives from the discussion between the author and conference attendees that will be fostered by the face-to-face presentation of the work. Each WIP poster will be provided a poster board and pushpins to hang your poster. Details about the available poster facilities will be provided in due time. Make sure to print your poster ahead of time according to these dimensions.
Demonstrations. A demonstration is a high-visibility, high-impact forum of the HCOMP program that allows you to present your hands-on demonstration, share novel interactive technologies, and stage interactive experiences. We encourage submissions from any area of human computation and crowdsourcing, human-AI collaboration and interaction, and human-in-the-loop intelligent systems. Demos promote and provoke discussion of the role of technology, and invites contributions from industry, research, the arts and design. Demonstrations will showcase this year’s most exciting human computation and collaborative human-AI prototypes and systems. If you have an interesting prototype, system, exhibit or installation, we want to know about it. Sharing hands-on experiences of your work is often the best way to communicate what you have created. The demonstration submission should describe the nature of the system as well as the expected form of interaction with the user and the audience. If you have special infrastructure requirements for the demonstration, please include them in a dedicated paragraph within the submission.
Previously unpublished. All submitted Works-in-Progress papers must represent original work, not previously published or under simultaneous peer-review for any other peer-reviewed, archival conference or journal.
Length. Works-in-Progress & Demonstration papers can be up to 2 pages (references can extend beyond the 2 pages).
Formatting. Papers must be formatted in AAAI two-column, camera-ready style; please refer to the AAAI 2019 Author Kit for details. Papers must be in trouble-free, high-resolution PDF format, formatted for US Letter (8.5″ x 11″) paper, using Type 1 or TrueType fonts. The AAAI copyright block is not required for works-in-progress or demo submissions, as they are not included in the formal proceedings. Please see below for information about publication.
Electronic submission through the HCOMP-19 EasyChair paper submission site is required on or before the deadline listed above. We cannot accept submissions by e-mail or fax. Authors will receive confirmation of receipt of their submissions, including an ID number, shortly after submission. HCOMP will contact authors again only if problems are encountered with papers. Inquiries regarding paper receipt must be made no later than August 12, 2019.
Supplemental Materials. Authors are invited, but not required, to include supplemental materials such as executables and data files so that reviewers can reproduce results in the paper, images, additional videos, related papers, more detailed explanations, derivations, or results. These materials will be viewed only at the discretion of the reviewers, who are only obligated to read your paper itself.
NOT Anonymized. Authors should include information identifying themselves and their institutions for single-blind review.
NOT Archival. Accepted papers will NOT be included in official conference proceedings, and so may be submitted later to other conferences or journals for official publication. Accepted papers will be made available online on the conference website.
Questions? Please contact the Works-in-progress and Demonstration Co-Chairs.
HCOMP’s annual Doctoral Consortium provides doctoral students with a unique opportunity to meet each other and experienced researchers in the field. Students will be mentored by a group of faculty who are leaders in the diverse specialties that make up the HCOMP field. The objectives of the Doctoral Consortium are to provide students with an opportunity:
Areas of Interest: HCOMP is unique in the diversity of disciplines it draws upon, and contributes to, ranging from computer science, artificial intelligence, and human-computer interaction, to economics and the social sciences, all the way to digital humanities, policy, and ethics. This year, we especially encourage work that generate new insights into the “human computation” side of HCOMP, such as new understandings about human cognition, human-in-the-loop intelligence systems, human-AI interaction and collaboration, algorithmic and interface techniques for augmenting human abilities to perform tasks, and other issues that affect how humans collaborate with AI systems (such as bias, fairness, and interpretability).
Eligibility: Applicants must be currently enrolled in a full-time PhD program and have written, or be close to completing, a thesis proposal (or equivalent). We will give preference to students who have proposed or are about to propose but are far enough from completing their thesis that the feedback they receive at the event can impact their work. Before submitting, students should discuss this criterion with their advisor or supervisor.
Attendance: Those accepted are required to attend the DC in person. Participants will also likely be required to present a poster on their work during the poster session at the main conference.
Selection: Submissions will be reviewed by a Program Committee of Doctoral Committee Mentors, with selection based upon the expected potential of both the student and their proposed work, as well as the expected benefit to the student from participation. Priority will be given to students whose research goes beyond locally available expertise at their home institutions.
Financial support: We have been able to support most expenses associated with attendance (airfare, accommodation, full registration, and meals at the DC) thanks to generous funding from the Artificial Intelligence Journal (AIJ).
Applications: Applicants must submit a solely-authored paper in English containing: 1) a Doctoral Research Overview; and 2) a Supplemental Paragraph.
Doctoral Research Overview. Please summarize your doctoral research, including the following sections:
Supplemental Paragraph. Please write a paragraph explaining:
Length and Organization. Your paper should be no more than 4 pages in total: 3 pages for the Doctoral Research Overview (including all figures and references), and the 4th page being the Supplemental Paragraph. The first page must contain the title of the paper, full author name, affiliation and contact details, an abstract of up to 250 words, and up to 3 keywords describing the research topic areas.
Formatting. Papers must be formatted in AAAI two-column, camera-ready style; please refer to the AAAI 2019 Author Kit for details. Papers must be in trouble-free, high-resolution PDF format, formatted for US Letter (8.5″ x 11″) paper, using Type 1 or TrueType fonts. It is the responsibility of the student to ensure that their submission uses no unusual formatting and is printable on a standard printer. The AAAI copyright block is not required for works-in-progress or demo submissions, as they are not included in the formal proceedings. Please see below for information regarding dissemination.
Electronic submission through the HCOMP-19 EasyChair paper submission site is required on or before the deadline listed above. We cannot accept submissions by e-mail or fax. Authors will receive confirmation of receipt of their submissions, including an ID number, shortly after submission. HCOMP will contact authors again only if problems are encountered with papers.
Dissemination: Submissions will be distributed only to mentors and other attendees of the doctoral consortium. Proceedings of the Doctoral Consortium will NOT be archived. As such, students may freely submit their research contributions for official publication in other venues. Participant names and university affiliations, as well as paper titles and abstracts, will be publicized on the conference website and in the conference program for the poster session.
Questions? Please contact the Doctoral Consortium Chairs.
We welcome everyone who is interested in crowdsourcing and human computation to: