Call for Submissions

 

OVERVIEW

HCOMP is the home of the human computation and crowdsourcing community. It is the premier venue for presenting the latest findings from research and practice into frameworks, methods, and systems that bring together people and machine intelligence to achieve better results.

While artificial intelligence (AI) and human-computer interaction (HCI) represent traditional mainstays of the conference, HCOMP believes strongly in fostering and promoting broad, interdisciplinary research. Our field is particularly unique in the diversity of disciplines it draws upon and contributes to, including human-centered qualitative studies and HCI design, social computing, artificial intelligence, economics, computational social science, digital humanities, policy, and ethics. We promote the exchange of advances in human computation and crowdsourcing not only among researchers but also engineers and practitioners, to encourage dialogue across disciplines and communities of practice.

Submissions may cover theory, studies, tools, and applications that present novel, interesting, impactful interactions between people and computational systems. These cover a broad range of scenarios, from classical human computation, wisdom of the crowds, and all forms of crowdsourcing to people-centric AI methods, systems, and applications.

This year, we especially encourage work that generates new insights into the connections between human computation and crowdsourcing, and humanity. For example, how to support the well-being and welfare of participants of human-in-the-loop systems? How to promote diversity and inclusion of the crowd workforce? How can crowdsourcing be used for social good, e.g., to address societal challenges and improve people’s lives? How can human computation and crowdsourcing studies advance the design of trustworthy, ethical, and responsible AI? How can crowd science inform the development of AI that extends human capabilities and augments human intelligence?

Topics of interest include:

CALL FOR FULL PAPERS

 

Important Dates

All times are midnight AoE

Submission

Authors are invited to submit papers of up to 10 pages, plus any number of additional pages containing references only.

Papers must be formatted in AAAI two-column, camera-ready style; please refer to the AAAI 2022 Author Kit for details. The AAAI copyright block is not required on submissions but must be included on final accepted versions.

Electronic abstract and paper submission through the HCOMP-22 EasyChair paper submission site is required on or before the deadlines listed above. We cannot accept submissions by e-mail or fax. Authors will receive confirmation of receipt of their abstracts or papers, including an ID number, shortly after submission. HCOMP will contact authors again only if problems are encountered with papers. Inquiries regarding paper receipts must be made no later than July 1, 2022.

All papers must be anonymized (include no information identifying the authors or their institutions) for double-blind peer-review. To ensure fairness, authors should declare any conflicts-of-interest with PC members by selecting the “Declare Conflicts” link on the upper-right of your EasyChair submission page.

Authors are invited, but not required, to include supplemental materials such as executables and data files so that reviewers can reproduce results in the paper, images, additional videos, related papers, more detailed explanations, derivations, or results. These materials will be viewed only at the discretion of the reviewers, who are only obligated to read your paper itself.

Double Submission Policy: Papers submitted to the HCOMP conference must represent original work that has not been previously published or under simultaneous peer-review for any other peer-reviewed archival conference or journal. Specifically:

Reviews

Each paper will be reviewed by at least two members of the program committee and one AC. Reviewers will be instructed to evaluate paper submissions according to specific review criteria. We encourage authors to review them before submission.

To ensure relevance, authors should consider including research questions and contributions of broad interest to crowdsourcing and human computation, as well as discuss relevant open problems and prior work in the field. When evaluation is conducted entirely within a specific domain, authors are encouraged to discuss how findings might generalize to other communities and application areas using crowdsourcing and human computation.

Publication and proceedings

To be included in the proceedings and in the conference program, at least one author must register for the main conference. The registration needs to occur by the camera-ready deadline.

Accepted full papers will be allocated ten (10) pages in the conference proceedings. Final papers found to exceed page limits and or otherwise violating the instructions to authors will not be included in the proceedings. Authors will be required to transfer copyright of their paper to AAAI. Accepted full papers will be published in the HCOMP conference proceedings and included in the AAAI Digital Library.

Accepted papers will also be listed on the conference website.

Presenting your paper

If your paper is accepted, you will be invited to present it at HCOMP 2022.

As noted earlier, at least one author of each accepted paper must register for the main conference to present the work or acceptance will be withdrawn. The deadline for that is the same as the camera-ready deadline.

Paper awards

HCOMP 2022 will recognize one best paper and two runner-ups. Reviewers will be asked to flag papers they deem worthy of a prize. The general chairs will set up a small panel that will read the papers, consider the comments of the reviewers and assess the talk to determine the winners.

CALL FOR WORKS-IN-PROGRESS (WiP) AND DEMONSTRATION PAPERS

 

Important Dates

Overview

The Works-in-Progress and Demonstration track focuses on recent findings or other types of innovative or thought-provoking work, hands-on demonstration, novel interactive technologies and experiences relevant to the HCOMP community. We encourage practitioners and researchers to submit Works-in-Progress & Demo Track as it provides a unique opportunity for sharing valuable ideas, eliciting useful feedback on early-stage work, and fostering discussions and collaborations among colleagues. Submissions are welcome from any area of computer science, artificial intelligence, and human-computer interaction, to economics and the social sciences, all the way to digital humanities, policy, and ethics.

The accepted papers in this track will be non-archival and will not be included in the HCOMP’s official conference proceedings. The authors could further develop the idea and submit the outcome to other conferences or journals.

Works-in-Progress

A Work-in-Progress is a concise report of recent findings or other types of innovative or thought-provoking work relevant to the HCOMP community. The difference between Works-in-Progress and other contribution types is that Work-in-Progress submissions represent work that has not reached a level of completion that would warrant the full Refereed selection process. That said, appropriate submissions should make some contribution to the body of HCOMP knowledge, whether realized or promised. A significant benefit of a Work-in-Progress derives from the discussion between the author and conference attendees that will be fostered by the synchronous virtual presentation of the work. Work-in-Progress submissions are in the form of a roughly 2 page paper, see Submission section.

Demonstrations

A demonstration is a high-visibility, high-impact forum of the HCOMP program that allows you to present your hands-on demonstration, share novel interactive technologies, and stage interactive experiences. Demonstrations will showcase this year’s most exciting human computation and collaborative human-AI prototypes and systems. If you have an interesting prototype, system, exhibit or installation, we want to know about it. Sharing hands-on experiences of your work is often the best way to communicate what you have created. The demonstration submission should describe the nature of the system as well as the expected form of interaction with the user and the audience. We advise preparing a demo video to address connectivity issues during the virtual demo session. Demonstrations submissions are in the form of a roughly 2 page paper, see Submission section.

Submission

Submissions must be done via the HCOMP-22 EasyChair Website under the Works-in-Progress and Demonstration track. Submissions to Easychair are required on or before the deadline listed above. We cannot accept submissions by e-mail or fax. Authors will receive confirmation of receipt of their submissions, including an ID number, shortly after submission. HCOMP will contact authors again only if problems are encountered with papers.

Length

Works-in-Progress and Demonstration papers can be up to 2 pages (references can extend beyond the 2 pages).

Formatting

Papers must be formatted in AAAI two-column, camera-ready style; please refer to the AAAI 2022 Author Kit (https://www.aaai.org/Publications/Templates/AuthorKit22.zip) for details. Papers must be in trouble-free, high-resolution PDF format, formatted for US Letter (8.5″ x 11″) paper, using Type 1 or TrueType fonts. The AAAI copyright block is not required for works-in-progress or demo submissions, as they are not included in the formal proceedings. Please see below for information about publication.

Supplemental Materials

Authors are invited, but not required, to include supplemental materials such as executables and data files so that reviewers can reproduce results in the paper, images, additional videos, related papers, more detailed explanations, derivations, or results. These materials will be viewed only at the discretion of the reviewers, who are only obligated to read your paper itself.

NOT Anonymized

Authors should include information identifying themselves and their institutions for single-blind review.

NOT Archival

Accepted papers will NOT be included in official conference proceedings, and so could be submitted later to other conferences or journals for official publication. Accepted papers will be made available online on the conference website.

Contacts

Please contact the Works-in-progress and Demonstration Co-Chairs if you have any questions.

CALL FOR DOCTORAL CONSORTIUM

 

IMPORTANT DATES

OBJECTIVE

HCOMP’s annual Doctoral Consortium provides doctoral students with a unique opportunity to meet each other and experienced researchers in the field. Students will be mentored by a group of faculty who are leaders in the diverse specialties that make up the HCOMP field. The objectives of the Doctoral Consortium are to provide students with an opportunity:

AREAS OF INTEREST

HCOMP is unique in the diversity of disciplines it draws upon, and contributes to, ranging from computer science, artificial intelligence, and human-computer interaction, to economics and the social sciences, all the way to digital humanities, policy, and ethics. This year, we especially encourage work that generates new insights into the connections between human computation and crowdsourcing, and humanity. For example, how to support the well-being and welfare of participants of human-in-the-loop systems? How to promote diversity and inclusion of the crowd workforce? How can crowdsourcing be used for social good, e.g., to address societal challenges and improve people’s lives? How can human computation and crowdsourcing studies advance the design of trustworthy, ethical, and responsible AI? How can crowd science inform the development of AI that extends human capabilities and augments human intelligence?

ELIGIBILITY

Applicants must be currently enrolled in a full-time PhD program and have written, or be close to completing, a thesis proposal (or equivalent). We will give preference to students who have proposed or are about to propose but are far enough from completing their thesis that the feedback they receive at the event can impact their work. Before submitting, students should discuss this criterion with their advisor or supervisor.

ATTENDANCE

Those accepted are required to present their work at the Doctoral Consortium. Participants will also likely be required to present a poster on their work during the poster session at the main conference.

SELECTION

Submissions will be reviewed by a Program Committee of Doctoral Committee Mentors, with selection based upon the expected potential of both the student and their proposed work, as well as the expected benefit to the student from participation. Priority will be given to students whose research goes beyond locally available expertise at their home institutions.

FINANCIAL SUPPORT

More information about financial support coming soon.

APPLICATION

Applicants must submit a solely-authored paper in English containing: 1) a Doctoral Research Overview; and 2) a Supplemental Paragraph.

DOCTORAL RESEARCH OVERVIEW

Please summarize your doctoral research, including the following sections:

SUPPLEMENTAL PARAGRAPH

Please write a paragraph explaining:

LENGTH AND ORGANIZATION

Your paper should be no more than 4 pages in total: 3 pages for the Doctoral Research Overview (including all figures and references), and the 4th page being the Supplemental Paragraph. The first page must contain the title of the paper, full author name, affiliation and contact details, an abstract of up to 250 words, and up to 3 keywords describing the research topic areas.

FORMATTING

Papers must be formatted in AAAI two-column, camera-ready style; please refer to the AAAI 2022 Author Kit for details. Papers must be in trouble-free, high-resolution PDF format, formatted for US Letter (8.5” x 11”) paper, using Type 1 or TrueType fonts. It is the responsibility of the student to ensure that their submission uses no unusual formatting and is printable on a standard printer. The AAAI copyright block is not required for works-in-progress or demo submissions, as they are not included in the formal proceedings. Please see below for information regarding dissemination.

SUBMISSION

Electronic submission through the HCOMP-22 EasyChair (https://easychair.org/conferences/?conf=hcomp22) paper submission site is required on or before the deadline listed above. We cannot accept submissions by e-mail or fax. Authors will receive confirmation of receipt of their submissions, including an ID number, shortly after submission. HCOMP will contact authors again only if problems are encountered with papers.

DISSEMINATION

Submissions will be distributed only to mentors and other attendees of the doctoral consortium. Proceedings of the Doctoral Consortium will NOT be archived. As such, students may freely submit their research contributions for official publication in other venues. Participant names and university affiliations, as well as paper titles and abstracts, will be publicized on the conference website and in the conference program for the poster session.

DOCTORAL CONSORTIUM CHAIRS

Please feel free to direct all questions or comments to the following email addresses: acwio@amazon or chienju.ho@wustl.edu.

CALL FOR CROWDCAMP

 

Detroit Industry, North Wall fresco by Diego M. Rivera

OVERVIEW

CrowdCamp is a one-day hack-a-thon for researchers and practitioners with interests in crowdsourcing, human computation, social media, AI, and collective intelligence. This year, Crowd Camp will focus on designing social good solutions for improving crowd work.

Historically, CrowdCamp’s focus for participants has been aimed at creating deliverable prototypes or study designs during the workshop. Prior CrowdCamp projects have resulted in top-tier conference publications, blog posts, and on-going research.

SUBMISSION

Call for Participation

We invite students, faculty, industry researchers, and anyone else who is interested to participate in CrowdCamp. We are looking for people with different expertise, ranging from social scientists to programmers, ethnographers to designers, and more.

To apply to participate, we ask that you complete the CrowdCamp 2022 application form. The application takes about 10 minutes to complete, and asks for:

CROWDCAMP FORMAT

The workshop day will focus on developing a research project (whether that’s a study design, an idea for a new algorithm, a system architecture, or something else entirely) within your interdisciplinary teams. Each team will also have the opportunity to get feedback on their research project from a group of experts. Our goal is to foster interdisciplinary collaborations and enable this for your particular domain of interest and research ideas.

Key Dates (all times are midnight AoE)

Contact

  • Stay CONNECTED: HCOMP COMMUNITY

We welcome everyone who is interested in crowdsourcing and human computation to:

  • Join crowd-hcomp Google Group (mailing list) to post and receive crowdsourcing and human computation email announcements (e.g., calls-for-papers, job openings, etc.) including updates here about the conference. To subscribe send an email to crowd-hcomp+subscribe@googlegroups.com.
  • Check our Google Group webpage to view the archive of past communications on the HCOMP mailing list.
  • Keep track of our twitter hashtag #HCOMP2024.
  • Join the HCOMP Slack Community to be in touch with researchers, industry players, practitioners, and crowd workers around Human Computation and relevant topics.