Call for Submissions

 

OVERVIEW

HCOMP is the home of the human computation and crowdsourcing community. It is the premier venue for presenting latest findings from research and practice into frameworks, methods and systems that bring together people and machine intelligence to achieve better results.

While artificial intelligence (AI) and human-computer interaction (HCI) represent traditional mainstays of the conference, HCOMP believes strongly in fostering and promoting broad, interdisciplinary research. Our field is particularly unique in the diversity of disciplines it draws upon and contributes to, including human-centered qualitative studies and HCI design, social computing, artificial intelligence, economics, computational social science, digital humanities, policy, and ethics. We promote the exchange of advances in human computation and crowdsourcing not only among researchers, but also engineers and practitioners, to encourage dialogue across disciplines and communities of practice.

Submissions may cover theory, studies, tools and applications that present novel, interesting, impactful interactions between people and computational systems. These cover a broad range of scenarios, from classical human computation, wisdom of the crowds, and all forms of crowdsourcing to people-centric AI methods, systems and applications.

Topics of interest include:

CALL FOR FULL PAPERS

 

Important Dates

All times are midnight AoE

Submission

Authors are invited to submit papers of up to 10 pages, plus any number of additional pages containing references only.

All submitted papers must represent original work, not previously published or under simultaneous peer-review for any other peer-reviewed, archival conference or journal.

Papers must be formatted in AAAI two-column, camera-ready style; please refer to the AAAI 2021 Author Kit for details. The AAAI copyright block is not required on submissions, but must be included on final accepted versions.

Electronic abstract and paper submission through the HCOMP-21 EasyChair paper submission site is required on or before the deadlines listed above. We cannot accept submissions by e-mail or fax. Authors will receive confirmation of receipt of their abstracts or papers, including an ID number, shortly after submission. HCOMP will contact authors again only if problems are encountered with papers. Inquiries regarding paper receipt must be made no later than July 9, 2021.

All papers must be anonymized (include no information identifying the authors or their institutions) for double-blind peer-review. To ensure fairness, authors should declare any conflicts-of-interest with PC members by selecting the “Declare Conflicts” link on the upper-right of your EasyChair submission page.

Authors are invited, but not required, to include supplemental materials such as executables and data files so that reviewers can reproduce results in the paper, images, additional videos, related papers, more detailed explanations, derivations, or results. These materials will be viewed only at the discretion of the reviewers, who are only obligated to read your paper itself.

Journal collaboration

HCOMP 2021 has a collaboration this year with the open-access journal Frontiers in AI. Frontiers will publish a special issue on Human-Centered AI and Crowd Computing, focusing on topics aligned with HCOMP. Papers accepted to HCOMP 2021 will have a streamlined process for publication in the journal (e.g., maintaining the same reviewers when possible) if authors decide to submit extended versions of their papers to Frontiers. Frontiers will waive publication fees for the HCOMP best paper award winners.

Reviews

Each paper will be reviewed by at least two members of the program committee and one AC. Reviewers will be instructed to evaluate paper submissions according to specific review criteria. We encourage authors to review them before submission.

To ensure relevance, authors should consider including research questions and contributions of broad interest to crowdsourcing and human computation, as well as discuss relevant open problems and prior work in the field. When evaluation is conducted entirely within a specific domain, authors are encouraged to discuss how findings might generalize to other communities and application areas using crowdsourcing and human computation.

Publication and proceedings

To be included in the proceedings and in the conference program, at least one author must register for the main conference. The registration needs to occur by the camera-ready deadline.

Accepted full papers will be allocated ten (10) pages in the conference proceedings. Final papers found to exceed page limits and or otherwise violating the instructions to authors will not be included in the proceedings. Authors will be required to transfer copyright of their paper to AAAI. Accepted full papers will be published in the HCOMP conference proceedings and included in the AAAI Digital Library.

Accepted papers will also be listed on the conference website.

Presenting your paper

If your paper is accepted, you will be invited to present it at HCOMP 2021.

As noted earlier, at least one author of each accepted paper must register for the main conference to present the work or acceptance will be withdrawn. The deadline for that is the same as the camera-ready deadline.

Paper awards

HCOMP 2021 will recognize a best paper and two runner ups. Reviewers will be asked to flag papers they deem worthy of a prize. The general chairs will set up a small panel who will read the papers, consider the comments of the reviewers and assess the talk to determine the winners.

Paper award winners will be invited to submit extended versions of their papers to a special issue of the open-access journal Frontiers of AI, with publication fees waived.

CALL FOR BLUE SKY IDEAS

 

IMPORTANT DATES

All times are midnight EDT

SUBMISSION

In cooperation with the Computing Community Consortium (CCC), HCOMP 2021 invites submissions to a special “Blue Sky Ideas” track. The goal of this track is to present ideas and visions that can push the HCOMPcommunity into new directions. Thus, papers in this track should be open-ended and present new problems, new application domains, or new methodologies that are likely to stimulate significant new research.

Submissions will be judged on the extent to which they expand the possibilities and horizons of the field, challenge existing assumptions prevalent in the field, and/or address long term challenges and opportunities that are outside of the current mainstream topics of the field.

Submissions to this track should follow the same formatting guidelines as submissions to the research track, but are limited to at most four (4) pages in length (including references) for both submission and final publication. Accepted papers will be published in the conference proceedings and on the web, and presented at the conference as full oral presentations

To encourage researchers to present truly visionary concepts, the CCC is offering prizes for up to three top papers in this special track: first prize $1000, second prize $750, and third prize $500, to be awarded.

Note that paper submissions in this track will not receive full-fledged reviews as in the other tracks at HCOMP 2021. All submissions however will be screened to ensure that they meet the required criteria of being visionary in nature. A committee of 5-6 experts will adjudicate the top-3 accepted submissions to this track and nominate them for awards sponsored by CCC.

The submissions are managed electronically through the HCOMP-21 EasyChair paper submission site and are required on or before the deadline listed above. We cannot accept submissions by e-mail or fax. Authors will receive confirmation of receipt of their submissions, including an ID number, shortly after submission. HCOMP will contact authors again only if problems are encountered with papers.

Questions? Please contact the Blue Sky Ideas track Chairs.

CALL FOR WORKSHOPS

 

Workshop Day: November 14, 2021

(NEW) Submission Deadline: August 31, 2021

Deadline has been extended to August 31, 2021!


OVERVIEW

We invite proposals for workshops at HCOMP 2021. Workshops bring together communities with common research interests and agendas to discuss ongoing work and initiate new collaborations. Workshops may address research, best practices, tools, education, emerging themes and applications, and critical thinking about existing methodologies and frameworks. Topics should be within the general scope of HCOMP, but may include emerging research directions that have not yet been fully explored and may even be seen as controversial. Workshops may also be a forum for other types of topic-specific activities, such as tutorials or roundtables.

WORKSHOP FORMAT

Workshop format can include discussions of contributions from attendees (e.g., posters, lightning talks) as well as providing space for lively, informal debates (e.g., breakout groups, panel discussions).

Keep everyone involved! We especially encourage innovative workshop formats that keep attendees engaged throughout the workshop. As we have all learned by now, virtual events can be boring without sufficient planning. Get creative! Consider incorporating demos, feedback on innovative task designs, or short-term collaborations. What can your attendees create? … or solve?

SUBMISSION INSTRUCTIONS

If you would like to organize a workshop at HCOMP 2021, please email us by August 31 at hcompworkshops2021@gmail.com and include the following information in a PDF file, which is has maximum of four pages:

Key Dates (all times are midnight AoE)

Contact

CALL FOR WORKS-IN-PROGRESS (WiP) AND DEMONSTRATION PAPERS

 

Important Dates

Deadline has been extended to September 10, 2021!

Overview

The Works-in-Progress and Demonstration track focuses on recent findings or other types of innovative or thought-provoking work, hands-on demonstration, novel interactive technologies and experiences relevant to the HCOMP community. We encourage practitioners and researchers to submit Works-in-Progress & Demo Track as it provides a unique opportunity for sharing valuable ideas, eliciting useful feedback on early-stage work, and fostering discussions and collaborations among colleagues. Submissions are welcome from any area of computer science, artificial intelligence, and human-computer interaction, to economics and the social sciences, all the way to digital humanities, policy, and ethics.

Works-in-Progress

A Work-in-Progress is a concise report of recent findings or other types of innovative or thought-provoking work relevant to the HCOMP community. The difference between Works-in-Progress and other contribution types is that Work-in-Progress submissions represent work that has not reached a level of completion that would warrant the full Refereed selection process. That said, appropriate submissions should make some contribution to the body of HCOMP knowledge, whether realized or promised. A significant benefit of a Work-in-Progress derives from the discussion between the author and conference attendees that will be fostered by the synchronous virtual presentation of the work. Work-in-Progress submissions are in the form of a roughly 2 page paper, see Submission section.

Demonstrations

A demonstration is a high-visibility, high-impact forum of the HCOMP program that allows you to present your hands-on demonstration, share novel interactive technologies, and stage interactive experiences. Demonstrations will showcase this year’s most exciting human computation and collaborative human-AI prototypes and systems. If you have an interesting prototype, system, exhibit or installation, we want to know about it. Sharing hands-on experiences of your work is often the best way to communicate what you have created. The demonstration submission should describe the nature of the system as well as the expected form of interaction with the user and the audience. We advise preparing a demo video to address connectivity issues during the virtual demo session. Demonstrations submissions are in the form of a roughly 2 page paper, see Submission section.

Submission

Submissions must be done via the HCOMP-21 EasyChair Website under the Works-in-Progress and Demonstration track. Submissions to Easychair are required on or before the deadline listed above. We cannot accept submissions by e-mail or fax. Authors will receive confirmation of receipt of their submissions, including an ID number, shortly after submission. HCOMP will contact authors again only if problems are encountered with papers.

Length

Works-in-Progress and Demonstration papers can be up to 2 pages (references can extend beyond the 2 pages).

Formatting

Papers must be formatted in AAAI two-column, camera-ready style; please refer to the AAAI 2021 Author Kit https://www.aaai.org/Publications/Templates/AuthorKit21.zip for details. Papers must be in trouble-free, high-resolution PDF format, formatted for US Letter (8.5″ x 11″) paper, using Type 1 or TrueType fonts. The AAAI copyright block is not required for works-in-progress or demo submissions, as they are not included in the formal proceedings. Please see below for information about publication.

Supplemental Materials

Authors are invited, but not required, to include supplemental materials such as executables and data files so that reviewers can reproduce results in the paper, images, additional videos, related papers, more detailed explanations, derivations, or results. These materials will be viewed only at the discretion of the reviewers, who are only obligated to read your paper itself.

NOT Anonymized

Authors should include information identifying themselves and their institutions for single-blind review.

NOT Archival

Accepted papers will NOT be included in official conference proceedings, and so could be submitted later to other conferences or journals for official publication. Accepted papers will be made available online on the conference website.

Contacts

Please contact the Works-in-progress and Demonstration Co-Chairs if you have any questions.

CALL FOR GRADUATE CONSORTIUM

 

THE HCOMP 2021 GRADUATE CONSORTIUM (14TH NOVEMBER 2021)

Detroit Industry, North Wall fresco by Diego M. Rivera

We are proud to announce the 8th HCOMP Graduate Consortium. We invite both master’s and doctoral students in graduate programs related to crowdsourcing and human-computation to submit a research proposal by August 2nd, 2021 to be considered in the Graduate Consortium of the AAAI Conference on Human Computation and Crowdsourcing (HCOMP 2021). The consortium will take place online and you can choose to participate in two ways: (1) graduate audience; or (2) “graduate colleague”. We are honored to announce that we have received sponsorship from the A.I. Journal to fully fund HCOMP conference registration for students participating as “graduate colleagues” (you will be selected based on your abstract submissions.)

OBJECTIVE

The HCOMP’21 graduate consortium provides graduate students with the unique opportunity to share their research with crowdsourcing and human computation experts, meet other graduate students, network, and receive mentoring from both industry and academia.

PARTICIPATING IN THE HCOMP GRADUATE CONSORTIUM

If you wish to participate in the graduate consortium, complete this form: https://tinyurl.com/2ax2zjxwj. The form will ask you general information about yourself, your research, motivations for participating in the graduate consortium, and the modality in which you wish to participate (as audience or colleague). If you wish to participate as a colleague you will be expected to to complete the online form and submit a 3 page abstract (with references) about your research. If you wish to participate as an audience member you only need to complete the form.

Expectations of Audience Type Participants.

Student participating in this modality will need to:

Expectations of Colleague Type Participants.

Additionally, students participating as colleagues will receive sponsorship from the A.I. Journal to fully fund their HCOMP conference registration fees. Note that only select candidates will be able to participate as colleagues. However, if you are not selected to be a colleague you will be able to participate as an audience member.

PREPARING YOUR ABSTRACT FOR COLLEAGUE PARTICIPATION

Applicants must submit a 3 page paper with references explaining their research.

Research Explanation.

While final versions of accepted papers will be posted on the Graduate Consortium website and publicized in the HCOMP community, proceedings of the Doctoral Consortium will NOT be archived. As such, students may freely submit their research contributions for official publication in other venues.

The research explanation should include:

Format Requirements.

Submitted papers must be written in English, formatted according to AAAI Format guidelines, and submitted as a single PDF file (embedding all required fonts). The paper should be no more than 3 pages in length including all figures and references.

SUBMISSION GUIDELINES

Submit your information via this form: https://tinyurl.com/2ax2zjxw.

SELECTION CRITERIA

All graduate students are invited to participate in the call. Submissions to Colleague Participation mode will be evaluated based on the research summary that is submitted in terms of quality and merit and where the student is in their academic career. We will favor students who might benefit the most from participating in the consortium as colleagues. Students interested in participating in the consortium as audience members only need to complete their online form: https://tinyurl.com/2ax2zjxw.

IMPORTANT DATES

GRADUATE CONSORTIUM CHAIRS

Write questions or comments to: s.savage@northeastern.edu, david.sarne@gmail.com

CALL FOR CROWDCAMP

 

OVERVIEW

CrowdCamp is a one-day hack-a-thon for researchers and practitioners with interests in crowdsourcing, human computation, social media, AI, and collective intelligence. Historically, CrowdCamp’s focus for participants has been aimed at creating deliverable prototypes or study designs during the workshop. Prior CrowdCamp projects have resulted in top-tier conference publications, blog posts, and on-going research.

SUBMISSION

Call for Participation

We invite students, faculty, industry researchers, and anyone else who is interested to participate in CrowdCamp. We are looking for people with different expertise, ranging from social scientists to programmers, ethnographers to designers, and more.

To apply to participate, we ask that you complete the CrowdCamp 2021 application form. The application takes about 10 minutes to complete, and asks for:

CROWDCAMP FORMAT

The workshop day will focus on developing a research project (whether that’s a study design, an idea for a new algorithm, a system architecture, or something else entirely) within your interdisciplinary teams. Each team will also have the opportunity to get feedback on their research project from a group of experts. Our goal is to foster interdisciplinary collaborations and enable this for your particular domain of interest and research ideas.

Key Dates (all times are midnight AoE)

Contact

  • Stay CONNECTED: HCOMP COMMUNITY

We welcome everyone who is interested in crowdsourcing and human computation to:

  • Join crowd-hcomp Google Group (mailing list) to post and receive crowdsourcing and human computation email announcements (e.g., calls-for-papers, job openings, etc.) including updates here about the conference. To subscribe send an email to crowd-hcomp+subscribe@googlegroups.com.
  • Check our Google Group webpage to view the archive of past communications on the HCOMP mailing list
  • Visit the HCOMP blog where we post about new ideas for ideas related to crowd and social computing research.
  • Keep track of our twitter hashtag #HCOMP2021.
  • Join the HCOMP Slack Community to be in touch with researchers, industry players, practitioners, and crowd workers around Human Computation and relevant topics.