This year, the Human Computation (HCOMP) and Collective Intelligence (CI) conferences are being jointly organized. We are excited about this opportunity to bring our two communities closer together, increase the visibility of work in this area, promote more multidisciplinary research, and create a diverse and engaging program. We look forward to your submissions and welcoming you to our joint conference. We hope to foster a fruitful and diverse exchange of ideas, research, and experiences across the HCOMP and CI communities.
All times are midnight AoE
We are thrilled to announce that the joint organization of CI and HCOMP will provide authors with the opportunity to access the best aspects of both conferences. With this collaboration, HCOMP will now allow authors to publish their accepted papers as extended abstracts if desired so that they can submit their work elsewhere for archival publication, while retaining a presentation at the conference. This change encourages social science researchers to participate and share their work. Meanwhile, CI will now enable authors to publish their papers archivally, thereby enhancing the conference’s academic value. We believe this collaboration will enable authors to showcase their work more effectively and contribute to advancing the fields of human computation, crowdsourcing, and computational intelligence.
To present a talk at the CI or HCOMP conference, authors must submit a full paper for review by the program committee. Accepted papers will be granted a presentation at the conference. Therefore, submitting a full paper is a mandatory requirement for authors who wish to present their work at the conference.
Extended abstract option. For some researchers and fields (e.g., social scientists or economists), it is beneficial to retain the option to publish the final paper outside of a conference venue. For other researchers, there is benefit from sharing work that was published in other venues with HCOMP-CI’s interdisciplinary audience. To support these researchers, there is an extended abstract option: publish only an extended abstract in the proceedings, should the paper be accepted. Extended abstracts still must submit a full paper for review. Electing for this extended abstraction option is a commitment to replacing the submitted full paper with a two page extended abstract at publication time. Submissions using this extended abstract option may be previously published elsewhere, or may be submitted for publication elsewhere later. Authors opting for the extended abstract option will have their papers juried rather than peer-reviewed; in other words, these articles will still be considered fully by the program committee, but authors will not receive reviews back—only a decision. Extended abstract papers will be treated like full papers in the conference schedule: they will receive a presentation slot. If the work is previously published, authors must clearly and visibly indicate the original paper and citation in their manuscript.
Forward-to-journal option. Typically, accepted conference papers will be published only in the proceedings, and if authors later want to extend or publish the work in another venue, they need to start a new review process. This year, however, we are excited to share that authors will have the opportunity to forward their papers, alongside their existing reviews and reviewers, for consideration to the ACM + SAGE Collective Intelligence journal. The journal will, at its discretion, keep or expand the existing set of reviewers for the article and consider the work for publication in the Collective Intelligence journal, accelerating the journal publication process. This option must be selected at submission time. Papers submitting under the extended abstract option will have reviewers forwarded, but since extended abstract option submissions do not receive written reviews, reviews will not be forwarded. Authors should bear in mind that, if the paper is also published archivally at the conference, the journal may ask for expanded content.
The conference is organized with one paper presentation track and two separate program subcommittees for paper submission and review. Authors may choose to submit to either the HCOMP or Collective Intelligence subcommittee. Each subcommittee reflects different areas of interest, as well as slightly different submission formats and instructions due to HCOMP being sponsored by AAAI and Collective Intelligence being sponsored by ACM.
Submit to HCOMP using Easychair here.
Topics
AAAI HCOMP publishes research on human computation and crowdsourcing. Its focus is on research and practice into frameworks, methods and systems that bring together people and machine intelligence to achieve better results.
While artificial intelligence (AI) and human-computer interaction (HCI) represent traditional mainstays of the conference, HCOMP believes strongly in fostering and promoting broad, interdisciplinary research. Our field is particularly unique in the diversity of disciplines it draws upon and contributes to, including human-centered qualitative studies and HCI design, social computing, artificial intelligence, economics, computational social science, digital humanities, policy, and ethics. We promote the exchange of advances in human computation and crowdsourcing not only among researchers, but also engineers and practitioners, to encourage dialogue across disciplines and communities of practice. Submissions may hence cover theory, studies, tools and applications that present novel, interesting, impactful interactions between people and computational systems. These cover a broad range of scenarios, from classical human computation, wisdom of the crowds, and all forms of crowdsourcing to people-centric AI methods, systems and applications.
Topics of interest include:
Format
Authors are invited to submit papers of up to 10 pages, plus any number of additional pages containing references only. Papers must be formatted in AAAI two-column, camera-ready style; please refer to the AAAI 2023 Author Kit for details. The AAAI copyright block is not required on submissions but must be included on final accepted versions. Accepted full papers will be allocated ten (10) pages in the conference proceedings. Final papers found to exceed page limits and or otherwise violating the instructions to authors will not be included in the proceedings.
Authors are invited, but not required, to include supplemental materials such as executables and data files so that reviewers can reproduce results in the paper, images, additional videos, related papers, more detailed explanations, derivations, or results. These materials will be viewed only at the discretion of the reviewers, who are only obligated to read your paper itself.
Authors will be required to transfer copyright of their paper to AAAI. Accepted full papers will be published in the HCOMP conference proceedings and included in the AAAI Digital Library.
Submit to Collective Intelligence using Easychair here.
Topics
ACM Collective Intelligence has a transdisciplinary focus devoted to advancing the theoretical and empirical understanding of collective performance in diverse systems, including human organizations, hybrid AI-human teams, computer networks, adaptive matter, cellular systems, neural circuits, animal societies, nanobot swarms, and others. Contributions may include principles that apply across scales, as well as new ways of harnessing the collective to improve social, ecological, and economic outcomes.
Collective intelligence has typically published a broad range of work across the social and behavioral sciences and computing, but also welcomes work in areas such as the natural sciences and humanities. We seek perspectives that emphasize both traditional views of intelligence as well as optimality, satisficing, robustness, adaptability, and wisdom. In more technical terms, this includes issues related to collective output quality and assessment, aggregation of information and related topics (e.g., network structure and dynamics, higher-order vs. pairwise interactions, spatial and temporal synchronization, diversity, etc.), accumulation of information by individuals or components, environmental complexity, evolutionary considerations, and design of systems and platforms fostering collective intelligence. Methods may range from behavioral, to theoretical, to engineering.
Topics of interest include:
Format
CI papers are of variable length. Paper length must be based on the weight of the contribution. A new idea presented in a compact format is more likely to be accepted than the same idea in a long format, and shorter, more focused papers are encouraged. As a guideline, please consider papers in the range of 10,000 words.
Collective Intelligence will adopt the ACM TAPS Workflow. For LaTeX authors, submissions should be made using the double-column format (example PDF) using \documentclass[sigconf,review,anonymous]{acmart}. For Word authors, submissions should be made using either the double-column format (submission template, example PDF) or the single-column template (submission template, example PDF). Please ensure that you and your co-authors obtain an ORCID ID, so you can complete the publishing process for your accepted paper. ACM has been involved in ORCID from the start and we have recently made a commitment to collect ORCID IDs from all of our published authors. The collection process has started and will roll out as a requirement throughout 2022. We are committed to improve author discoverability, ensure proper attribution and contribute to ongoing community efforts around name normalization; your ORCID ID will help in these efforts.
Authors are invited, but not required, to include supplemental materials such as executables and data files so that reviewers can reproduce results in the paper, images, additional videos, related papers, more detailed explanations, derivations, or results. These materials will be viewed only at the discretion of the reviewers, who are only obligated to read your paper itself.
By submitting your article to an ACM Publication, you are hereby acknowledging that you and your co-authors are subject to all ACM Publications Policies, including ACM’s new Publications Policy on Research Involving Human Participants and Subjects. Alleged violations of this policy or any ACM Publications Policy will be investigated by ACM and may result in a full retraction of your paper, in addition to other potential penalties, as per ACM Publications Policy.
Anonymity. All papers must be anonymized (including no information identifying the authors or their institutions) for double-blind peer review.
Preprint servers. We do not have a policy against uploading preprints to SSRN or arXiv before they are submitted for review at the conference. Nevertheless, to ensure the integrity of the peer review process, we ask that no authors publicize the work until that process is complete. Please do not share confidential info specific to a current review process on social media or in similarly public forums.
Conflicts of interest. To ensure fairness, authors should declare any conflicts of interest with PC members by selecting the “Declare Conflicts” link on the upper-right of your EasyChair submission page.
Double Submission Policy: Excepting papers submitting under the extended abstract option, all papers submitted to the conference must represent original work that has not been previously published or under simultaneous peer-review for any other peer-reviewed archival conference or journal. Specifically:
Reviews. Each full paper submission will be reviewed by at least two members of the program committee and one AC. Reviewers will be instructed to evaluate paper submissions according to specific review criteria. We encourage authors to review them before submission.
To ensure relevance, authors should consider including research questions and contributions of broad interest to crowdsourcing and human computation, as well as discuss relevant open problems and prior work in the field. When the evaluation is conducted within a specific domain, authors are encouraged to discuss how findings might generalize to other communities and application areas using crowdsourcing and human computation.
Attendance. To be included in the proceedings and the conference program, at least one author must register in person for the main conference. The registration needs to occur by the camera-ready deadline.
Presentation. If your paper is accepted, we are delighted to invite you to present your work at the conference. Please note that at least one author of each accepted paper must register for the main conference to present their work in person. Failure to do so will result in the withdrawal of acceptance. Remote presentation of accepted papers is not permitted except in the case of unforeseen circumstances. The deadline for registering to present your paper is the same as the camera-ready deadline.
Collective Intelligence and HCOMP 2023 will recognize the best paper winner and honorable mention(s). Reviewers will be asked to flag papers they deem worthy of a prize. The general chairs will set up a small panel that will read the papers, consider the reviewers’ comments and assess the talk to determine the winners.
We welcome everyone who is interested in crowdsourcing and human computation to: