[ Logo] Artificial Intelligence and Statistics 2025

[edit]

AISTATS 2025 AC Guidelines

This page provides guidelines for Area Chairs (ACs) for AISTATS 2025. The guideline has referenced previous AISTATS conferences’ practises and the AC guideline of NeurIPS 2023.

Responsibilities of an Area Chair (AC)

  1. Identify desk-rejection cases (e.g., papers with unacceptable formatting issues, dual submissions; see FAQ below)
  2. Help reviewer assignments by recruiting expert reviewers and adjusting reviewer assignments
  3. Monitor the review process and ensure reviewers are responsive
  4. Ensure the submissions have high-quality reviewers
  5. Organize reviewer discussions after author feedback
  6. Make acceptance/rejection recommendations based on reviews, author feedback, discussions, and their own understanding of the submission
  7. Recommend accepted submissions for oral talks
  8. Resolve any issue during the review process, e.g., by recruiting emergency reviewers, addressing concerns from both reviewers and authors, and/or raising concerns with Senior ACs and Program Chairs.

Important Dates

Dates may be subject to change. All deadlines are AoE timezone.

Main Tasks

Below is a list of tasks (and the detailed explanations) that an AC is expected to conduct.

  1. Registrations on OpenReview

    • Make sure your profile on OpenReview is up-to-date. Adding your conflict of interests as well as selecting your expertise topics. Import papers to your OpenReview profile.
    • Read and agree to abide by the AISTATS code of conduct.

  2. Paper bidding

    • We will assign papers to ACs and reviewers using a combination of bids and a matching algorithm supported by the TPMS paper matching system.
    • After receiving the initial assignment, quickly check the submissions and identify desk-reject and/or conflict-of-interest cases if applicable.
    • It is possible that some of the submissions in your batch might not be closely related to your expertise. As we have a large number of submissions, your flexibility is greatly appreciated. When making decisions in later stages, contact Senior AC if you need help for the submissions that are too far away from your expertise area

  3. Reviewer assignments adjustments

    • Make sure that every submission in your batch is matched with 5 suitable reviewers whom you can trust on this submission, ideally with a diverse set of opinions.
    • Do invest time for this before the reviewing process starts to ensure that your batch has expert reviewers - this will make your life much easier in reducing the number of borderline and mis-judged cases.

  4. Monitor the review process and ensure reviewers are responsive

    • Send reminders to reviewers for submitting reviews on time.
    • Recruit emergency reviewers if not having enough high-quality reviews, or having reviews with diverging opinions, 1 week before the review release date.
    • Ask reviewers to rewrite and resubmit their review if appropriate.
    • Please ensure reviewers provide their comments with evidence. E.g., if a reviewer selects “combinatorial approach” in their answer to the question regarding novelty, ensure that in the next question that reviewer has provided the corresponding references to justify this choice.

  5. Organize reviewer discussions after author feedback

    • Ensure reviewers have read the author feedback document. Ask them to update their review with e.g., a new paragraph starting “Post author feedback comments”.
    • Initiate and lead discussions between reviewers. At this point you should read both reviews and author feedback, to understand the pros and cons of the submission, as well as the major disagreements between reviewers and authors. List these points in your discussion post. If applicable, explicitly ask reviewers with e.g., very high/low scores to explain their opinions.
    • Read confidential messages from reviewers and authors. If applicable, contact the corresponding reviewers to address authors’ concerns (without revealing the authors’ confidential comments).

  6. Decision making and meta-review

    • Be on time in writing your meta-review and making decisions – we have a tight schedule regarding final decisions!
    • You should write the meta reviews based on your reading of the paper, the reviews, the author feedback, and the reviewer discussions. Keep in mind that the meta-review needs to provide a convincing justification about your decision (especially in rejection cases).
    • The meta-review should augment the reviews, and explain how the reviews, the author response, and the discussions were used to arrive at your recommendation. Do not dismiss or ignore a review or author feedback unless you have a good reason for doing so; in such case you should also explain this in your meta review.
    • If uncertain about your decision, reach out to your SAC as early as you can. For papers where the reviewers cannot come to a consensus, you should read the paper carefully and write a detailed meta-review. You are expected to discuss such difficult cases with your SAC.
    • For submissions with rejection decisions, you are encouraged to also provide comments regarding potential ways to improve the paper.

Best Practices

Writing the meta-review

Adapted from NeurIPS 2025 AC guidelines. Original source: Chris Williams and John Lafferty.

For more tips for area chairs of ML conferences, have a look at this blog post.

LLM Policy

The use of LLMs is not allowed to write papers, reviews, and meta-reviews. They can be used as an assist tool, for example, to check grammatical issues. Ultimately, you are responsible for the text you write, including content generated by LLMs that could be construed as plagiarism or scientific misconduct (e.g., fabrication of facts). Similar to other ML venues, at AISTATS too, LLMs are not eligible for authorship.

Confidentiality

You must keep everything relating to the review process confidential. Do not use ideas, code and results from submissions in your own work until they become publicly available (e.g., via a technical report or a published paper for ideas/results, via open source for code, etc.). Do not talk about or distribute submissions (whether it is the code, or the ideas and results described in them) to anyone without prior approval from the program chairs. Code submitted for reviewing cannot be distributed. DO NOT talk to other ACs and/or SACs about submissions that are assigned to you unless you have a justified reason to do so, in such case before contacting other ACs/SACs, consult with your SAC and/or the Program Chairs.

Frequently Asked Questions

  1. How do I contact the Senior Area Chair (SAC) and/or the Program Chairs?

    OpenReview provides contacting functions to do so once you’ve been assigned to an SAC. Also, you can contact the Program Chairs via aistats2025conference@gmail.com.

  2. What if the paper does not have the reproducibility checklist?

    This does not count for desk-reject, although you should check whether the authors have submitted the checklist during author feedback. Remind the authors of accepted submissions to include the checklist in camera ready.

  3. What is the page limit?

    In the review period, the main part of the submission should be 8 pages long. After that, only the references are allowed. If that is not the case, please mark it as a format violation.

  4. What else counts as format violations?

    Anything that breaks anonymity, violates dual submission policy, changes the format (e.g., margins or vertical spaces). If in doubt, please mark it as a violation, which will be looked after by the Program Chairs.

This site last compiled Wed, 30 Oct 2024 03:45:01 +0000
Github Account Copyright © AISTATS 2024. All rights reserved.