Terrible things about conferences, ICALP 2022 requiring submissions in LIPIcs style, more terrible things about conferences, and a new life

I’m on the ICALP 2022 program committee (PC) and was apparently the first to complain when I saw the draft call for papers, and I asked that the requirement that submissions must be in LIPIcs style be put to a vote. Despite substantial support among the PC for not requiring the majority of authors to squander their time formatting in an exotic style submissions that will be rejected, the Supreme Court blocked the vote. Their main rationale seems to be ensuring correspondence between submissions and proceedings. Ironically, at the same time other conferences are allowing authors to publish in proceedings an abridged version of the (accepted) submission, to make it easier to publish the paper in a journal (which may not want to have a full version already in a conference). We are at the nadir in history where human effort is systematically wasted to produce versions that do not even pretend to be useful for readers — only to check boxes.

When I was at the IAS and was briefed about logistics, I was stunned when they asked me if I type my own papers, or if I needed help with that. I guess the next level will be if you need help with formatting your submissions.

Picture a 100-year old retired scientist who followed the field for 75 years, and who wants to make one more contribution. Even though they are no match for the raw power of a 15-year old, their ability to draw connections almost makes up for it, and their perspective is invaluable to the community. This scientist, whose equipment consists of a desktop from two human generations ago, miraculously held together and kept working through sheer love and intimate knowledge, is now being asked to format their paper in LIPIcs style… or to ask someone else to do it for them (talk about fostering collaboration).

Here’s a non-exclusive list of true, terrible things about conferences, most of which were discussed earlier on this blog (see tag utopia-tcs):

  1. Requiring submissions in proceedings format.
  2. Pre-registering papers by a deadline different than the submission deadline.
  3. Requiring authors to submit a separate 2-page summary of the paper.
  4. Ultra-strict page limits, summary rejection for any deviation.
  5. Suddenly being forced on a short notice to submit a dummy .pdf so that PC assignments can be made.
  6. Extending the list of topics two days before the deadline.
  7. Moving deadlines.
  8. Forcing authors to check multiple times the call for papers and/or constantly monitor email for any of these last-minute changes.
  9. In the lucky case of acceptance, following up with a barrage of emails involving minutiae such as underfull \hbox.
  10. Writing “this only takes 60 seconds.” For me (and, apparently, many others — otherwise why delay answering emails that take 10 seconds to answer?) attending to any task, following any instruction, even “blink” or “say yes” has a huge fix cost, maybe 30 minutes. So I translate 60 seconds to 31 minutes.
  11. Hosting the conference in places which are inconvenient, for the attendees and planet earth.
  12. Hosting the conference at times which are inconvenient for the attendees.
  13. Requiring in-person PC meetings whose outcome does not justify the costs.

As usual, people in a position of power do not have much incentive to fight to change the very practices that put them in that position in the first place. But even this cynical remark doesn’t tell the whole story, since the practices got worse with time, unlike the case of journals. One impression I have is that people have gotten so used to buggy software, constant updates, and general techno slavery that they just accept all of this as another inevitable misery in life… and by far not the worst! This last point is important, as I think a seeping philosophy that permeates much of the discussion and the decisions is that much more important things are at stake, so who cares about this? If you really want to spend cycles fixing something, then what about X? (It’s fun to think where you end up if you stretch this point.) But another life is possible.

One day, I will throw in my two cents and launch a new journal. Besides being electronic and free (like ToC) it will have the following features.

  1. Papers, if accepted, will appear in the authors’ chosen format. No conversion, and no additional effort, will be required for publication. All the effort will be exclusively directed at improving the content of the paper.
  2. Submissions can be by pdf attachment or by overlay, but not only to arxiv: to *any* repository. In particular, authors will not be required to get their paper to compile on the arxiv.
  3. The identities of the reviewers will be made public (in case of acceptance). This I am still debating, but so far I am leaning towards it. The problem that this is trying to address is that while you get reputation points for being on a program committee or on an editorial board, you don’t get many for being an unknown journal referee who is actually supposedly doing the hard work or finally really checking the proofs. Instead with public identities people can show off the hard work and their role in the community, as happens on more recent platforms like say stackexchange.
  4. Authors will be free to submit anonymously, or not. This choice will be made by the authors, not dictated by a committee.
  5. And perhaps the most consequential thing that I am still debating, should all submissions be public? (Maybe not.)

To finish on a high note, a great thing about conferences is the fast turn-around. It is really depressing — in other fields — to have to wait so long for any quantifiable feedback on your work, and this is definitely something which I liked about the TCS community. But, to come back to the mood of the post, this good aspect (and others) of conferences can probably be kept while rethinking the not so good. (For example, there could be a journal with deadlines similar to conferences, which is also what happens for grant proposals etc.)

6 thoughts on “Terrible things about conferences, ICALP 2022 requiring submissions in LIPIcs style, more terrible things about conferences, and a new life

  1. Hey, LiPICS format beats Springer LNCS, which ICALP used to require! See Luca Trevisan’s post about the 2015 ICALP submission process. (https://lucatrevisan.wordpress.com/2015/03/10/i-almost-fell-for-it/) I do think that conference PCs have vastly difficult work that they are doing for free, so we should support them by making sure that what they see is in a legible. However, the notion that this constrained formatting is required to avoid any possible perception of potential unfairness (authors submitting something non-conforming might get an advantage by submitting too much content) feels vastly unnecessary and legalistic.

  2. Hi Emanuele, as the vast majority of TCS conferences ICALP has a page limit (which was increased this year from 12 to 15, to make it easier to convert from one submission format to the other) Due to the page limit we have a specific submission format, which is not restrictive (e.g. full/longer versions can be the content of an appendix).
    The question whether we want to remove page limits altogether would require a thorough discussion in the community, and the decision can’t be just the result of a vote of a small group (which actually does not represent the entire ICALP community, see track A/B).

  3. Thank you for the comment. But my main point is not at all page limits. My main point is the LIPIcs style file conversion (see the post). I don’t see why page limits imply specific style. Other top conferences such as STOC/FOCS/CCC don’t typically require a specific style for submission. See for example the STOC 2022 call for papers below. Why does ICALP need to make it more annoying for submitters?

    Personally, the idea that any of this has anything to do with the accept/reject decision on a paper I find ludicrous. The only effect is that submitters waste time.

    Regarding the “small group.” I was asking for a vote from the PC of a track. It could be easily extended to a vote in both tracks. I don’t see why that’s a small group: PCs routinely make decisions such as these.

    http://acm-stoc.org/stoc2022/cfp.html
    Submission format: Submissions should start with a title page consisting of the title of the paper; each author’s name, affiliation, and email address; and an abstract of 1-2 paragraphs summarizing the paper’s contributions. There is no page limit and authors are encouraged to use the “full version” of their paper as the submission. The submission should contain within the initial ten pages following the title page a clear presentation of the merits of the paper, including a discussion of the paper’s importance within the context of prior work and a description of the key technical and conceptual ideas used to achieve its main claims. The submission should be addressed to a broad spectrum of theoretical computer science researchers. Proofs must be provided which can enable the main mathematical claims of the paper to be fully verified.

    1. Hi Manu, my point is that a specific format makes sense once there is a page limit. Also, applying the LIPIcs style is no big deal (it’s usual conference format) whereas the work required for the first 10 pages according to the STOC CfP most probably requires more time, and thinking.

      Regarding the vote: no serious conference would undertake any fundamental change without consulting the broad community (and that’s very sane!).

      1. Thank you for clarifying your position, and for the discussion. It seems we disagree on fundamental things. For one, I can’t understand why the STOC CFP would need more time. Both LIPIcs and STOC have some kind of page limit, in addition LIPIcs forces everyone to mess around with LaTeX. Is your point the 10 page vs. the more generous bound in ICALP? (I would find that point very strange.)
        <\br>
        Regarding the fundamental change: Again we seem to disagree on fundamental issues. I believe such changes to the call for papers have happened many times, without any consultation broader than a PC discussion.
        <\br>
        But on one thing you must agree with me: If there was a consultation with the broad community, people would choose at once to eliminate the LIPIcs requirement from submissions ;-) (Indeed, why a random submitter would want this extra requirement?)

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s