Talk:Accepting More Papers

From Health of Conferences Committee

(Difference between revisions)
Revision as of 16:46, 8 March 2006
DonnaBaglio (Talk | contribs)
Starting Comments
← Previous diff
Revision as of 19:17, 8 March 2006
MarkDHill (Talk | contribs)
SIGGRAPH and OOPSLA - JM
Next diff →
Line 21: Line 21:
:For the '05 conference, there were more submissions than expected and the number of manuscripts assigned to each reviewer was very large (about 7). Not surprisingly, this created unhappy members of the Program Committee who had not expected so many manuscripts to review. To deal with this, the PC Chair indicated that committee members could ask colleagues to review some of the papers in areas in which their colleagues were particularly qualified. These people who were asked for special reviews were listed separately in the conference Proceedings. :For the '05 conference, there were more submissions than expected and the number of manuscripts assigned to each reviewer was very large (about 7). Not surprisingly, this created unhappy members of the Program Committee who had not expected so many manuscripts to review. To deal with this, the PC Chair indicated that committee members could ask colleagues to review some of the papers in areas in which their colleagues were particularly qualified. These people who were asked for special reviews were listed separately in the conference Proceedings.
:While this system worked post hoc for the situation, it is not ideal. For '06, a larger PC has been created. The conference has not resorted to charging a reviewing fee or tracking reviews from conference to conference. We have, however, worked to better describe criteria for acceptable papers in the hopes of reducing the number of unqualified submissions. For example, in the past there has always been a tendency for authors to submit papers about proposals they have that have not been tested sufficiently. The CFP for '06 makes clear that testing with user populations will be important in the evaluation of submitted manuscripts. :While this system worked post hoc for the situation, it is not ideal. For '06, a larger PC has been created. The conference has not resorted to charging a reviewing fee or tracking reviews from conference to conference. We have, however, worked to better describe criteria for acceptable papers in the hopes of reducing the number of unqualified submissions. For example, in the past there has always been a tendency for authors to submit papers about proposals they have that have not been tested sufficiently. The CFP for '06 makes clear that testing with user populations will be important in the evaluation of submitted manuscripts.
 +
 +'''SIGGRAPH'''
 +:Even though submissions to the SIGGRAPH Papers Program has increased by 50% over the past few years, the acceptance rate has stayed fairly constant at 18%-20%. However, other programs at the conference have experienced growth during this time, such as the Sketches and Applications Program, which is essentially a short-papers program.
 +
 +'''OOPSLA'''
 +:OOPSLA has recently introduced different categories to the papers track (e.g., Essays, selected papers from the OnWard! track that pass the same technical papers review criteria).
== Discussion Begins == == Discussion Begins ==

Revision as of 19:17, 8 March 2006

To add your comment to this discussion, please click the + sign tab above. Like an email message, you can then contribute:

  • a subject (use subject Re: FOO to continue a discussion of FOO)
  • message body
  • (optionally) your name.

Starting Comments

Some argue that too-high acceptance rates (e.g., 40%) don't challenge the field enough; while too-low acceptance rates (< 15%) enourage too much conservativism in program committees. Thus, as a field grows some feel the paper publishing opportunities should also grow to keep acceptance reasonable (e.g, 20-30%).


SIGPLAN

There also seems to be a sense that the conference/journal system is broken. At least a vocal minority think that our community place too much importance on conference papers. This group thinks we need to improve the journal response rate, make journal publication meaningful, and increase the acceptance rate at conferences significantly.

SIGMETRICS

Sigmetrics has increased the committee size (since we are suppose to review all the papers ourself) and increased a bit the number of accepted papers (one year we had 2 parallel sessions and we've had longer days), so basically we can do a bit over 30 papers these days (rather than say around 20-25). ...

SIGACCESS

For the '05 conference, there were more submissions than expected and the number of manuscripts assigned to each reviewer was very large (about 7). Not surprisingly, this created unhappy members of the Program Committee who had not expected so many manuscripts to review. To deal with this, the PC Chair indicated that committee members could ask colleagues to review some of the papers in areas in which their colleagues were particularly qualified. These people who were asked for special reviews were listed separately in the conference Proceedings.
While this system worked post hoc for the situation, it is not ideal. For '06, a larger PC has been created. The conference has not resorted to charging a reviewing fee or tracking reviews from conference to conference. We have, however, worked to better describe criteria for acceptable papers in the hopes of reducing the number of unqualified submissions. For example, in the past there has always been a tendency for authors to submit papers about proposals they have that have not been tested sufficiently. The CFP for '06 makes clear that testing with user populations will be important in the evaluation of submitted manuscripts.

SIGGRAPH

Even though submissions to the SIGGRAPH Papers Program has increased by 50% over the past few years, the acceptance rate has stayed fairly constant at 18%-20%. However, other programs at the conference have experienced growth during this time, such as the Sketches and Applications Program, which is essentially a short-papers program.

OOPSLA

OOPSLA has recently introduced different categories to the papers track (e.g., Essays, selected papers from the OnWard! track that pass the same technical papers review criteria).

Discussion Begins