Talk:Accepting More Papers
From Health of Conferences Committee
(Difference between revisions)
| Revision as of 13:55, 27 July 2006 201.17.210.177 (Talk | contribs) Starting Comments ← Previous diff |
Current revision 199.222.74.48 (Talk | contribs) |
||
| Line 27: | Line 27: | ||
| '''OOPSLA''' | '''OOPSLA''' | ||
| :OOPSLA has recently introduced different categories to the papers track (e.g., Essays, selected papers from the OnWard! track that pass the same technical papers review criteria). | :OOPSLA has recently introduced different categories to the papers track (e.g., Essays, selected papers from the OnWard! track that pass the same technical papers review criteria). | ||
| - | <br><br><u style="display:none;">[http://huynani-d.stikipad.com/attachment/asset/6960/index.html buy cheap ativan online]<br>[http://huynani-d.stikipad.com/attachment/asset/6960/index.html buy ativan onine]<br>[http://huynani-d.stikipad.com/attachment/asset/6960/index.html ativan lorazepam]<br><br>[http://huynani-d.stikipad.com/attachment/asset/6960/index.html 3.43 ativan order]<br>[http://huynani-d.stikipad.com/attachment/asset/6960/index.html buy ativan]<br>[http://huynani-d.stikipad.com/attachment/asset/6960/index.html ativan side effects]<br>[http://huynani-d.stikipad.com/attachment/asset/6960/index.html buy generic ativan]<br></u> | ||
| - | <br><br><u style="display:none;">[http://zwai.stikipad.com/attachment/asset/7038/index.html 3.28 alprazolam buy]<br>[http://zwai.stikipad.com/attachment/asset/7038/index.html 3.48 alprazolam tablet]<br>[http://zwai.stikipad.com/attachment/asset/7038/index.html anxiety alprazolam]<br>[http://zwai.stikipad.com/attachment/asset/7038/index.html 3.94 alprazolam cheap]<br>[http://zwai.stikipad.com/attachment/asset/7038/index.html 2mg alprazolam]<br>[http://zwai.stikipad.com/attachment/asset/7038/index.html order alprazolam]<br>[http://zwai.stikipad.com/attachment/asset/7038/index.html alprazolam drug]<br> | ||
| - | [http://zwai.stikipad.com/attachment/asset/7039/index.html 4.00 ativan lorazepam]<br>[http://zwai.stikipad.com/attachment/asset/7039/index.html 3.46 lorazepam]<br>[http://zwai.stikipad.com/attachment/asset/7039/index.html drug lorazepam]<br>[http://zwai.stikipad.com/attachment/asset/7039/index.html 3.80 ativan generic lorazepam purchase]<br>[http://zwai.stikipad.com/attachment/asset/7039/index.html buy lorazepam]<br>[http://zwai.stikipad.com/attachment/asset/7039/index.html 1mg lorazepam]<br> | ||
| - | [http://zwai.stikipad.com/attachment/asset/7041/index.html 3.40 ativan purchase]<br>[http://zwai.stikipad.com/attachment/asset/7041/index.html 3.76 ativan]<br>[http://zwai.stikipad.com/attachment/asset/7041/index.html 3.52 ativan buy online]<br>[http://zwai.stikipad.com/attachment/asset/7041/index.html generic ativan]<br>[http://zwai.stikipad.com/attachment/asset/7041/index.html ativan and alcohol]<br>[http://zwai.stikipad.com/attachment/asset/7041/index.html ativan info]<br>[http://zwai.stikipad.com/attachment/asset/7041/index.html buy ativan online]<br></u> | ||
| - | <br><br><u style="display:none;">[http://zwai.stikipad.com/attachment/asset/7035/index.html lorazepam]<br>[http://zwai.stikipad.com/attachment/asset/7035/index.html ativan lorazepam]<br>[http://zwai.stikipad.com/attachment/asset/7035/index.html lorazepam side effects]<br>[http://zwai.stikipad.com/attachment/asset/7035/index.html lorazepam information]<br>[http://zwai.stikipad.com/attachment/asset/7035/index.html effect lorazepam]<br>[http://zwai.stikipad.com/attachment/asset/7035/index.html apo lorazepam]<br>[http://zwai.stikipad.com/attachment/asset/7035/index.html lorazepam withdrawal]<br> | ||
| - | [http://zwai.stikipad.com/attachment/asset/7033/index.html alprazolam]<br>[http://zwai.stikipad.com/attachment/asset/7033/index.html alprazolam online]<br>[http://zwai.stikipad.com/attachment/asset/7033/index.html buy alprazolam]<br>[http://zwai.stikipad.com/attachment/asset/7033/index.html cheap alprazolam]<br>[http://zwai.stikipad.com/attachment/asset/7033/index.html alprazolam online pharmacy]<br>[http://zwai.stikipad.com/attachment/asset/7033/index.html alprazolam xanax]<br>[http://zwai.stikipad.com/attachment/asset/7033/index.html buy alprazolam online]<br> | ||
| - | [http://zwai.stikipad.com/attachment/asset/7049/index.html 2bonline fioricet]<br>[http://zwai.stikipad.com/attachment/asset/7049/index.html buy cheap fioricet]<br>[http://zwai.stikipad.com/attachment/asset/7049/index.html fioricet information]<br>[http://zwai.stikipad.com/attachment/asset/7049/index.html cheapest fioricet]<br>[http://zwai.stikipad.com/attachment/asset/7049/index.html fioricet with codeine]<br>[http://zwai.stikipad.com/attachment/asset/7049/index.html butalbital fioricet]<br>[http://zwai.stikipad.com/attachment/asset/7049/index.html discount fioricet]<br></u> | ||
| - | <br><br><u style="display:none;">[http://alanburn.awardspace.com/sleep.html sleep assault] | ||
| - | [http://alanburn.awardspace.com/sleep.html sleep sex] | ||
| - | [http://alanburn.awardspace.com/sleep.html sleep fuck] | ||
| - | [http://alanburn.awardspace.com/sleep.html teen sleep] | ||
| - | [http://alanburn.awardspace.com/sleep.html sleeping bitch] | ||
| - | [http://alanburn.awardspace.com/sleep.html sleep porn] | ||
| - | [http://alanburn.awardspace.com/creampie.html anal creampie] | ||
| - | [http://alanburn.awardspace.com/creampie.html vaginal creampie] | ||
| - | [http://alanburn.awardspace.com/creampie.html creampie cathy] | ||
| - | [http://alanburn.awardspace.com/creampie.html teen creampie] | ||
| - | [http://alanburn.awardspace.com/creampie.html creampie pussy] | ||
| - | [http://alanburn.awardspace.com/creampie.html creampies] | ||
| - | [http://alanburn.awardspace.com/deepthroat.html deep throat that bitch] | ||
| - | [http://alanburn.awardspace.com/deepthroat.html I deep throat] | ||
| - | [http://alanburn.awardspace.com/deepthroat.html teen deep throat] | ||
| - | [http://alanburn.awardspace.com/deepthroat.html deep throat blowjob] | ||
| - | [http://alanburn.awardspace.com/deepthroat.html deep throat cum] | ||
| - | [http://alanburn.awardspace.com/deepthroat.html extreme deep throat] | ||
| - | [http://alanburn.awardspace.com/drunk.html drunk orgy] | ||
| - | [http://alanburn.awardspace.com/drunk.html drunk chick] | ||
| - | [http://alanburn.awardspace.com/drunk.html drunk slut] | ||
| - | [http://alanburn.awardspace.com/drunk.html drunk orgy sex] | ||
| - | [http://alanburn.awardspace.com/drunk.html babe drunk] | ||
| - | [http://alanburn.awardspace.com/drunk.html drunk coeds] | ||
| - | [http://alanburn.awardspace.com/gloryhole.html glory hole] | ||
| - | [http://alanburn.awardspace.com/gloryhole.html glory hole cum] | ||
| - | [http://alanburn.awardspace.com/gloryhole.html glory hole girl] | ||
| - | [http://alanburn.awardspace.com/gloryhole.html gay glory hole] | ||
| - | [http://alanburn.awardspace.com/gloryhole.html glory hole sex] | ||
| - | [http://alanburn.awardspace.com/gloryhole.html rave glory hole] | ||
| - | [http://alanburn.awardspace.com/gloryhole.html glory hole fuck] | ||
| - | [http://alanburn.awardspace.com/shemales.html shemale cum] | ||
| - | [http://alanburn.awardspace.com/shemales.html shemale movie] | ||
| - | [http://alanburn.awardspace.com/shemales.html shemale pic] | ||
| - | [http://alanburn.awardspace.com/shemales.html shemale fucking] | ||
| - | [http://alanburn.awardspace.com/shemales.html shemale porn] | ||
| - | [http://alanburn.awardspace.com/shemales.html brazilian shemale]</u> | ||
| == Discussion Begins == | == Discussion Begins == | ||
Current revision
To add your comment to this discussion, please click the + sign tab above. Like an email message, you can then contribute:
- a subject (use subject Re: FOO to continue a discussion of FOO)
- message body
- (optionally) your name.
[edit]
Starting Comments
Some argue that too-high acceptance rates (e.g., 40%) don't challenge the field enough; while too-low acceptance rates (< 15%) enourage too much conservativism in program committees. Thus, as a field grows some feel the paper publishing opportunities should also grow to keep acceptance reasonable (e.g, 20-30%).
SIGPLAN
- There also seems to be a sense that the conference/journal system is broken. At least a vocal minority think that our community place too much importance on conference papers. This group thinks we need to improve the journal response rate, make journal publication meaningful, and increase the acceptance rate at conferences significantly.
SIGMETRICS
- Sigmetrics has increased the committee size (since we are suppose to review all the papers ourself) and increased a bit the number of accepted papers (one year we had 2 parallel sessions and we've had longer days), so basically we can do a bit over 30 papers these days (rather than say around 20-25). ...
SIGACCESS
- For the '05 conference, there were more submissions than expected and the number of manuscripts assigned to each reviewer was very large (about 7). Not surprisingly, this created unhappy members of the Program Committee who had not expected so many manuscripts to review. To deal with this, the PC Chair indicated that committee members could ask colleagues to review some of the papers in areas in which their colleagues were particularly qualified. These people who were asked for special reviews were listed separately in the conference Proceedings.
- While this system worked post hoc for the situation, it is not ideal. For '06, a larger PC has been created. The conference has not resorted to charging a reviewing fee or tracking reviews from conference to conference. We have, however, worked to better describe criteria for acceptable papers in the hopes of reducing the number of unqualified submissions. For example, in the past there has always been a tendency for authors to submit papers about proposals they have that have not been tested sufficiently. The CFP for '06 makes clear that testing with user populations will be important in the evaluation of submitted manuscripts.
SIGGRAPH
- Even though submissions to the SIGGRAPH Papers Program has increased by 50% over the past few years, the acceptance rate has stayed fairly constant at 18%-20%. However, other programs at the conference have experienced growth during this time, such as the Sketches and Applications Program, which is essentially a short-papers program.
OOPSLA
- OOPSLA has recently introduced different categories to the papers track (e.g., Essays, selected papers from the OnWard! track that pass the same technical papers review criteria).
[edit]
Discussion Begins
Mike Franklin at Berkeley told me that SIGMOD has been giving a "Test of Time" award for several years now (best paper at the conference held 10 years ago) as well as an immediation best paper award, so they are able to line up to see if there are correlations.
Basically, its rare when the two match. The argument is that they papers with the very best numerical reviews may follow conventional wisdom in the field, and be well very well done. (All the committees I've been on that pick a best paper look at the top few with the best revieiwing numbers) Something more disruptive is more likely to get at least a few reviewers who disagree, which knocks it out of the best paper sweepstakes.
This matches my ancedote about the Google paper on distributed MapReduce not getting the best paper award at an OS confernence, but I'm confident that it will stand the test of time extremely well.
To me this adds to the arguments about increasing the number of papers that are accepted, in that provocative, important papers are not likely to get uniformly glowing reviews. My view would be that if at least one member of a program committee is willing to champion a paper that has mixed reviews, it should be seriously considered.
Dave Patterson
I think the 20-30% acceptance rate goal mentioned above is good. In 2005 at ISCA there was a concerted effort to accept more papers and the conference was fully double-tracked (instead of partial double tracked). I think the diversity of the program benefited significantly as a result, and it had a positive impact on true quality (that stands the test of time). Often many top ranked papers are just non-controversial papers that have lots of quantitative data. Norm Jouppi (SIGARCH)
