Main Page
From Health of Conferences Committee
| Revision as of 23:31, 24 February 2006 MarkDHill (Talk | contribs) ← Previous diff |
Revision as of 23:33, 24 February 2006 MarkDHill (Talk | contribs) Next diff → |
||
| Line 73: | Line 73: | ||
| Big conferences have more than one thousand attendees, small conferences less than 100, and medium conferences in the middle. | Big conferences have more than one thousand attendees, small conferences less than 100, and medium conferences in the middle. | ||
| - | Question 1: REVIEWER LOAD. | + | ===Question 1: REVIEWER LOAD=== |
| Has your community recently adopted new practices to deal with growing reviewer load, such as: | Has your community recently adopted new practices to deal with growing reviewer load, such as: | ||
| Line 90: | Line 90: | ||
| - | Question 2: NON-INCREMENTAL | + | ===Question 2: NON-INCREMENTAL=== |
| Has your community recently adopted new practices to promote non-incremental new ideas? | Has your community recently adopted new practices to promote non-incremental new ideas? | ||
| Line 108: | Line 108: | ||
| - | Question 3: PROGRAM COMMITTEES | + | ===Question 3: PROGRAM COMMITTEES=== |
| Does your community practice: | Does your community practice: | ||
| *double blind submissions | *double blind submissions | ||
| Line 126: | Line 126: | ||
| - | Question 4: WORKSHOPS, ETC. | + | ===Question 4: WORKSHOPS, ETC.=== |
| Does your community provide venue for work not mature | Does your community provide venue for work not mature | ||
| enough for your major conferences, such as: | enough for your major conferences, such as: | ||
| Line 144: | Line 144: | ||
| - | Question 5: CATCH-ALL. Are there other approaches your community has tried or abandoned that the rest of us can learn from? | + | ===Question 5: CATCH-ALL=== |
| + | Are there other approaches your community has tried or abandoned that the rest of us can learn from? | ||
| [[Q5: Large Conferences]] | [[Q5: Large Conferences]] | ||
Revision as of 23:33, 24 February 2006
Contents |
Health of Conferences Committee
- University of Wisconsin, ACM/SIGARCH & IEEE
- UC Irvine, IEEE
- USC/ISI, ACM/SIGPLAN
- Mitsubishi Electric Research Labs, ACM/SIGGRAPH
Paolo Prinetto
- Politecnico di Torino, IEEE
Donna Baglio
- ACM Headquarters
Charge from ACM President David Patterson
The idea is to collect the best practices onto a web page so that conference organizers can see innovative ways to cope with the demands of paper submissions, refereeing, and presentations as the number of papers increase.
The hope is that organizers will either try good new ideas or at least avoid the mistakes of others.
Process
The committee--with the members listed above--was formed in December 2005. It "met" for several conference calls to create this Wiki whose initial version was released in XXX 2006. Key steps were formulating questions to ask ACM SIG chairs and IEEE XXXs, mailing out the questionaires and compiling a short list of ideas to be recommended or avoided.
The goals are to the unearth actionable ideas and reveal failed ideas. It is NOT a goal to produce summary statistics, because we expect our audience is more interested in groups in similar situations (e.g., running very large conferences) than in some average.
Big conferences have more than one thousand attendees, small conferences less than 100, and medium conferences in the middle.
Top 10 Best Conference Ideas
We encourage an open debate on each of these ten ideas. In order to do this, follow the links below and click the + sign in the discussion area. You are then able to enter a discussion topic title and text. To reply to a specific discusion please put "Re" in front of the original topic title.
1. FOO
2. FOO
3. FOO
4. FOO
5. FOO
6. FOO
7. FOO
8. FOO
9. FOO
10. FOO
Detailed Results
Big conferences have more than one thousand attendees, small conferences less than 100, and medium conferences in the middle.
Question 1: REVIEWER LOAD
Has your community recently adopted new practices to deal with growing reviewer load, such as:
- tracking reviews of rejected papers from conference to conference as is done in journal reviewing
- increasing program committee size
- charging a review fee
- others?
For each practice you are using, what is your view of how well it is working within your community? Please comment on the merit of the other strategies as applies to your community.
Question 2: NON-INCREMENTAL
Has your community recently adopted new practices to promote non-incremental new ideas?
- big ideas sessions
- more papers
- shorter papers
- deemphasizing detailed evaluation
- others?
For each practice you are using, what is your view of how well it is working within your community? Please comment on the merit of the other strategies as applies to your community.
Question 3: PROGRAM COMMITTEES
Does your community practice:
- double blind submissions
- program committee submission restrictions
- rebuttals (author responses)
- large program committees
- program subcommittees
- others?
Do these practices seem to help or hurt promoting your field?
Question 4: WORKSHOPS, ETC.
Does your community provide venue for work not mature enough for your major conferences, such as:
- workshop co-located at conferences
- stand-alone workshops
- panels
- crazy idea sessions
On balance, are these other venues effect for advancing your field? What mechanisms, if any, do you use allow good papers from these venues to later achieve wider dissemination?
Question 5: CATCH-ALL
Are there other approaches your community has tried or abandoned that the rest of us can learn from?
Acknowledgements
The committee acknowledges the constructive advice of David A. Patterson, MORE NAMES HERE.
The committee acknowledges the excellent work of Mike Marty, Caitlin Scopel, MORE NAMES HERE.
References
Mark D. Hill, Some Advice for Program Committee Chairs Based on my ISCA 2005 Experience, April 2005, http://www.cs.wisc.edu/~markhill/pcadvice2005.html.
Mark D. Hill, Interim Talk to the ACM Special Interest Group Governing Board, February 24, 2006, http://www.cs.wisc.edu/~markhill/acm_ieee_heath_conf_2006_02.ppt.
Kathyrn D. McKinley, Notes of Chairing Program Committees, May 2005, http://www.cs.utexas.edu/users/mckinley/notes/PC.html.
David A. Patterson, President's Letter: The Health of Research Conferences and the Dearth of Big Idea Papers, Communications of the ACM, December 2004, pp. 23-24.
Please see documentation on customizing the interface + Health of Conferences Committee - and the User's Guide for usage and configuration help.
