research-article

How NOT to review a paper: the tools and techniques of the adversarial reviewer

Author:

Graham CormodeAuthors Info & Claims

ACM SIGMOD Record, Volume 37, Issue 4

Pages 100 - 104

https://doi.org/10.1145/1519103.1519122

Published: 20 March 2009 Publication History

Get Access

Abstract

There are several useful guides available for how to review a paper in Computer Science [10, 6, 12, 7, 2]. These are soberly presented, carefully reasoned and sensibly argued. As a result, they are not much fun. So, as a contrast, this note is a checklist of how not to review a paper. It details techniques that are unethical, unfair, or just plain nasty. Since in Computer Science we often present arguments about how an adversary would approach a particular problem, this note describes the adversary's strategy.

References

[1]

Mark Allman. A referee's plea. http://www.icir.org/mallman/plea.txt, 2001.

Google Scholar

[2]

Mark Allman. Thoughts on reviewing. ACM SIGCOMM Computer Communication Review (CCR), 38(2), April 2008.

Digital Library

Google Scholar

[3]

Joshua S. Gans and George B. Shepherd. How are the mighty fallen: Rejected classic articles by leading economists. The Journal of Economic Perspectives, 8(1):165--179, 1994.

Crossref

Google Scholar

[4]

Anthony Jay and Jonathan Lynn. The Complete 'Yes Minister'. BBC Books, 1984.

Google Scholar

[5]

Frank Manola. How to get even with database conferece program committees. IEEE Data Engineering Bulletin, 4(1):30--36, September 1981.

Google Scholar

[6]

Ian Parberry. A guide for new referees in theoretical computer science. Information and Computation, 112(1):96--116, 1994.

Digital Library

Google Scholar

[7]

Timothy Roscoe. Writing reviews for systems conferences. http://people.inf.ethz.ch/troscoe/pubs/review-writing.pdf, 2007.

Google Scholar

[8]

Simone Santini. We are sorry to inform you. Computer, 38(12):128--127, 2005.

Digital Library

Google Scholar

[9]

Simon Singh. Fermat's Last Theorem. Fourth Estate, 1997.

Google Scholar

[10]

Alan Jay Smith. The task of the referee. IEEE Computer, 23(4):65--71, 1990.

Digital Library

Google Scholar

[11]

Mary-Claire van Leunen and Richard Liption. How to have your abstract rejected. SIGACT News, 8(3):21--24, 1976.

Digital Library

Google Scholar

[12]

Toby Walsh. How to write a review. http://www.labunix.uqam.ca/~jpmf/int-mgmt/walsh1.pdf, 2001.

Google Scholar

Cited By

View all

Wang GPeng QZhang YZhang M(2023)What have we learned from OpenReview?World Wide Web10.1007/s11280-022-01109-z26:2(683-708)Online publication date: 1-Mar-2023
https://dl.acm.org/doi/10.1007/s11280-022-01109-z
Halle S(2021)Computer Simulations of Scientific Peer ReviewingIEEE Access10.1109/ACCESS.2021.31038379(111595-111607)Online publication date: 2021
https://doi.org/10.1109/ACCESS.2021.3103837
Misra DRavindran V(2019)Peer Review in Academic Publishing: Threats and ChallengesJournal of the Royal College of Physicians of Edinburgh10.4997/jrcpe.2019.20149:2(99-100)Online publication date: 1-Jun-2019
https://doi.org/10.4997/jrcpe.2019.201
Show More Cited By

Index Terms

How NOT to review a paper: the tools and techniques of the adversarial reviewer
1. Social and professional topics
  1. Professional topics
    1. Computing profession
      1. Codes of ethics

Recommendations

Review: Analyzing well-known countermeasures against distributed denial of service attacks

This paper reviews and analyzes well-known countermeasures against distributed denial of service (DDoS) attacks. This paper provides an in-depth analysis of each countermeasure and enumerates strengths and challenges of each technique. If it is possible,...
Short Paper: The Meaning of Attack-Resistant Systems
PLAS'15: Proceedings of the 10th ACM Workshop on Programming Languages and Analysis for Security

In this paper, we introduce a formal notion of partial compliance, called ATTACK-RESISTANCE, of a computer program running together with a defense mechanism w.r.t a non-exploitability specification. In our setting, a program may contain exploitable ...
Short paper: security evaluation of IEEE 802.11w specification
WiSec '11: Proceedings of the fourth ACM conference on Wireless network security

The IEEE 802.11w amendment for protected management frame has been finalized. The main purpose of this new amendment is to reduce the susceptibility of Wi-Fi networks to various DoS attacks. In this paper, we scrutinize the resilience of 802.11w ...

Comments

Information & Contributors

Information

Published In

ACM SIGMOD Record Volume 37, Issue 4

December 2008

116 pages

ISSN:0163-5808

DOI:10.1145/1519103

Issue’s Table of Contents

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 March 2009

Published in SIGMOD Volume 37, Issue 4

Check for updates

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
4,801
Total Downloads

Downloads (Last 12 months)74
Downloads (Last 6 weeks)11

Reflects downloads up to 07 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Wang GPeng QZhang YZhang M(2023)What have we learned from OpenReview?World Wide Web10.1007/s11280-022-01109-z26:2(683-708)Online publication date: 1-Mar-2023
https://dl.acm.org/doi/10.1007/s11280-022-01109-z
Halle S(2021)Computer Simulations of Scientific Peer ReviewingIEEE Access10.1109/ACCESS.2021.31038379(111595-111607)Online publication date: 2021
https://doi.org/10.1109/ACCESS.2021.3103837
Misra DRavindran V(2019)Peer Review in Academic Publishing: Threats and ChallengesJournal of the Royal College of Physicians of Edinburgh10.4997/jrcpe.2019.20149:2(99-100)Online publication date: 1-Jun-2019
https://doi.org/10.4997/jrcpe.2019.201
Cormode G(2013)What does an associate editor actually do?ACM SIGMOD Record10.1145/2503792.250380542:2(52-58)Online publication date: 16-Jul-2013
https://dl.acm.org/doi/10.1145/2503792.2503805
D. Holt G(2013)Note: issues of importance, timing and method relating to peer review of journal manuscriptsJournal of Financial Management of Property and Construction10.1108/JFMPC-05-2013-001918:3(282-290)Online publication date: 4-Nov-2013
https://doi.org/10.1108/JFMPC-05-2013-0019
Papagiannaki KRizzo L(2009)The ACM SIGCOMM 2009 technical program committee processACM SIGCOMM Computer Communication Review10.1145/1568613.156862339:3(43-48)Online publication date: 30-Jun-2009
https://dl.acm.org/doi/10.1145/1568613.1568623

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Review: Analyzing well-known countermeasures against distributed denial of service attacks

Short Paper: The Meaning of Attack-Resistant Systems

Short paper: security evaluation of IEEE 802.11w specification

Comments

Information

Published In

Publisher

Publication History

Check for updates

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations