Abstract
Over the last few years many articles have been published in an attempt to provide performance benchmarks for virtual screening tools. While this research has imparted useful insights, the myriad variables controlling said studies place significant limits on results interpretability. Here we investigate the effects of these variables, including analysis of calculation setup variation, the effect of target choice, active/decoy set selection (with particular emphasis on the effect of analogue bias) and enrichment data interpretation. In addition the optimization of the publicly available DUD benchmark sets through analogue bias removal is discussed, as is their augmentation through the addition of large diverse data sets collated using WOMBAT.








Similar content being viewed by others
References
Gruneberg S, Wendt B, Klebe G (2001) Angew Chem Int Ed Engl 40:389
Wu JH, Batist G (2001) Anticancer Drug Design 16:129
Paiva AM, Vanderwall DE, Blanchard JS, Kozarich JW, Williamson JM, Kelly TM (2001) Biochim Biophys Acta 1545:67
Perola E, Xu K, Kollmeyer TM, Kaufmann SH, Prendergast FG, Pang Y-P (2000) J Med Chem 43:401
Evers A, Klebe G (2004) J Med Chem 47:5381
Doman TN, McGovern SL, Witherbee BJ, Kasten TP, Kurumbail R, Stallings WC, Connolly DT, Shoichet BK (2002) J Med Chem 45:2213
Brenk R, Naerum L, Gradler U, Gerber H-D, Garcia GA, Reuter K, Stubbs MT, Klebe G (2003) J Med Chem 46:1133
Kitchen DB, Deconrez H, Furr JR, Bajorath J (2004) Nat Rev Drug Discov 3:935
Alvarez JC (2004) Curr Opin Chem Biol 8:365
Shoichet BK (2004) Nature 432:862
Barril X, Hubbard RE, Morley SD (2004) Mini Rev Med Chem 4:779
Jansen JM, Martin EJ (2004) Curr Opin Chem Biol 8:359
Krovat EM, Steindl T, Langer T (2005) Curr Comput Aided Drug Des 1:93
Mohan V, Gibbs AC, Cummings MD, Jaeger EP, DesJarlais RL (2005) Curr Pharm Des 11:323
Rajamani R, Good AC (2007) Curr Opin Drug Discov Devel 10:308
Charifsen PS, Corkery JJ, Murcko MA, Patrick Walters W (1999) J Med Chem 42:5100
Bissantz C, Folkers G, Rognan D (2000) J Med Chem 43:4759
Miteva MA, Lee WH, Montes MO, Villoutriex BO (2005) J Med Chem 48:6012
Cummings MD, DesJarlais RL, Gibbs AC, Mohan V, Jaeger EP (2005) J Med Chem 48:962
Evers A, Hessler G, Matter H, Klabunde T (2005) J Med Chem 48:5448
Chen H, Lyne PD, Giordanetto F, Lovell T, Li J (2006) J Chem Inf Model 46:401
Warren GL, Andrews CW, Cappelli AM, Clarke B, LaLonde J, Lambert MH, Lindvall M, Nevins N, Semus SF, Senger S, Tedesco G, Wall ID, Woolven JM, Peishoff CE, Head MS (2006) J Med Chem 49:5912
McGaughey GB, Sheridan RP, Bayly CI, Culberson JC, Kreatsoulas C, Lindsley S, Maiorov V, Truchon J-F, Cornell WD (2007) J Chem Inf and Model 47:1504
Huang N, Shoichet BK, Irwin JJ (2006) J Med Chem 49:6789
Olah M, Mracec M, Ostopovici L, Rad R, Bora A, Hadaruga N, Olah I, Banda M, Simon Z, Mracec M, Oprea TI (2004) In: Oprea TI (ed) WOMBAT: world of molecular bioactivity, in chemoinformatics in drug discovery. Wiley-VCH, New York, pp 223–239
LIGPREP, developed and distributed by Schrodinger Inc.: http://www.schrodinger.com/ProductDescription.php?mID=6&sID=7&cID=0 10/07
Sadowski J, Gasteiger J (1993) J Chem Rev 7:2567
Pearlman RS (1987) Chem Des Autom News 2:5
ROCS, OMEGA and the OECHEM toolkit are all developed and distributed by Openeye Scientific Software Inc: http://www.eyesopen.com/products 10/07
Pipeline Pilot, developed by Scitegic: http://www.scitegic.com/ 10/07
Hawkins PCD, Skillman AG, Nicholls A (2007) J Med Chem 50:74
Pham TA, Jain AN (2006) J Med Chem 49:5856
http://www.biopharmics.com/downloads.html accessed 11/07
Steindl T, Langer T (2004) J Chem Inf Comput Sci 44:1849
Oprea TI, Davis AM, Teague SJ, Leeson PD (2001) J Chem Inf Comput Sci 41:1308
Ghose AK, Pritchett A, Crippen GM (1988) J Comput Chem 9:80
Barnard JM (1993) J Chem Inf Comput Sci 33:532
Gillet VJ, Willett P, Bradshaw J (2003) J Chem Inf Comput Sci 43:346
Jain AN (2007) 234th ACS National Meeting, Boston, USA, Aug 19–23, COMP-147
Smith R, Hubbard RE, Gschwend DA, Leach AR, Good AC (2003) J Mol Graph Model 22:41
Good AC, Hermsmeier MA, Hindle SA (2004) J Comput Aided Mol Des 18:529
Oprea TI (2002) J Braz Chem Soc 13:811
Acknowledgments
This work was supported in part by support the New Mexico Tobacco Settlement fund (TIO). Thanks go to Andrei Leitão of UNM Biocomputing for his help in differentiating WOMBAT HIV NNRTI/NRTI compounds.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Good, A.C., Oprea, T.I. Optimization of CAMD techniques 3. Virtual screening enrichment studies: a help or hindrance in tool selection?. J Comput Aided Mol Des 22, 169–178 (2008). https://doi.org/10.1007/s10822-007-9167-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10822-007-9167-2