Frederick P. Brooks
Ming Ouh-Young
James J. Batter
ABSTRACT
We began in 1967 a project to develop a haptic+display for 6-D force fields of interacting protein molecules. We approached it in four stages: a 2-D system, a 3-D system tested with a simple task, a 6-D system tested with a simple task, and a full 6-D molecular docking system, our initial goal. This paper summarizes the entire project---the four systems, the evaluation experiments, the results, and our observations. The molecular docking system results are new.Our principal conclusions are:• Haptic display as an augmentation to visual display can improve perception and understanding both of force fields and of world models populated with impenetrable objects.• Whereas man-machine systems can outperform computer-only systems by orders of magnitude on some problems, haptic-augmented interactive systems seem to give about a two-fold performance improvement over purely graphical interactive systems. Better technology may give somewhat more, but a ten-fold improvement does not seem to be in the cards.• Chemists using GROPE-III can readily reproduce the true docking positions for drugs whose docking is known (but not to them) and can find very good docks for drugs whose true docks are unknown. The present tool promises to yield new chemistry research results; it is being actively used by research chemists.• The most valuable result from using GROPE-III for drug docking is probably the radically improved situation awareness that serious users report. Chemists say they have a new understanding of the details of the receptor site and its force fields, and of why a particular drug docks well or poorly.• We see various scientific/education applications for haptic displays but believe entertainment, not scientific visualization, will drive and pace the technology.• The hardware-software system technology we have used is barely adequate, and our experience sets priorities for future development.• Some unexpected perceptual phenomena were observed. All of these worked for us, not against us.
- 1.Batter, J.J. and Brooks, F.P., Jr. GROPE-I: A computer display to the sense of feel. Information Processing, Proc. 1FIP Congress 71,759-763.]]Google Scholar
- 2.Bejczy, A.K. Sensors,controls, and man-machine interface for advanced teleoperation. Science 208 (1980), 1327-1335,.]]Google ScholarCross Ref
- 3.Brooks, F.P., Jr. The computer scientist as toolsmith: Studies in interactive computer graphics. In Information Processing 77, 625- 634. B. Gilchrist, ed. North-Holland: Amsterdam, 1977.]]Google Scholar
- 4.Brooks, F.P., Jr. Grasping reality through illusion: Interactive graphics serving science. Invited keynote address. Published in CHI'68 Proceedings, May 1988. Addison-Wesley: Reading, MA. 1- 11.]] Google ScholarDigital Library
- 5.Capowski, J.J. Remote Manipulators as a Computer Input Device. M.S. Thesis, Computer Science Department, University of North Carolina, Chapel Hill, 1971.]] Google ScholarDigital Library
- 6.Connolly, M.L. Solvent-accessible surfaces of proteins and nucleic acids. Science 221 (August 1983), 709-713.]]Google ScholarCross Ref
- 7.Deyo, R., Briggs, J., and Doenges, P. Getting graphics in gear. Proceedings of SIGGRAPH'86 (Dallas, Texas, August 18-22, 1986). In Computer Graphics 22, 4 (August 1986), 317-326.]] Google ScholarDigital Library
- 8.Goertz, R.C. et al. The ANL Model 3 master slave manipulators-Its design and use in a cave. Proc. of the Ninth Conference on Hot Laboratories and Equipment, Washington, D.C., United States Atomic Energy Commission, 1961.]]Google Scholar
- 9.Gregory, R.L. Eye and Brain. 2nded. McGraw- Hill: New York, 1973.]]Google Scholar
- 10.Hill, J.W. and Salisbury, J.K., Jr. Two measures of performance in a peg-in-hole manipulation task with force feedback. Paper presented at Thirteenth Annual Conference on Manual Control, MIT (June 15-17, 1977).]]Google Scholar
- 11.Hill, J.W. and Salisbury, J.K., Jr. Study to design and develop remote manipulator system. Quarterly Reports 5, 6 (January 1978). Stanford Research Institute, Menlo Park, CA.]]Google Scholar
- 12.Hogan, N. Stable execution of contact tasks using impedance control. Proceedings of lEEE Robotics and Automation Conference, Raleigh, NC (t 987), 1047-1054.]]Google Scholar
- 13.Kilpatrick, P.J. The Use of Kinesthetic Supplement in an Interactive System. Ph.D dissertation, Computer Science Department, University of North Carolina at Chapel Hill, 1976.]] Google ScholarDigital Library
- 14.Kuyper, L. Receptor-based design of Dihydrofolate Reductase inhibitors: Comparison of crystallographically determined enzyme binding with enzyme affinity in a series of carboxy-substituted Trimethoprim analogues." J. Med. Chem.. 1122, 25 (1982), 1120- 1124.]]Google Scholar
- 15.McCormick, B.H., DeFanti, T.A., Brown, M.D., eds. Visualization in scientific computing. Computer Graphics 21, 6 (Nov. 1987), and SIGGRAPH Video Review, Issues 28-29 (Nov. 1987).]]Google Scholar
- 16.Minsky, M., Ouh-young, M., Steele, O., Brooks, F. P., Jr., Behensky, M. Feeling and seeing: Issues in force display. Proc. of 1990 Symposium on Interactive 3D Graphics, Snowbird, Utah, March 1990. Published in Computer Graphics 24, 2 (March 1990), 235-244.]] Google ScholarDigital Library
- 17.Mowbray, G. H. and Gebhard, J. W. Man's senses as information channels. In H.W. Sinaiko, ed. Selected Papers on Human Factors in the Design and Use of Control Systems. Dover: New York, 1961. p. 118.]]Google Scholar
- 18.Ouh-Young, M., Pique, M., Hughes,L, Srinivasan, N., Brooks, F.P., Jr. Using a manipulator for force display in molecular docking. Proc. IEEE Robotics and Automation Conference 3 (Philadelphia, April 1988), 1824-1829.]]Google ScholarCross Ref
- 19.Ouh-Young, M., Beard, D.V., Brooks, F.P., Jr. Force display performs better than visual display in a simple 6-D docking task. Proc. IEEE International Conference on Robotics and Automation (Arizona, May 1989), 1462-1466.]]Google Scholar
- 20.Ouh-Young, M. Force Display in Molecular Docking. Ph.D. Dissertation, Computer Science Department, University of North Carolina, Chapel Hill, 1990.]] Google ScholarDigital Library
- 21.Pattabiraman, N. et al. Computer graphics and drug design: Real time docking, energy calculation and minimization. Journal of Computational Chemistry 6 (1985), 432-436.]]Google ScholarCross Ref
- 22.Smith, M.J. Tactile Interface for Three-Dimensional Computer-Simulated Environments: Experimentation and the Design of a Brake-Motor Device. M.S. Thesis, Mechanical Engineering Department., Massachusetts Institute of Technology, 1988.]]Google Scholar
- 23.Stark, L.W., Kim, W.S., Tendick, F. Cooperative control in telerobotics. Proc. IEEE International Conference on Robotics and Automation (Philadelphia, April 1988), 593-595.]]Google ScholarCross Ref
- 24.Steelman, H.S. The GROPE-I System: An Analysis of Friction and Backlash Problems. M.S. Thesis, Computer Science Department, University of North Carolina, Chapel Hill, 1968.]] Google ScholarDigital Library
- 25.Sutherland, I.E. The ultimate display. Information Processing 1965, Proc. IFIP Congress 65, 506-508.]]Google Scholar
- 26.Turk, G. Interactive Collision Detection for Molecular Graphics. M.S. thesis, Computer Science Department, University of North Carolina at Chapel Hill, 1989.]]Google Scholar
- 27.Weber, C.O. The properties of space and time in kinaesthetic fields of force. Am. J. of Psychology 38, 4 (1927), 597-606.]]Google ScholarCross Ref
- 28.Weber, C.O. The properties of space and time in kinaesthetic fields offorce. Am.J. of Psychology 41, 1 (1929), 95-105.]]Google ScholarCross Ref
- 29.Webster's New International Dictionary. 2nd ed. Merriam: Springfield, MA.]]Google Scholar
Index Terms
- Project GROPEHaptic displays for scientific visualization
Recommendations
Project GROPEHaptic displays for scientific visualization
We began in 1967 a project to develop a haptic+display for 6-D force fields of interacting protein molecules. We approached it in four stages: a 2-D system, a 3-D system tested with a simple task, a 6-D system tested with a simple task, and a full 6-D ...
A new haptic interaction and visualization approach for rigid molecular docking in virtual environments
Many biological activities take place through the physicochemical interaction of two molecules. This interaction occurs when one of the molecules finds a suitable location on the surface of the other for binding. This process is known as molecular ...
Comments