Skip to main content
SpringerLink
Log in

Neural Networks in Advanced Computational Problems

  • Conference paper
Neural Networks in the Analysis and Design of Structures

Part of the book series: CISM International Centre for Mechanical Sciences ((CISM,volume 404))

  • 326 Accesses

Abstract

It this chapter we discuss the use of parallel processing for the training of back propagation neural networks. This leads to a discussion of how neural networks and genetic algorithms may be utilised for preprocessing large finite element problems for parallel or distributed finite element analysis. This preprocessing is the partitioning of the finite element mesh into subdomains to ensure load balancing and minimum interprocessor communication during the parallel finite element analysis on a MIMD distributed memory computer.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. B.H.V. Topping, and J. Sziveri, “Parallel Processing, Neural Networks and Genetic Algorithms”, Proceedings of the Second International Conference on Computer Applications Research and Practice, v3, University of Bahrain, April, 1996.

    Google Scholar 

  2. B.H.V. Topping and A.I. Khan, “Parallel Finite Element Computations”, Saxe-Coburg Publications, Edinburgh, U.K., 1996.

    Google Scholar 

  3. A. Geist, A. Beguelin, J. Dongarra, W. Jiang, R. Manchek, V. Sunderam, “PVM: Parallel Virtual Machine — A User’s Guide and Tutorial for Network Parallel Computing” The MIT Press, Cambrideg, Massachusetts, U.S.A., 1994.

    MATH  Google Scholar 

  4. W. Gropp, E. Lusk, A. Skjellum., “Using MPI — Portable Parallel Programming with the Message-Passing System”, THe MIT Press, Cambridge, Massachusetts, U.S.A., 1995.

    Google Scholar 

  5. Donald O. Hebb, “The Organization of Behavior”, Wiley Publication Company, New York, U.S.A., 1949.

    Google Scholar 

  6. C. C. Jorgensen, “Neural Network Representation of Sensor Graphs in Autonomous Robot Path Planning”, IEEE First Int. Conf. on Neural Networks IV, 507–515, San Diego, U.S.A., June 1987.

    Google Scholar 

  7. P. Van Der Smagt, B. J. A. Kröse, “A Real Time Learning Neural Robot Controller”, in Proceedings of the 1991 Int. Conf. on Artificial Neural Networks, 351–356, Espoo, Finland, June 1991.

    Google Scholar 

  8. W. T. Miller III, “Real Time Application of Neural Networks for Sensor-Based Control of Robot with Vision”, IEEE Transactions on Systems, Man and Cybernetics 19, 825–831, August, 1989.

    Google Scholar 

  9. K. Fukushima, “Neocognitron: A Hierarchical Neural Network Capable of Visual Pattern. Recognition”, Neural Networks 1, 119–130, 1988,

    Article  Google Scholar 

  10. C. Mead, “Analog VLSI and Neural Systems”, Addison-Wesley, Reading, MA, U.S.A., 1989.

    Book  MATH  Google Scholar 

  11. D. Marr, “Vision”, W. H. Freeman, San Francisco, U.S.A., 1982.

    Google Scholar 

  12. Y. Izui, A. Pentland, “Speeding Up Back Propagation” in M. Caudill, (Editor), Theory Track Neural & Cognitive Sciences Track of the Proceedings of the International Joint Conference on Neural Networks, IJCNN-90-WASH-DC, Lawrence Erlbaum Associates, Publishers, New Jersey, United States of America, Vol. 1, 639–642, 1990

    Google Scholar 

  13. M. Hagiwara, “Accelerated Back Propagation using Unlearning based on Hebb Rule”, in M. Caudill, (Editor), Theory Track Neural & Cognitive Sciences Track of the Proceedings of the International Joint Conference on Neural Networks, IJCNN-90-WASH-DC, Lawrence Erlbaum Associates, Publishers, New Jersey, United States of America, Vol. 1, 617–620, 1990

    Google Scholar 

  14. S-B. Cho, J. H. Kim, “An Accelerated Learning Method with Backpropagation” in M. Caudill, (Editor), Theory Track Neural & Cognitive Sciences Track of the Proceedings of the International Joint Conference on Neural Networks, IJCNN-90-WASH-DC, Lawrence Erlbaum Associates, Publishers, New Jersey, United States of America, Vol. 1, 605–608, 1990

    Google Scholar 

  15. D. E. Rumelhart, G. E. Hinton, R. J. Williams, “Learning Internal Representation by Error Propagation”, in D. E. Rumelhart and J. L. McClelland (Eds.) Parallel Distributed Processing: Explorations in the Microstructure of Cognition, Vol. 1 : Foundations., MIT Press, 1986.

    Google Scholar 

  16. A. I. Khan, B. H. V. Topping, A. Bahreininejad, “Parallel Training of Neural Networks for Finite Element Mesh Generation” in B. H. V. Topping and A. I. Khan (Eds.), Neural Networks and Combinatorial Optimization in Civil and Structural Engineering, 81–94, Civil-Comp Press, Edinburgh, U.K., 1993.

    Google Scholar 

  17. Ken L. Parker, Allison L. Thornbrugh, “Parallelized BP Training and Its Effectiveness”, in M. Caudill, (Editor), Theory Track Neural & Cognitive Sciences Track of the Proceedings of the International Joint Conference on Neural Networks, IJCNN-90-WASH-DC, Lawrence Erlbaum Associates, Publishers, New Jersey, United States of America, Vol. 2, 179–182, 1990

    Google Scholar 

  18. C. Peterson, T. Rognvaldsson, “An Introduction to Artificial Neural Networks”, C. Verkerk (Ed.), Proceedings of 1991 CERN School of Computing, CERN Vol. 92, No. 2, 113–170, May 1992.

    Google Scholar 

  19. A. Bahreininejad, B.H.V. Topping and A.I. Khan, “Subdomain Generation Using Multiple Neural Networks Models”, in B. H. V. Topping, M. Papadrakakis, (Eds.) Parallel and Vector Processing for Structural Mechanics, Civil-Comp Press, Edinburgh, 1994.

    Google Scholar 

  20. B.H.V. Topping, A. Bahreininejad, “Subdomain Generation Using Parallel Q-state Potts Neural Networks Multiple Neural Networks Models”, in B. H. V. Topping, (Editor) Developments in Neural Networks and Evolutionary Computing for Civil and Structural Engineering, 65–78, Civil-Comp Press, Edinburgh, 1995.

    Chapter  Google Scholar 

  21. J.J. Hopfield, D.W. Tank, “Neural Computation of Decisions in Optimization Problems”, Biological Cybernetics, Vol. 52, 141–152, 1985.

    MATH  MathSciNet  Google Scholar 

  22. S. Kirkpatrick, CD. Gelatt Jr., M.P. Vecchi, “Optimization by Simulated Annealing”, Science, 220:4598, 671–680, 1983.

    Article  MATH  MathSciNet  Google Scholar 

  23. F.Y. Wu, “The Potts Model”, Reviews of Modern Phys., Vol. 54, No. 1, 235–268, 1982.

    Article  Google Scholar 

  24. K.H. Fischer, J.A. Hertz, “Spin Glasses”, Cambridge University Press, UK, 1991.

    Book  Google Scholar 

  25. J.M. Yeomans, “Statistical Mechanics of Phase Transition”, Oxford University Press, U.S.A., 1992.

    Google Scholar 

  26. J. Hertz, A. Krogh and R.G. Palmer, “Introduction to the Theory of Neural Computing”, Addison-Wesley Publication Company, U.S.A., 1991.

    Google Scholar 

  27. G. Bilbro, R. Mann, T.K. Miller III, W.E. Snyder, D. E. Van den Bout, M. White, “Optimization by Mean Field Annealing”, David S. Touretzky (Ed), Advances in Neural Information Processing Systems 1, Morgan Kaufmann Pub. Inc., 91–98, 1989.

    Google Scholar 

  28. C. Peterson, J.R. Anderson, “Neural Networks and NP-complete Optimization Problems; A Performance Study on the Graph Bisection Problem”, Complex Systems, Vol. 2, No. 1, 59–89, 1988.

    MATH  MathSciNet  Google Scholar 

  29. C. Peterson, B. Söderberg, “A New Method for Mapping Optimization Problems onto Neural Networks”, Int. J. Neural Syst., Vol. 1, No. 1, 3–22 , 1989.

    Article  Google Scholar 

  30. C. Peterson, J. R. Anderson, “A Mean Field Learning Algorithm for Neural Networks”, Complex Systems, Vol. 1, 995–1019, 1987.

    MATH  Google Scholar 

  31. A.I. Khan, B.H.V. Topping, “Parallel adaptive mesh generation”, Computing Systems in Engineering, vol. 2, No. 1, 75–102, 1991.

    Article  Google Scholar 

  32. A.I. Khan, B.H.V. Topping, “Subdomain Generation for Parallel Finite Element Analysis 77, Computing Systems in Engineering. Vol. 4, Nos. 4–6, 473–488, 1993.

    Article  Google Scholar 

  33. A. Bertoni, M. Dorigo, “Implicit Parallelism in Genetic Algorithms”, Artificial Intelligence, V 61, N 2, 307–314, 1993.

    Article  MATH  MathSciNet  Google Scholar 

  34. J.J. Grefenstette, J.E. Baker, “How Genetic Algorithms Work: A Critical Look at Implicit Parallelism”, Proceedings of the Third International Conference on Genetic Algorithms, Morgan Kaufmann Publishers, Inc, 70–79, Virginia, U.S.A., 1989.

    Google Scholar 

  35. Mühlenbein, H, Schleuter, M G- and Krämer, O (1988) “Evolution Algorithms in Combinatorial Optimization”, Parallel Computing, V 7, N 1, 65–88, 1988.

    Article  MATH  Google Scholar 

  36. Pettey, C C, Leuze, M R and Grefenstette, J J (1987) “A Parallel Genetic Algorithm”, Genetic Algorithms and Their Applications: Proceedings of the Second International Conference on Genetic Algorithms, Lawrence Erlbaum Associates Publishers, 155–161, Cambridge, MA, U.S.A., 1987.

    Google Scholar 

  37. Tanese, R (1987) “Parallel Genetic Algorithm for a Hypercube”, Genetic Algorithms and Their Applications: Proceedings of the Second International Conference on Genetic Algorithms, Lawrence Erlbaum Associates Publishers, pp 177–183, Cambridge, MA, U.S.A., 1987.

    Google Scholar 

  38. Collins, R J and Jefferson, D J (1991) “Selection in Massively Parallel Genetic Algorithms”, Proceedings of the Fourth International Conference on Genetic Algorithms, Morgan Kaufmann Publishers, Inc, pp 249–256, San Diego, CA, U.S.A., 1991.

    Google Scholar 

  39. Manderick, B and Spiessens, P (1989) “Fine-Grained Parallel Genetic Algorithms”, Proceedings of the Third International Conference on Genetic Algorithms, Morgan Kaufmann Publishers, Inc, pp 428–433, Virginia, U.S.A., 1989.

    Google Scholar 

  40. Schleuter, M G- (1992) “Comparison of Local Mating Strategies in Massively Parallel Genetic Algorithms”, Proceedings of Parallel Problem Solving by Nature, 2, R Männer and B Manderick (Editors), Elsevier Science Publishers B V, pp 65–74, Brussels, Belgium, 1992.

    Google Scholar 

  41. Grefenstette, J J (1981) “Parallel Adaptive Algorithms for Function Optimization”, Technical Report N CS-81–19, Vanderbilt University, Computer Science Department, Nashville, U.S.A., 1981.

    Google Scholar 

  42. Leite, J P B and Topping, B H V (1995) “Improved Genetic Operators for Structural Engineering Optimization”, CIVIL-COMP95, Proceedings of the Sixth International Conference on Civil and Structural Engineering Computing: Developments in Computational Techniques for Structural Engineering, in Developments in Neural Networks and Evolutionary Computing for Civil and Structural Engineering, Civil-Comp Press, 151–165, Cambridge, UK., 1995

    Google Scholar 

  43. T.C. Fogarty, Huang, R. (1990) “Implementing the Genetic Algorithms on Transputer Based Parallel Processing Systems”, Proceedings of Parallel Problem Solving by Nature, H-P Schwefel & R Männer (Editors), Springer-Verlag Publishers, 145–149, Dortmund, FRG, 1990.

    Google Scholar 

  44. P. Neuhaus, “Solving the Mapping-Problem — Experiences with a Genetic Algorithm”, Proceedings of Parallel Problem Solving by Nature, H-P Schwefel & R Männer (Editors), Springer-Verlag Publishers, 170–175, Dortmund, FRG., 1990.

    Google Scholar 

  45. S. Wright, “Stochastic Process in Evolution”, Stochastic Models in Medicine and . Biology, J Gurland, Ed, University of Wisconsin Press, 199–241, U.S.A., 1964.

    Google Scholar 

  46. R. Shonkwiler, F. Mendivil, A. Deliu, “Genetic Algorithms for 1-D Fractal Inverse Problem”, Proceedings of the Fourth International Conference on Genetic Algorithms, Morgan Kaufmann Publishers, Inc, 495–501, San Diego, CA, U.S.A., 1991.

    Google Scholar 

  47. R. Shonkwiler, “Parallel Genetic Algorithms”, Proceedings of the Fifth International Conference on Genetic Algorithms, Morgan Kaufmann Publishers, Inc, 495–501, Illinois, U.S.A., 1993.

    Google Scholar 

  48. B.H.V. Topping, J.P.B. Leite, “Parallel Genetic Models for Structural Optimization”, Submitted to publication, 1996.

    Google Scholar 

  49. N. Mansour, G.C. Fox, “A Hybrid Genetic Algorithm for Task Allocation in Multicomputers”, Proceedings of the Fourth International Conference on Genetic Algorithms, Morgan Kaufmann Publishers, Inc, 466–473, San Diego, CA, U.S.A., 1991.

    Google Scholar 

  50. H. Mühlenbein, M. Schomisch, J. Born, “The Parallel Genetic Algorithm as Function Optimizer”, Proceedings of the Fourth International Conference on Genetic Algorithms, Morgan Kaufmann Publishers, Inc, 271–278, Virginia, U.S.A., 1991.

    Google Scholar 

  51. E.-G. Talbi, P. Brassière, “A Parallel Genetic Algorithm for the Graph Partitioning Problem”, ACM International Conference on Supercomputing. Cologne, Germany, 1991

    Google Scholar 

  52. R Jog, J.Y. Suh, D.V. Gucht, “Parallel Genetic Algorithms Applied to the Travelling Salesman Problem”, SIAM Journal of Optimization, V 1, N 4, 515–529, 1991

    Google Scholar 

  53. S.-C. Lin, W.F. Punch, E.D. Goodman, “Coarse-Grain Parallel Genetic Algorithms: Categorization and New Approach”, Accepted for publication, Parallel and Distributed Processing, Dallas, TX, U.S.A., 1994.

    Google Scholar 

  54. W.F. Punch, R.C. Averill, E.D. Goodman, S.-C. Lin, Y. Ding, Y.C. Yip, “Optimal Design of Laminated Composite Structures using Coarse-Grain Parallel Genetic Algorithms”, Computing Systems in Engineering, V 5, N 4–6, 415–423, 1994.

    Google Scholar 

  55. H. Adeli and N-T. Cheng, “Concurrent Genetic Algorithms for Optimization of Large Structures”, ASCE — Journal of Aerospace Engineering, V 7, N 3, 276–296, 1994.

    Article  Google Scholar 

  56. H. Adeli and S. Kummar, “Distributed Genetic Algorithm for Structural Optimization”, ASCE — Journal of Aerospace Engineering, V 8, N 3, 156–163, 1995.

    Article  Google Scholar 

  57. H. Adeli and S. Kummar, “Concurrent Structural Optimization on Massively Parallel Supercomputer”, ASCE — Journal of Structural Engineering, V 121, N 11, 1588–1597, 1995.

    Article  Google Scholar 

  58. A.I. Khan and B.H.V. Topping, “Parallel Adaptive Mesh Generation”, Computing Systems in Engineering, Vol. 2, No 1, pp. 75–102, Pergamon Press, UK, 1991.

    Article  Google Scholar 

  59. B.H.V. Topping and B. Cheng, “Parallel Adaptive Quadrilateral Mesh Generation”, in Advances in Computational Structures Technology, Civil-Comp Press, Edinburgh, UK, 1996.

    Google Scholar 

  60. A.I. Khan and B.H.V. Topping, “Sub-domain Generation for Parallel Finite Element Analysis”, Computing Systems in Engineering, Vol. 4, Nos 4–6, pp. 473–488, Pergamon Press, UK, 1993.

    Article  Google Scholar 

  61. D. E. Rumelhart, G. E. Hinton and R. J. Williams, “Learning Internal Representation by Error Propagation”, in D.E. Rumelhart and J. L. McClelland (Eds.) Parallel Distributed Processing: Explorations in the Microstructure of Cognition, Vol. 1: Foundations., MIT Press, U.S.A., 1986.

    Google Scholar 

  62. A.I. Khan, B.H.V Topping and A. Bahreininejad, “Parallel Training of Neural Networks for Finite Element Mesh Generation”, Neural Networks and Combinatorial Optimization in Civil and Structural Engineering, 81–94, Civil-Comp Press, Edinburgh, UK, 1993.

    Google Scholar 

  63. B.H.V. Topping and A. Bahreininejad, “Neural Computing for Sturctural Mechanics” Saxe-Coburg Publications, Edinburgh, UK, 1996.

    Google Scholar 

  64. B.H.V. Topping and J. Sziveri, “Parallel Sub-domain Generation Method”, Developments in Computational Techniques for Structural Engineering, 449–457, Civil-Comp Press, Edinburgh, UK, 1995.

    Google Scholar 

  65. J. Sziveri, B. Cheng, A. Bahreininejad, J. Cai, G. Thierauf and B.H.V. Topping, “Parallel Quadrilateral Subdomain Generation”, in Advances in Computational Structures Technology, Civil-Comp Press, Edinburgh, UK, 1996.

    Google Scholar 

  66. P. T. Baffes, Nets User’s Guide, version 2.01, NASA, Lyndon B. Johnson Space Center, U.S.A., 1989.

    Google Scholar 

  67. B.H.V. Topping and A.L Khan, “Parallel Computation Schemes for Dynamic Relaxation”, Engineering Computations, Vol. 11, 513–548, Pineridge Press Ltd, Swansea, UK, 1994

    Article  MATH  Google Scholar 

  68. A.I. Khan and B.H.V. Topping, “A Transputer Routing Algorithm for Non-linear or Dynamic Finite Element Analysis”, Engineering Computations, Vol. 11, 549–564, Pineridge Press Ltd, Swansea, UK, 1994

    Article  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Heriot-Watt University, Edinburgh, UK

    B. H. V. Topping, A. I. Khan, J. Sziveri, A. Bahreininejad, J. P. B. Leite, B. Cheng & P. Iványi

Authors
  1. B. H. V. Topping
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. A. I. Khan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. J. Sziveri
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. A. Bahreininejad
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. J. P. B. Leite
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. B. Cheng
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. P. Iványi
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Cracow University of Technology, Poland

    Zenon Waszczyszyn

Rights and permissions

Reprints and permissions

Copyright information

© 1999 Springer-Verlag Wien

About this paper

Cite this paper

Topping, B.H.V. et al. (1999). Neural Networks in Advanced Computational Problems. In: Waszczyszyn, Z. (eds) Neural Networks in the Analysis and Design of Structures. CISM International Centre for Mechanical Sciences, vol 404. Springer, Vienna. https://doi.org/10.1007/978-3-7091-2484-0_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-7091-2484-0_5

  • Publisher Name: Springer, Vienna

  • Print ISBN: 978-3-211-83322-3

  • Online ISBN: 978-3-7091-2484-0

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation