Skip to main content

A Concept for the Application of Reinforcement Learning in the Optimization of CAM-Generated Tool Paths

  • Conference paper
  • First Online:
Machine Learning for Cyber Physical Systems

Part of the book series: Technologien für die intelligente Automation ((TIA))

Abstract

Cyber physical systems (CPS) are changing the way machine tools function and operate. As the CAD-CAM-CNC tool chain gains intelligence the boundaries of the elements of the tool chain become blurred and new features, based on advancements in artificial intelligence can be integrated. The main task of the CAD-CAM-CNC chain is to generate the cutter trajectories for the manufacturing operation. Driven by sustainability and the need for capacity, the need arises to optimize the paths through this tool chain. In this paper a concept for path optimization with reinforcement learning is proposed, with focus on the reward function, specific to tool path optimization via the channel method.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Mikusz, Martin and Csiszar, Akos, CPS Platform Approach to Industrial Robots: State of the Practice, Potentials, Future Research Directions, PACIS 2015 Proceedings, 2015

    Google Scholar 

  2. Friedrich, Jens and Hinze, Christoph and Renner, Anton and Verl, Alexander and Lechler, Armin, Estimation of stability lobe diagrams in milling with continuous learning algorithms. Robotics and Computer-Integrated Manufacturing, 2015

    Google Scholar 

  3. Nalbant, Muammer and Gokkaya, Hasan and Toktas, Iahsan, Comparison of Regression and Artificial Neural Network Models for Surface Roughness Prediction with the Cutting Parameters in CNC Turning, Model. Simul. Eng., vol. 2007, pp. 3:1–3:14, 2007

    Google Scholar 

  4. Peters, Jan and Schaal, Stefan, Learning to control in operational space, The International Journal of Robotics Research, vol. 27, no. 2, pp. 197-212, 2008

    Google Scholar 

  5. B. Bócsi and D. Nguyen-Tuong and L. Csató and B. Schölkopf and J. Peters, Learning inverse kinematics with structured prediction, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2011

    Google Scholar 

  6. W. D. Smart and L. Pack Kaelbling, Effective reinforcement learning for mobile robots, Robotics and Automation, 2002. Proceedings. ICRA ’02. IEEE International Conference on, 2002

    Google Scholar 

  7. Chansophea Chuon, Sumanta Guha, Paul Janecek, Nguyen Duc Cong Song, Simplipoly: Curvature-Based Polygonal Curve Simplification, Int. J. Comput. Geometry Appl., vol. 21, no.4, 2011

    Google Scholar 

  8. Douglas, David H. and Peucker, Thomas K., Algorithms for the Reduction of the Number of Points Required to Represent a Digitized Line or its Caricature, John Wiley & Sons, Ltd, 2011

    Google Scholar 

  9. P. Ziegler, Apriori G-Code Analyse und Optimierung unter Berücksichtigung dynamischer Eigenschaften einerWerkzeugmaschine, in German, Study Thesis at the University of Stuttgart, 2015

    Google Scholar 

  10. Berglund, T. and Erikson, U. and Jonsson, H. and Mrozek, K. and Söderkvist, I. and AB, Q. Navigator, Automatic generation of smooth paths bounded by polygonal chains, Citeseer, 2001

    Google Scholar 

  11. Myles, Ashish and Peters, Jörg, Threading splines through 3D channels, Computer-Aided Design, vol. 37, no.2 , 2005

    Google Scholar 

  12. Bézier, Pierre E, How Renault uses numerical control for car body design and tooling, SAE Technical Paper, 1968

    Google Scholar 

  13. Salomon David, Curves and surfaces for computer graphics, Springer Science & Business Media, 2007

    Google Scholar 

  14. Sutton, Richard S. and Barto, Andrew G., Reinforcement learning: An introduction, MIT press, 1998

    Google Scholar 

  15. Kaelbling, Leslie Pack and Littman, Michael L. and Moore, Andrew W., Reinforcement learning: A survey, Journal of artificial intelligence research, pp. 237 – 285, 1996

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Caren Dripke .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer-Verlag GmbH Germany

About this paper

Cite this paper

Dripke, C., Höhr, S., Csiszar, A., Verl, A. (2017). A Concept for the Application of Reinforcement Learning in the Optimization of CAM-Generated Tool Paths. In: Beyerer, J., Niggemann, O., Kühnert, C. (eds) Machine Learning for Cyber Physical Systems. Technologien für die intelligente Automation. Springer Vieweg, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-53806-7_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-662-53806-7_1

  • Published:

  • Publisher Name: Springer Vieweg, Berlin, Heidelberg

  • Print ISBN: 978-3-662-53805-0

  • Online ISBN: 978-3-662-53806-7

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics