skip to main content
10.1145/3305275.3305280acmotherconferencesArticle/Chapter ViewAbstractPublication PagesisbdaiConference Proceedingsconference-collections
short-paper

Machine Learning Hyperparameter Fine Tuning Service on Dynamic Cloud Resource Allocation System - taking Heart Sounds as an Example

Published: 29 December 2018 Publication History

Abstract

The hyperparameters tuning of machine learning has always been a difficult and time-consuming task in deep learning area. In many practical applications, the hyperparameter tuning directly affects the accuracy. Therefore, the tuning optimization of hyperparameters is an important topic. At present, hyperparameters can only be set manually based on experience, and use Violent Enumeration, Random Search or through Grid Search to try and error, lack of effective automatic search parameters. In this study, we proposed a machine learning hyperparameter fine tuning service on dynamic cloud resource allocation system, which leverages several mainstream hyperparameter tuning methods such as Hyperopt and Optunity. In the meanwhile, various tuning methods are measured and compared by example application in this work. Finally, we dedicated actual case - Heart Sounds, and then tested it. In order to verify that the system service can not only automate the task of tuning, but also break through the limitation of the number of adjustable parameters. Furthermore the proposed hyperparameter fine tune system makes optimization process more efficient.

References

[1]
Matthias Feurer, Aaron Klein, Katharina Eggensperger, Jost Springenberg, Manuel Blum, and Frank Hutter, "Efficient and robust automated machine learning," in Advances in Neural Information Processing Systems, pages 2944--2952, 2015.
[2]
Chris Thornton, Frank Hutter, Holger H Hoos, and Kevin Leyton-Brown," Auto-WEKA: Combined selection and hyperparameter optimization of classification algorithms," in Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining, pages 847--855. ACM, 2013.
[3]
Ruben Martinez-Cantin, Nando de Freitas, Arnaud Doucet, and Jose A Castellanos," Active policy learning for robot planning and exploration under uncertainty," in Robotics: Science and Systems, pages 321--328, 2007.
[4]
Eric Brochu, Tyson Brochu, and Nando de Freitas," A bayesian interactive optimization approach to procedural animation design," in Proceedings of the 2010 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, pages 103--112. Eurographics Association, 2010.
[5]
Adam Coates, Honglak Lee, and Andrew Y Ng," An analysis of single-layer networks in unsuper- vised feature learning," JMLR workshop and conference proceedings, 15:215--223, 2011.
[6]
Jasper Snoek, Hugo Larochelle, and Ryan P Adams," Practical bayesian optimization of machine learning algorithms," in Advances in neural information processing systems, pages 2951--2959, 2012.
[7]
Frank Hutter, Holger H Hoos, and Kevin Leyton-Brown," Sequential model-based optimization for general algorithm configuration," in Learning and Intelligent Optimization, pages 507--523. Springer, 2011.
[8]
James Bergstra, Daniel Yamins, and David Cox," Making a science of model search: Hyperparameter optimization in hundreds of dimensions for vision architectures," in Proceedings of the 30th International Conference on Machine Learning, pages 115--123, 2013.
[9]
https://optunity.readthedocs.io/en/latest/user/installation.html
[10]
http://scikit-learn.org/stable/
[11]
Xavier-de Souza, S., Suykens, J. A., Vandewalle, J., & Bolle, D. (2010)," Coupled simulated annealing," Systems, Man, and Cybernetics, Part B: Cybernetics, IEEE Transactions on, 40(2), 320--335, 2010.
[12]
Hutter, F., Hoos, H. H., & Leyton-Brown, K. (2011)," Sequential model-based optimization for general algorithm configuration," in Learning and intelligent optimization (pp. 507--523). Springer, 2011.
[13]
https://kubernetes.io/
[14]
https://www.docker.com/
[15]
https://www.ansible.com/
[16]
https://www.physionet.org/challenge/

Cited By

View all
  • (2021)Maintaining proper health records improves machine learning predictions for novel 2019-nCoVBMC Medical Informatics and Decision Making10.1186/s12911-021-01537-321:1Online publication date: 27-May-2021

Index Terms

  1. Machine Learning Hyperparameter Fine Tuning Service on Dynamic Cloud Resource Allocation System - taking Heart Sounds as an Example

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Other conferences
      ISBDAI '18: Proceedings of the International Symposium on Big Data and Artificial Intelligence
      December 2018
      365 pages
      ISBN:9781450365703
      DOI:10.1145/3305275
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      In-Cooperation

      • International Engineering and Technology Institute, Hong Kong: International Engineering and Technology Institute, Hong Kong

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 29 December 2018

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. Grid Search
      2. Hyperopt
      3. Hyperparameters
      4. Optunity
      5. Random Search

      Qualifiers

      • Short-paper
      • Research
      • Refereed limited

      Conference

      ISBDAI '18

      Acceptance Rates

      ISBDAI '18 Paper Acceptance Rate 70 of 340 submissions, 21%;
      Overall Acceptance Rate 70 of 340 submissions, 21%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)3
      • Downloads (Last 6 weeks)0
      Reflects downloads up to 27 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2021)Maintaining proper health records improves machine learning predictions for novel 2019-nCoVBMC Medical Informatics and Decision Making10.1186/s12911-021-01537-321:1Online publication date: 27-May-2021

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media