Abstract
In this paper we make use of two highly efficient second order neural network training algorithms, namely the LMAM (Levenberg-Marquardt with Adaptive Momentum) and OLMAM (OptimizedLevenberg-Marquardt with Adaptive Momentum), for the construction of an efficient pap-smear test classifier. The algorithms are methodologically similar, and are based on iterations of the form employed in the Levenberg-Marquardt (LM) method for non-linear least squares problems with the inclusion of an additional adaptive momentum term arising from the formulation of the training task as a constrained optimization problem. The classification results obtained from the application of the algorithms on a standard benchmark pap-smear data set reveal the power of the two methods to obtain excellent solutions in difficult classification problems whereas other standard computational intelligence techniques achieve inferior performances.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Ampazis, N., Perantonis, S.J.: Levenberg-Marquardt Algorithm with Adaptive Momentum for the Efficient Training of Feedforward Networks. In: Proceedings of International Joint Conference on Neural Networks IJCNN 2000, Como, Italy (2000)
Ampazis, N., Perantonis, S.J.: Two Highly Efficient Second Order Algorithms for Training Feedforward Networks. IEEE Transactions on Neural Networks 13 (5), 1064–1074 (2002)
Angeline, P.J., Kinnear Jr., K.E.: Advances in Genetic Programming, vol. 2. MIT Press, Cambridge (1996)
Babuska, R.: Fuzzy Modeling for Control. Kluwer Academic Publishers, Dordrecht (1998)
Byriel J.: Neuro-Fuzzy Classification of Cells in Cervical Smears. MSc Thesis, Technical University of Denmark, Dept. of Automation (1999), http://fuzzy.iau.dtu.dk/download/byriel99.pdf
Fahlman, S.E.: Faster-Learning Variations on Back-Propagation: An Empirical Study. In: Proceedings of the 1988 Connectionist Models Summer School, Morgan Kaufmann, San Francisco (1988)
Furnkranz, J.: Pruning Algorithms for Rule Learning. Machine Learning 27, 139–171 (1997)
Gilbert, J.C., Nocedal, J.: Global convergence properties of conjugate gradient methods for optimization. SIAM J. on Optimization 2 (1) (1992)
Goldberg, D.E.: Genetic Algorithms in Search, Optimization and Machine Learning. Addison-Wesley, Reading (1989)
Gonzalez, R.C., Woods, R.E.: Digital Image Processing. Addison-Wesley, Reading (1993)
Gruau, F.: On Using Syntactic Constraints with Genetic Programming. In: Angeline, P.J., Jinnear Jr., K.E. (eds.) Advances in Genetic Programming, MIT Press, Cambridge (1996)
Hagan, M.T., Menhaj, M.: Training feedforward networks with the Marquardt algorithm. IEEE Transactions on Neural Networks 5 (6), 989–993 (1994)
Jang, J.-S.R.: Neuro-fuzzy modeling for nonlinear dynamic system identification. In: Ruspini, E.H., Bonissone, P.P., Pedrycz, W. (eds.) Handbook of Fuzzy Computation, Institute of Physics Publishing, Dirak House, Temple Back, Bristol BS1 6BE UK (1998)
Jang, J.-S.R.: ANFIS: Adaptive-Network-based Fuzzy Inference Systems. IEEE Transactions on Systems, Man and Cybernetics 23 (3), 665–685 (1993)
Jantzen, J.: Neurofuzzy Modelling. Technical University of Denmark: Oersted-DTU, Tech report no 98-H-874 (nfmod), (1998), http://fuzzy.iau.dtu.dk/download/nfmod.pdf
Koss, L.: The Application of PAPNET to Diagnostic Cytology. In: Lisboa, P., Ifeachor, E., Szczepaniak, P. (eds.) Artificial Neural Networks in Biomedicine, pp. 51–68. Springer, Heidelberg (2000)
Koza, J.R.: Genetic Programming II - Automatic Discovery of Reusable Programs. MIT Press, Cambridge (1994)
Koza, J.R.: Genetic Programming - On the Programming of Computers by Means of Natural Selection. MIT Press, Cambridge (1992)
Koza, J.R., Bennett III, F.H., Andre, D., Keane, M.A.: Genetic Programming III. Morgan Kaufmann Publishers, Inc., San Francisco (1999)
Erik, M.: Pap-Smear Classification, MSc Thesis, Technical University of Denmark, Oersted-DTU, Automation (2003)
Matthews, B.W.: Comparison of the predicted and observed secondary structure of T4 phage lysozyme. Biochemica et Biophysica Acta 405, 442–551 (1975)
Meisels, A., Morin, C.: Cytopathology of the Uterus, 2nd edn. ASCP Press (1997)
Perantonis, S.J., Karras, D.A.: An efficient constrained learning algorithm with momentum acceleration. Neural Networks 8, 237–249 (1995)
Quinlan, J.R.: Boosting First Order Learning. In: Arikawa, S., Sharma, A.K. (eds.) ALT 1996. LNCS, vol. 1160, pp. 1–11. Springer, Heidelberg (1996)
Quinlan, J.R.: Boosting, Bagging, and C4.5. In: Proc. of the 13th National Conf. on AI, Portland, Oregon, USA, pp. 725–730. AAAI Press, Menlo Park (1996)
Quinlan, J.R.: C4.5: Programs for Machine Learning. Morgan Kaufmann, San Mateo (1993)
Schapire, R.: The strategy of weak learnability. Machine Learning 5(2), 197–227 (1990)
Tsakonas, A., Dounias, G., Jantzen, J., Axer, H., Bjerregaard, B., von Keyserlingk, D.G.: Evolving Rule Based Systems in two Medical Domains Using Genetic Programming. AIM Journal (2003) (to appear); Artificial Intelligence in Medicine, Elsevier
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ampazis, N., Dounias, G., Jantzen, J. (2004). Pap-Smear Classification Using Efficient Second Order Neural Network Training Algorithms. In: Vouros, G.A., Panayiotopoulos, T. (eds) Methods and Applications of Artificial Intelligence. SETN 2004. Lecture Notes in Computer Science(), vol 3025. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24674-9_25
Download citation
DOI: https://doi.org/10.1007/978-3-540-24674-9_25
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-21937-8
Online ISBN: 978-3-540-24674-9
eBook Packages: Springer Book Archive