Abstract
The Choquet integral (ChI), a parametric function for information aggregation, is parameterized by the fuzzy measure (FM), which has \(2^N\) real-valued variables for N inputs. However, the ChI incurs huge storage and computational burden due to its exponential complexity relative to N and, as a result, its calculation, storage, and learning becomes intractable for even modest sizes (e.g., \(N=15\)). Inspired by empirical observations in multi-sensor fusion and the more general need to mitigate the storage, computational, and learning limitations, we previously explored the binary ChI (BChI) relative to the binary fuzzy measure (BFM). The BChI is a natural fit for many applications and can be used to approximate others. Previously, we investigated different properties of the BChI and we provided an initial representation. In this article, we propose a new efficient learning algorithm for the BChI, called EBChI, by utilizing the BFM properties that add at most one variable per training instance. Furthermore, we provide an efficient representation of the BFM (EBFM) scheme that further reduces the number of variables required for storage and computation, thus enabling the use of the BChI for “big N”. Finally, we conduct experiments on synthetic data that demonstrate the efficiency of our proposed techniques.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Price, S.R., Murray, B., Hu, L., Anderson, D.T., Havens, T.C., Luke, R.H., Keller, J.M.: Multiple kernel based feature and decision level fusion of iECO individuals for explosive hazard detection in FLIR imagery. In: SPIE, vol. 9823, pp. 98231G–98231G–11 (2016)
Tahani, H., Keller, J.: Information fusion in computer vision using the fuzzy integral. IEEE Trans. Syst. Man Cybern. 20, 733–741 (1990)
Grabisch, M., Nicolas, J.M.: Classification by fuzzy integral: performance and tests. Fuzzy Sets Syst. 65(2–3), 255–271 (1994)
Grabisch, M., Sugeno, M.: Multi-attribute classification using fuzzy integral. In: IEEE International Conference on Fuzzy Systems, pp. 47–54. IEEE (1992)
Mendez-Vazquez, A., Gader, P., Keller, J.M., Chamberlin, K.: Minimum classification error training for Choquet integrals with applications to landmine detection. IEEE Trans. Fuzzy Syst. 16(1), 225–238 (2008)
Keller, J.M., Gader, P., Tahani, H., Chiang, J., Mohamed, M.: Advances in fuzzy integration for pattern recognition. Fuzzy Sets Syst. 65(2–3), 273–283 (1994)
Gader, P.D., Keller, J.M., Nelson, B.N.: Recognition technology for the detection of buried land mines. IEEE Trans. Fuzzy Syst. 9(1), 31–43 (2001)
Grabisch, M.: The application of fuzzy integrals in multicriteria decision making. Eur. J. Oper. Res. 89(3), 445–456 (1996)
Labreuche, C.: Construction of a Choquet integral and the value functions without any commensurateness assumption in multi-criteria decision making. In: EUSFLAT Conference, pp. 90–97 (2011)
Tomlin, L., Anderson, D.T., Wagner, C., Havens, T.C., Keller, J.M.: Fuzzy integral for rule aggregation in fuzzy inference systems. In: Carvalho, J.P., Lesot, M.-J., Kaymak, U., Vieira, S., Bouchon-Meunier, B., Yager, R.R. (eds.) IPMU 2016. CCIS, vol. 610, pp. 78–90. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-40596-4_8
Pinar, A.J., Rice, J., Hu, L., Anderson, D.T., Havens, T.C.: Efficient multiple kernel classification using feature and decision level fusion. IEEE Trans. Fuzzy Syst. PP(99), 1 (2016)
Pinar, A., Havens, T.C., Anderson, D.T., Hu, L.: Feature and decision level fusion using multiple kernel learning and fuzzy integrals. In: 2015 IEEE International Conference on Fuzzy Systems, FUZZ-IEEE, pp. 1–7, August 2015
Hu, L., Anderson, D.T., Havens, T.C., Keller, J.M.: Efficient and scalable nonlinear multiple kernel aggregation using the Choquet integral. In: Laurent, A., Strauss, O., Bouchon-Meunier, B., Yager, R.R. (eds.) IPMU 2014. CCIS, vol. 442, pp. 206–215. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-08795-5_22
Hu, L., Anderson, D.T., Havens, T.C.: Multiple kernel aggregation using fuzzy integrals. In: 2013 IEEE International Conference on Fuzzy Systems, FUZZ-IEEE, pp. 1–7, July 2013
Grabisch, M., Nguyen, H.T., Walker, E.A.: Fundamentals of Uncertainty Calculi with Applications to Fuzzy Inference, vol. 30. Springer Science & Business Media, Dordrecht (2013)
Keller, J.M., Osborn, J.: Training the fuzzy integral. Int. J. Approx. Reason. 15(1), 1–24 (1996)
Keller, J.M., Osborn, J.: A reward/punishment scheme to learn fuzzy densities for the fuzzy integral. In: Proceedings of the International Fuzzy Systems Association World Congress, pp. 97–100 (1995)
Mendez-Vazquez, A., Gader, P.: Sparsity promotion models for the Choquet integral. In: IEEE Symposium on Foundations of Computational Intelligence, FOCI 2007, pp. 454–459. IEEE (2007)
Beliakov, G.: Construction of aggregation functions from data using linear programming. Fuzzy Sets Syst. 160(1), 65–75 (2009)
Islam, M.A., Anderson, D.T., Pinar, A.J., Havens, T.C.: Data-driven compression and efficient learning of the Choquet integral. IEEE Trans. Fuzzy Syst. PP(99), 1 (2017)
Anderson, D.T., Islam, M., King, R., Younan, N.H., Fairley, J.R., Howington, S., Petry, F., Elmore, P., Zare, A.: Binary fuzzy measures and Choquet integration for multi-source fusion. In: 6th International Conference on Military Technologies, May 2017
Du, X., Zare, A., Keller, J.M., Anderson, D.T.: Multiple instance Choquet integral for classifier fusion. In: 2016 IEEE Congress on Evolutionary Computation, CEC, pp. 1054–1061, July 2016
Anderson, D.T., Price, S.R., Havens, T.C.: Regularization-based learning of the Choquet integral. In: 2014 IEEE International Conference on Fuzzy Systems, FUZZ-IEEE, pp. 2519–2526, July 2014
Cho, S.B., Kim, J.H.: Combining multiple neural networks by fuzzy integral for robust classification. IEEE Trans. Syst. Man Cybern. 25(2), 380–384 (1995)
Olsson, C., Eriksson, A.P., Kahl, F.: Solving large scale binary quadratic problems: spectral methods vs. semidefinite programming. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2007, pp. 1–8. IEEE (2007)
Glover, F., Kochenberger, G.A., Alidaee, B.: Adaptive memory tabu search for binary quadratic programs. Manag. Sci. 44(3), 336–345 (1998)
Sperner, E.: Ein satz über untermengen einer endlichen menge. Math. Z. 27(1), 544–548 (1928)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Islam, M.A., Anderson, D.T., Du, X., Havens, T.C., Wagner, C. (2018). Efficient Binary Fuzzy Measure Representation and Choquet Integral Learning. In: Medina, J., et al. Information Processing and Management of Uncertainty in Knowledge-Based Systems. Theory and Foundations. IPMU 2018. Communications in Computer and Information Science, vol 853. Springer, Cham. https://doi.org/10.1007/978-3-319-91473-2_10
Download citation
DOI: https://doi.org/10.1007/978-3-319-91473-2_10
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-91472-5
Online ISBN: 978-3-319-91473-2
eBook Packages: Computer ScienceComputer Science (R0)