skip to main content
10.1145/3297067.3297075acmotherconferencesArticle/Chapter ViewAbstractPublication PagesspmlConference Proceedingsconference-collections
research-article

An Online Transfer Learning Algorithm with Adaptive Cost

Published: 28 November 2018 Publication History

Abstract

Online transfer learning aims to attack an online learning task on a target domain by transferring knowledge from some source domains, which has received more attentions. And most online transfer learning methods adapt the classifier according to its accuracy on new coming data. However, in real-world applications, such as anomaly detection and credit card fraud detection, the cost may be more important than the accuracy. Moreover, the cost usually changes in these online data, which challenges state-of-art-methods. Therefore, this paper introduces the cost of misclassification into transfer-learning of classifier, and proposes a novel online transfer learning algorithm with adaptive cost (OLAC). Firstly, we introduce the label distribution into traditional Hinge Loss Function to compute the cost of classification adaptively. Secondly, we transfer learn the classifier according to its performance on new coming data including both accuracy and cost. Extensive experimental results show that our method can achieve higher accuracy and less classification lost, especially for the samples with higher costs.

References

[1]
Zhao P., Hoi S. C. H., Wang, J., Li B. (2014). Online transfer learning. Artificial Intelligence, 216(16), 76--102.
[2]
Zhao P., Hoi S. C. H. (2010). OTL: a framework of online transfer learning. International Conference on International Conference on Machine Learning (pp.1231--1238)
[3]
Ge L., Gao J., Zhang A. (2013). OMS-TL: a framework of online multiple source transfer learning. ACM International Conference on Information, Knowledge Management (pp.2423--2428). ACM.
[4]
Wu Q., Wu H., Zhou X., Tan M., Xu Y., Yan Y., et al. (2017). Online transfer learning with multiple homogeneous or heterogeneous sources. IEEE Transactions on Knowledge, Data Engineering, PP(99), 1--1.
[5]
Wang J., Zhao P., Hoi S. C. H. (2014). Cost-sensitive online classification. IEEE Transactions on Knowledge & Data Engineering, 26(10), 2425--2438.
[6]
Sahoo D., Zhao P., Hoi S. C. H. (2016). Cost-Sensitive Online Multiple Kernel Classification. JMLR: Workshop and Conference Proceedings, 60:1--16.
[7]
Zhao P., Zhuang F., Wu M., Li X. L., Hoi, S. C. H. (2015). Cost-Sensitive Online Classification with Adaptive Regularization and Its Applications. IEEE International Conference on Data Mining (pp.649--658). IEEE Computer Society.
[8]
Crammer K., Dekel O., Keshet J., Shalev-Shwartz S., Singer Y. (2006). Online passive-aggressive algorithms. Journal of Machine Learning Research, 7(3), 551--585.
[9]
Zhang J., García J. (2016). Online classifier adaptation for cost-sensitive learning. Neural Computing & Applications, 27(3), 781--789.
[10]
Mansour Y., Mohri M., Rostamizadeh A. (2009). Domain Adaptation with Multiple Sources. Conference on Neural Information Processing Systems, Vancouver, British Columbia, Canada, December (pp.1041--1048).
[11]
Tan B., Zhong, E., Xiang, E. W., Yang, Q. (2014). Multi-transfer: transfer learning with multiple views and multiple sources. Statistical Analysis & Data Mining, 7(4), 282--293.
[12]
Ryu D., Jang J. I, Baik, J. (2017). A transfer cost-sensitive boosting approach for cross-project defect prediction. Software Quality Journal, 25(1), 235--272.
[13]
Uguroglu S., Carbonell J., Doyle, M., Biederman R. (2012). Cost-sensitive risk stratification in the diagnosis of heart disease. 26th AAAI Conference on Artificial Intelligence (pp.2335--2340). AAAI Press.
[14]
Li Z., Jing X, Wu F, et al. (2017) Cost-sensitive transfer kernel canonical correlation analysis for heterogeneous defect prediction. Automated Software Engineering, (1):1--45
[15]
Margineantu D. D, Dietterich T. G. (2007). A wrapper method for cost-sensitive learning via stratification.
[16]
Kim J, Choi K, Kim G, et al. (2012). Classification cost: An empirical comparison among traditional classifier, Cost-Sensitive Classifier, and MetaCost. Expert Systems with Applications. 39(4):4013--4019
[17]
Sun Y., Kamel M. S., Wong A. K. C. Wang Y. (2007). Cost-sensitive boosting for classification of imbalanced data. Pattern Recognition, 40(12), 3358--3378.
[18]
Li Q., Mao Y. (2014). A review of boosting methods for imbalanced data classification. Pattern Analysis & Applications, 17(4), 679--693.
[19]
Masnadi-Shirazi H., Vasconcelos N. (2011). Cost-sensitive boosting. IEEE Transactions on Pattern Analysis & Machine Intelligence, 33(2), 294--309.
[20]
Zhao P., Zhuang F., Wu M., Li X. L. Hoi S. C. H. (2015). Cost-Sensitive Online Classification with Adaptive Regularization and Its Applications. IEEE International Conference on Data Mining (pp.649--658).

Cited By

View all
  • (2022)Addressing modern and practical challenges in machine learning: a survey of online federated and transfer learningApplied Intelligence10.1007/s10489-022-04065-353:9(11045-11072)Online publication date: 30-Aug-2022
  • (2019)Convolutional Equalizer - A Convolutional Approach to Equalize Input Features in Dimension2019 International Conference on System Science and Engineering (ICSSE)10.1109/ICSSE.2019.8823380(318-323)Online publication date: Jul-2019

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
SPML '18: Proceedings of the 2018 International Conference on Signal Processing and Machine Learning
November 2018
177 pages
ISBN:9781450366052
DOI:10.1145/3297067
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 November 2018

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Adaptive Cost
  2. Cost sensitive
  3. Online transfer learning

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

SPML '18

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)9
  • Downloads (Last 6 weeks)3
Reflects downloads up to 02 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2022)Addressing modern and practical challenges in machine learning: a survey of online federated and transfer learningApplied Intelligence10.1007/s10489-022-04065-353:9(11045-11072)Online publication date: 30-Aug-2022
  • (2019)Convolutional Equalizer - A Convolutional Approach to Equalize Input Features in Dimension2019 International Conference on System Science and Engineering (ICSSE)10.1109/ICSSE.2019.8823380(318-323)Online publication date: Jul-2019

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media