skip to main content
10.1145/3487075.3487091acmotherconferencesArticle/Chapter ViewAbstractPublication PagescsaeConference Proceedingsconference-collections
research-article

Data Matrix Completion Based on Pattern Classification

Authors Info & Claims
Published:07 December 2021Publication History

ABSTRACT

In recent years, with the rapid development of big data technology, the matrix completion is often used for data recovery, and how to improve the accuracy of matrix completion is a key issue. This paper proposes a matrix completion method based on pattern classification, called PCRE, to improve data recovery performance. Since the hidden similarity within the data is a significant factor affecting the overall performance, the method PCRE uses non-negative matrix decomposition to extract the patterns of the data and accordingly rearranges the data matrix to fit for the matrix completion. Experiments are conducted by using PM 10 monitoring data collected by 34 sensors in Beijing in 2019 (totally 351 days). The results show that, compared with existing methods, PCRE improves the accuracy of data recovery with a shorter computation time.

References

  1. W.DAI,O.MILENKOVIC,E. KERMAN (2011). Subspace Evolution and Transfer form Low-Rank Matrix Completion[J].IEEE Transactions on Signal Processing, 59(7):3120-3132.Google ScholarGoogle Scholar
  2. PM 10 data in beijing, http://www.bjmemc.com.cn/jsps/jsp/zxgk/hjzljc.jsp.Google ScholarGoogle Scholar
  3. E. J. Candes, B. Recht (2008). Exact low-rank matrix completion via convex optimization, in: 2008 46th Annual Allerton Conference on Communication, Control, and Computing, pp. 806–812. doi:10.1109/ALLERTON.2008.4797640.Google ScholarGoogle ScholarCross RefCross Ref
  4. E. J. Candes, T. Tao (2010). The power of convex relaxation: Near-optimal matrix completion, IEEE Transactions on Information Theory 56 (5) 2053–2080. doi:10.1109/TIT.2010.2044061.Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Qu L, Li L, Zhang Y , (2009). PPCA-Based Missing Data Imputation for Traffic Flow Volume: A Systematical Approach[J]. IEEE Transactions on Intelligent Transportation Systems, 10(3):512-522.Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Le W (2017). Data collection and data completion based on the theory of sparse representation.Google ScholarGoogle Scholar
  7. Peng C, Jin X, Wong, K C, Shi, M., P Liò (2012). Collective human mobility pattern from taxi trips in urban area, PLOS ONE 7. doi:10.1371/journal.pone.0034487.Google ScholarGoogle Scholar
  8. Liu X, Liu, X, Wang Y, Pu J, Zhang X (2016). Detecting anomaly in traffic flow from road similarity analysis, Springer International Publishing. doi:10.1007/978-3-319-39958-4_8.Google ScholarGoogle ScholarCross RefCross Ref
  9. D. D. Lee, H. S. Seung (1999). Learning the parts of objects by nonnegative matrix factorization, Nature 401 (7). doi:10.1038/44565.Google ScholarGoogle Scholar
  10. J. Deng, K. Xie (2017). Typical algorithm for low rank matrix completion, Electronic production (9) 40–43.doi:10.16589.Google ScholarGoogle Scholar
  11. Chen L, Chen SC (2017). Survey on matrix completion models and algorithms. RuanJianXueBao/Journal of Software, 28(6):1547−1564 (in Chinese). http://www.jos.org.cn/1000-9825/5260.htmGoogle ScholarGoogle Scholar
  12. Liu Z, L. Vandenberghe L (2009). Interior-Point Method for Nuclear Norm Approximation with Application to System Identification[J]. SIAM Journal on Matrix Analysis and Applications, 31(3):1235-1256.Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. TOH K C, YUN S (2010). An Accelerated Proximal Gradient Algorithm form Nuclear Norm Regularized Least Squares Problems[J].Pacific J. Optimaization, 6.615-640.Google ScholarGoogle Scholar
  14. RECHT B, FAZEL M,PARRILO P A (2010). Guaranteed Minimum-Rank Solutions of Linear Matrix Equation Equations Via Nuclear Norm Minimization[J]. SIAM Rev., 52:471-501.Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. CAI J, CANDES E J, SHEN Z (2010). A Singular Value Thresholding Algorithm for Matrix Completion[J] SIAM J. Op, 20:1956-1982.Google ScholarGoogle Scholar
  16. MAS, GOLDFARB D, CHEN L (2011). Fixed Point and Bregman Iterative Methods for Matrix Rank Minimization[J]. Mathematical Programming, 12:321-353.Google ScholarGoogle Scholar
  17. Raghunandan H. Keshava, Andrea Montanari, Sewoong Oh (2010). Matrix completion from a few entries[J]. IEEE Transactions on Information Theory, 56(6):2980-2998.Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. WEN Z,YIN W,ZHANG Y (2012). Solving A Low-Rank Factorization Model for Matrix Completion by A Nonlinear Successive Over-Relaxation Algorithm[J]. Math.Prog. Comp., 4(4):333-361.Google ScholarGoogle ScholarCross RefCross Ref
  19. D. Zhang, Y. Hu, J. Ye, X. Li and X. He (2012). Matrix completion by Truncated Nuclear Norm Regularization," 2012 IEEE Conference on Computer Vision and Pattern Recognition, pp. 2192-2199.Google ScholarGoogle Scholar
  20. Chen Y, Fan J, Ma C, (2019). Inference and uncertainty quantification for noisy matrix completion[J]. Proceedings of the National Academy of Sciences, 116(46): 22931-22937.Google ScholarGoogle ScholarCross RefCross Ref
  21. Nguyen L T, Kim J, Shim B (2019). Low-rank matrix completion: A contemporary survey[J]. IEEE Access, 7: 94215-94237.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Data Matrix Completion Based on Pattern Classification
        Index terms have been assigned to the content through auto-classification.

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Other conferences
          CSAE '21: Proceedings of the 5th International Conference on Computer Science and Application Engineering
          October 2021
          660 pages
          ISBN:9781450389853
          DOI:10.1145/3487075

          Copyright © 2021 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 7 December 2021

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article
          • Research
          • Refereed limited

          Acceptance Rates

          Overall Acceptance Rate368of770submissions,48%
        • Article Metrics

          • Downloads (Last 12 months)14
          • Downloads (Last 6 weeks)0

          Other Metrics

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        HTML Format

        View this article in HTML Format .

        View HTML Format