skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Multifrontal Non-negative Matrix Factorization

Conference ·

Non-negative matrix factorization (Nmf) is an important tool in high-performance large scale data analytics with applications ranging from community detection, recommender system, feature detection and linear and non-linear unmixing. While traditional Nmf works well when the data set is relatively dense, however, it may not extract sufficient structure when the data is extremely sparse. Specifically, traditional Nmf fails to exploit the structured sparsity of the large and sparse data sets resulting in dense factors. We propose a new algorithm for performing Nmf on sparse data that we call multifrontal Nmf (Mf-Nmf) since it borrows several ideas from the multifrontal method for unconstrained factorization (e.g. LU and QR). We also present an efficient shared memory parallel implementation of Mf-Nmf and discuss its performance and scalability. We conduct several experiments on synthetic and realworld datasets and demonstrate the usefulness of the algorithm by comparing it against standard baselines. We obtain a speedup of 1.2x to 19.5x on 24 cores with an average speed up of 10.3x across all the real world datasets.

Research Organization:
Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)
Sponsoring Organization:
USDOE
DOE Contract Number:
AC05-00OR22725
OSTI ID:
1649537
Resource Relation:
Journal Volume: 12043; Conference: 13th International Conference on Parallel Processing and Applied Mathematics (PPAM) - BIALYSTOK, , Poland - 9/8/2019 12:00:00 PM-9/11/2019 4:00:00 AM
Country of Publication:
United States
Language:
English

References (16)

Nonnegative Matrix and Tensor Factorizations: Applications to Exploratory Multi-Way Data Analysis and Blind Source Separation book September 2009
Behavioral clusters in dynamic graphs journal August 2015
Parallelization of the Hierarchical Alternating Least Squares Algorithm for Nonnegative Matrix Factorization conference September 2018
Large-scale matrix factorization with distributed stochastic gradient descent
  • Gemulla, Rainer; Nijkamp, Erik; Haas, Peter J.
  • Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining - KDD '11 https://doi.org/10.1145/2020408.2020426
conference January 2011
Nested Dissection of a Regular Finite Element Mesh journal April 1973
Hypergraph-Based Unsymmetric Nested Dissection Ordering for Sparse LU Factorization journal January 2010
NeNMF: An Optimal Gradient Method for Nonnegative Matrix Factorization journal June 2012
Parallel Algorithms for Sparse Linear Systems journal September 1991
MPI-FAUN: An MPI-Based Framework for Alternating-Updating Nonnegative Matrix Factorization journal March 2018
Algorithms for nonnegative matrix and tensor factorizations: a unified view based on block coordinate descent framework journal March 2013
Fast Nonnegative Matrix Factorization: An Active-Set-Like Method and Comparisons journal January 2011
Sparse nonnegative matrix factorization for protein sequence motif discovery journal September 2011
CloudNMF: A MapReduce Implementation of Nonnegative Matrix Factorization for Large-scale Biological Datasets journal February 2014
Distributed nonnegative matrix factorization for web-scale dyadic data analysis on mapreduce conference January 2010
A Communication-Avoiding 3D LU Factorization Algorithm for Sparse Matrices conference May 2018
Alternating direction method of multipliers for non-negative matrix factorization with the beta-divergence conference May 2014

Similar Records

An Efficient Multicore Implementation of a Novel HSS-Structured Multifrontal Solver Using Randomized Sampling
Journal Article · Thu Oct 27 00:00:00 EDT 2016 · SIAM Journal on Scientific Computing · OSTI ID:1649537

High performance sparse multifrontal solvers on modern GPUs
Journal Article · Sat Feb 05 00:00:00 EST 2022 · Parallel Computing · OSTI ID:1649537

Partitioning and Communication Strategies for Sparse Non-negative Matrix Factorization
Conference · Wed Aug 01 00:00:00 EDT 2018 · OSTI ID:1649537

Related Subjects