Skip to main content

A Multi-pass Streaming Algorithm for Regularized Submodular Maximization

  • Conference paper
  • First Online:
Combinatorial Optimization and Applications (COCOA 2021)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 13135))

Abstract

In this paper, we consider a problem of maximizing regularized submodular functions with a k-cardinality constraint under streaming fashion. In the model, the utility function \(f(\cdot )=g(\cdot )-\ell (\cdot )\) is expressed as the difference between a non-negative monotone non-decreasing submodular function g and a non-negative modular function \(\ell \). In addition, the elements are revealed in a streaming setting, that is to say, an element is visited in one time slot. The problem asks to find a subset of size at most k such that the regularized utility value is maximized. Most of the existing algorithms for the submodular maximization heavily rely on the non-negativity assumption of the utility function, which may not be applicable for our regularized scenario. Indeed, determining if the maximum is positive or not is NP-hard, which implies that no multiplicative factor approximation is existed for this problem. To circumvent this challenge, several works paid attention to more meaningful guarantees by introducing a slightly weaker notion of approximation, and any developed algorithm is aim to construct a solution S satisfying \(f(S)\ge \rho \cdot g(OPT)-\ell (OPT)\) for some \(\rho >0\). In this work, assume there is a weak \(\rho \)-approximation for the k-cardinality constrained regularized submodular maximization, we develop Distorted-Threshold-Streaming, a multi-pass bicriteria algorithm for the streaming regularized submodular maximization with the k-cardinality constraint (SRSMCC), which produces a \((\rho /\lambda ,1/\lambda )\)-bicriteria approximation by making over \(O(\log (\lambda /\rho )/\varepsilon )\) passes, consuming O(k) memory and using \(O(\log (\lambda /\rho )/\varepsilon )\) queries per element, where \(\lambda =\frac{2-(2\rho +2)/(3+\sqrt{5-4\rho })}{(3+\sqrt{5-4\rho })/(2\rho +2)-1}\) and any accuracy parameter \(\varepsilon >0\).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 89.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Badanidiyuru, A., Mirzasoleiman, B., Karbasi, A., Krause, A.: Streaming submodular maximization: massive data summarization on the fly. In: Proceedings of SIGKDD, pp. 671–680 (2014)

    Google Scholar 

  2. Buchbinder, N., Feldman, M., Garg, M.: Deterministic \((1/2+\varepsilon )\)-approximation for submodular maximization over a matroid. In: Proceedings of SODA, pp. 241–254 (2019)

    Google Scholar 

  3. Calinescu, G., Chekuri, C., Pál, M., Vondrák, J.: Maximizing a monotone submodular function subject to a matroid constraint. SIAM J. Comput. 40, 1740–1766 (2011)

    Article  MathSciNet  Google Scholar 

  4. Feige, U.: A threshold of \(\ln (n)\) for approximating set cover. J. ACM 45(4), 634–652 (1998)

    Article  MathSciNet  Google Scholar 

  5. Feldman, M.: Guess free maximization of submodular and linear sums. In: Proceedings of WADS, pp. 380–394 (2019)

    Google Scholar 

  6. Feldman, M., Harshaw, C., Karbasi, A.: Greed is good: near-optimal submodular maximization via greedy optimization. In: Proceedings of COLT, pp. 758–784 (2017)

    Google Scholar 

  7. Feldman, M., Naor, J.S., Schwartz, R., Ward, J.: Improved approximations for k-exchange systems. In: Demetrescu, C., Halldórsson, M.M. (eds.) ESA 2011. LNCS, vol. 6942, pp. 784–798. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-23719-5_66

    Chapter  Google Scholar 

  8. Fisher, M.L., Nemhauser, G.L., Wolsey, L.A.: An analysis of approximations for maximizing submodular set functions-II. In: Balinski, M.L., Hoffman, A.J. (eds.) Polyhedral Combinatorics. MATHPROGRAMM, vol. 8, pp. 73–87. Springer, Heidelberg (1978). https://doi.org/10.1007/BFb012119

    Chapter  Google Scholar 

  9. Harshaw, C., Feldman, M., Ward, J., Karbasi, A.: Submodular maximization beyond non-negativity: guarantees, fast algorithms, and applications. In: Proceedings of ICML, pp. 2634–2643 (2019)

    Google Scholar 

  10. Kazemi, E., Minaee, S., Feldman, M., Karbasi, A.: Regularized submodular maximization at scale. In: Proceedings of ICML, pp. 5356–5366 (2021)

    Google Scholar 

  11. Kazemi, E., Mitrovic, M., Zadimoghaddam, M., Lattanzi, S., Karbasi, A.: Submodular streaming in all its glory: tight approximation, minimum memory and low adaptive complexity. In: Proceedings of ICML, pp. 3311–3320 (2019)

    Google Scholar 

  12. Lee, J., Sviridenko, M., Vondrák, J.: Submodular maximization over multiple matroids via generalized exchange properties. Math. Oper. Res. 35, 795–806 (2010)

    Article  MathSciNet  Google Scholar 

  13. Lu, C., Yang, W., Gao, S.: Regularized non-monotone submodular maximization. arXiv:2103.10008

  14. Mirzasoleiman, B., Jegelka, S., Krause, A.: Streaming non-monotone submodular maximization: personalized video summarization on the fly. In: Proceedings of AAAI, pp. 1379–1386 (2018)

    Google Scholar 

  15. Mitrovic, M., Kazemi, E., Zadimoghaddam, M., Karbasi, A.: Data summarization at scale: a two-stage submodular approach. In: Proceedings of ICML, pp. 3593–3602 (2018)

    Google Scholar 

  16. Nemhauser, G.L., Wolsey, L.A., Fisher, M.L.: An analysis of approximations for maximizing submodular set functions-I. Math. Program. 14, 265–294 (1978). https://doi.org/10.1007/BF01588971

    Article  MathSciNet  MATH  Google Scholar 

  17. Norouzi-Fard, A., Tarnawski, J., Mitrovic, S., Zandieh, A., Mousavifar, A., Svensson, O.: Beyond \(1/2\)-approximation for submodular maximization on massive data streams. In: Proceedings of ICML, pp. 3826–3835 (2018)

    Google Scholar 

  18. Sarpatwar, K.K., Schieber, B., Shachnai, H.: Constrained submodular maximization via greedy local search. Oper. Res. Lett. 41(1), 1–6 (2019)

    Article  MathSciNet  Google Scholar 

  19. Sviridenko, M.: A note on maximizing a submodular set function subject to a knapsack constraint. Oper. Res. Lett. 32, 41–43 (2004)

    Article  MathSciNet  Google Scholar 

  20. Sviridenko, M., Vondrák, J., Ward, J.: Optimal approximation for submodular and supermodular optimization with bounded curvature. Math. Oper. Res. 42(4), 1197–1218 (2017)

    Article  MathSciNet  Google Scholar 

  21. Tang, S., Yuan, J.: Adaptive regularized submodular maximization. arXiv:2103.00384

  22. Wang, Y., Xu, D., Du, D., Ma, R.: Bicriteria algorithms to balance coverage and cost in team formation under online model. Theor. Comput. Sci. 854, 68–76 (2021)

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgements

The third author is supported by National Natural Science Foundation of China (No. 11901544). The fourth author is supported by National Natural Science Foundation of China (No. 12101587), China Postdoctoral Science Foundation (No. 2021M703167) and Fundamental Research Funds for the Central Universities (No. EIE40108X2).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ruiqi Yang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Gong, Q., Gao, S., Wang, F., Yang, R. (2021). A Multi-pass Streaming Algorithm for Regularized Submodular Maximization. In: Du, DZ., Du, D., Wu, C., Xu, D. (eds) Combinatorial Optimization and Applications. COCOA 2021. Lecture Notes in Computer Science(), vol 13135. Springer, Cham. https://doi.org/10.1007/978-3-030-92681-6_55

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-92681-6_55

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-92680-9

  • Online ISBN: 978-3-030-92681-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics