Skip to main content

Advertisement

Log in

Automated Slideshow Design from a Set of Photos Based on a Hybrid Metaheuristic Approach

  • Research
  • Published:
Operations Research Forum Aims and scope Submit manuscript

Abstract

Automated slideshow creation techniques can help in arranging various multimedia elements, such as photos, videos, and graphics, into a cohesive and engaging story. This paper specifically focuses on utilizing metaheuristic algorithms to create compelling slideshows based on a predetermined set of photos. The work presents a two-stage algorithm for solving the photo slideshow problem as defined in the qualification round of Google Hash Code 2019. In the first stage, a Genetic Algorithm is applied to produce a good-quality initial solution. In the second stage, an Iterated Local Search metaheuristic is used to further optimize the solution. Additionally, an Integer Linear Programming model is presented for comparison purposes, which is used to solve a subset of instances that are of smaller sizes. The computational study uses a challenging test set of four instances and demonstrates that the proposed approach produces comparable results to the best performing algorithms in the competition. For two of the instances, new benchmark results are obtained. Furthermore, the proposed solution is tested on a newly generated test set of 55 instances, consisting of real-life and synthetic data. The results indicate that the proposed approach can effectively produce solutions of good quality for smaller instances and efficiently solve larger instances within a short period.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Algorithm 1
Algorithm 2
Algorithm 3
Fig. 2

Similar content being viewed by others

Data Availability

The authors explicitly state that no supplementary data or materials are connected to this study.

Code Availability

The code and software developed as part of this article’s work can be accessed at the following links:

https://github.com/labeatarbneshi/photo-slideshow

https://github.com/ksylejmani/Photo-Slideshow-ILP

https://github.com/Ndriqim-H/Photo-SlideShow-CP-Sat-Solver

https://slideshow.instance.generator.erzen.tk/

References

  1. Segel E, Heer J (2010) Narrative visualization: telling stories with data. IEEE Trans Visual Comput Graphics 16(6):1139–1148

    Article  Google Scholar 

  2. Tominski C, Andrienko G, Andrienko N, Bleisch S, Fabrikant SI, Mayr E, Miksch S, Pohl M, Skupin A (2021) Toward flexible visual analytics augmented through smooth display transitions. Vis Inform 5(3):28–38

    Article  Google Scholar 

  3. Google (2019) Google hash code competition. https://storage.googleapis.com/coding-competitions.appspot.com/HC/2019/hashcode2019_qualification_task.pdf. Accessed 12 Feb 2023

  4. Arbneshi L, Sylejmani K (2023) Iterated local search with genetic algorithms for the photo slideshow problem. In: Metaheuristics: 14th International Conference, MIC 2022, Syracuse, Italy, July 11–14, 2022, Proceedings. Springer, pp 537–543

  5. Unsplash.com (2023) Unsplash.com. https://unsplash.com/. Accessed 12 Feb 2023

  6. Desrochers M, Laporte G (1991) Improvements and extensions to the miller-tucker-zemlin subtour elimination constraints. Oper Res Lett 10(1):27–36

    Article  MathSciNet  Google Scholar 

  7. Jünger M, Reinelt G, Rinaldi G (1995) The traveling salesman problem. Handbooks Oper Res Management Sci 7:225–330

    MathSciNet  Google Scholar 

  8. Johnson DS (2005) Local optimization and the traveling salesman problem. In: Automata, Languages and Programming: 17th International Colloquium Warwick University, England, July 16–20, 1990 Proceedings. Springer, pp 446–461

  9. Golden BL, Levy L, Vohra R (1987) The orienteering problem. Naval Research Logistics (NRL) 34(3):307–318

    Article  Google Scholar 

  10. Vansteenwegen P, Souffriau W, Van Oudheusden D (2011) The orienteering problem: a survey. Eur J Oper Res 209(1):1–10

    Article  MathSciNet  Google Scholar 

  11. Li C-T, Hsieh H-P, Lin S-D (2011) Photofeel: feeling your photo collection with graph-based audiovisual flocking. In: Proceedings of the 19th ACM International Conference on Multimedia. pp 1553–1556

  12. Fu T-J, Wang WY, McDuff D, Song Y (2022) Doc2 ppt: automatic presentation slides generation from scientific documents. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol 36. pp 634–642

  13. Wang F, Liu X, Liu O, Neshati A, Ma T, Zhu M, Zhao J (2023) Slide4n: Creating presentation slides from computational notebooks with human-AI collaboration

  14. Girardi EA (2022) Automatic slide generation from scientific papers based on multimodal learning. PhD thesis, Politecnico di Torino

  15. Zhang M, Li M, Chen L, Yu J (2021) Aesthetic photo collage with deep reinforcement learning. arXiv preprint arXiv:2110.09775

  16. Leake M, Shin HV, Kim JO, Agrawala M (2020) Generating audio-visual slideshows from text articles using word concreteness. In: CHI, vol 20. pp 25–30

  17. Chi P, Sun Z, Panovich K, Essa I (2020) Automatic video creation from a web page. In: Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology. pp 279–292

  18. Zhong M, Li G, Chi P, Li Y (2021) Helpviz: automatic generation of contextual visual mobile tutorials from text-based instructions. In: The 34th Annual ACM Symposium on User Interface Software and Technology. pp 1144–1153

  19. Chi P, Frey N, Panovich K, Essa I (2021) Automatic instructional video creation from a markdown-formatted tutorial. In: The 34th Annual ACM Symposium on User Interface Software and Technology. pp 677–690

  20. Forrest S (1993) Genetic algorithms: principles of natural selection applied to computation. Science 261(5123):872–878

    Article  ADS  CAS  PubMed  Google Scholar 

  21. Lourenço HR, Martin OC, Stützle T (2003) Iterated local search. Springer

  22. Derbel H, Jarboui B, Hanafi S, Chabchoub H (2012) Genetic algorithm with iterated local search for solving a location-routing problem. Expert Syst Appl 39(3):2865–2871

    Article  Google Scholar 

  23. Lima CF, Lobo FG (2004) Parameter-less optimization with the extended compact genetic algorithm and iterated local search. In: Genetic and Evolutionary Computation–GECCO 2004: Genetic and Evolutionary Computation Conference, Seattle, WA, USA, June 26-30, 2004. Proceedings, Part I. Springer, pp 1328–1339

  24. Bernardino AM, Bernardino EM, Sanchez-Perez JM, Gomez-Pulido JA, Vega-Rodriguez MA (2008) Genetic algorithms and iterated local search to solve the ring loading problem. In 2008 50th International Symposium ELMAR, vol 1. IEEE, pp 265–268

  25. Blickle T (2000) Tournament selection. Evol Comput 1:181–186

    Google Scholar 

  26. Goldberg DE, Deb K (1991) A comparative analysis of selection schemes used in genetic algorithms. In: Foundations of Genetic Algorithms, vol 1. Elsevier, pp 69–93

  27. Doerr B, Doerr C (2018) Optimal static and self-adjusting parameter choices for the (1+(\(\lambda\), \(\lambda\)))(1+(\(\lambda\), \(\lambda\))) genetic algorithm. Algorithmica 80:1658–1709

  28. Arbneshi L (2022) labeatarbneshi/photo-slideshow. https://github.com/labeatarbneshi/photo-slideshow. Accessed 25 Mar 2023

  29. Sylejmani K (2023) ksylejmani/photo-slideshow-ilp. https://github.com/ksylejmani/Photo-Slideshow-ILP. Accessed 25 Mar 2023

  30. Halili N (2023) NDRIQIM-H/photo-slideshow-cp-sat-solver. https://github.com/Ndriqim-H/Photo-SlideShow-CP-Sat-Solver. Accessed 25 Mar 2023

  31. Krasniqi E (2023) slideshow.instance.generator. https://slideshow.instance.generator.erzen.tk/. Accessed 25 Mar 2023

  32. Montgomery DC (2017) Design and analysis of experiments. John Wiley & Sons

  33. Ratti D (2019) danieleratti/hashcode-2019. https://github.com/danieleratti/hashcode-2019. Accessed 25 Mar 2023

Download references

Funding

This work was partially supported by the HERAS+ project under the umbrella of project number K-12-2021.

Author information

Authors and Affiliations

Authors

Contributions

Labeat Arbneshi contributed to the development of the hybrid approach for the design of the photo slideshow. Kadri Sylejmani was responsible for writing the majority of the manuscript and developing and implementing the ILP model. Ndriçim Halili implemented the CP-SAT model. Erzen Krasniqi developed web tools for generating test data based on real-life photos, as well as for generating synthetic test data.

Corresponding author

Correspondence to Kadri Sylejmani.

Ethics declarations

Ethics Approval

Not applicable.

Consent to Participate

Not applicable.

Consent for Publication

Not applicable.

Competing Interests

The authors declare no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Arbneshi, L., Sylejmani, K., Halili, N. et al. Automated Slideshow Design from a Set of Photos Based on a Hybrid Metaheuristic Approach. Oper. Res. Forum 4, 75 (2023). https://doi.org/10.1007/s43069-023-00261-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s43069-023-00261-0

Keywords

Navigation