Skip to main content

Tractable Planning for Coordinated Story Capture: Sequential Stochastic Decoupling

  • Conference paper
  • First Online:

Part of the book series: Springer Proceedings in Advanced Robotics ((SPAR,volume 22))

Abstract

We consider the problem of deploying robots to observe the evolution of a stochastic process in order to output a sequence of observations that fit some given specification. This problem often arises in contexts such as event reporting, situation depiction, and automated narrative generation. The paper extends our prior work by formulating and examining the multi-robot case: a team of robots move about, each recording what they observe, and, if they manage to capture some event, communicating that fact with the group. In the end, all events from all the robots are collated to provide a cumulative output. A plan is used to decide what each robot will attempt to capture next, based on the state of the world and the events that have been captured (collectively) so far. This paper focuses on the question of how to compute effective multi-robot plans. A monolithic treatment, involving the optimal selection of joint choices, i.e., choosing the next elements to attempt to capture by all robots, is formulated where costs are minimized in an expected sense. Since such plans are prohibitive to compute, variants based on an approximation scheme based on solving a sequence of individual planning problems are then introduced. This scheme sacrifices some solution quality but requires far less computational expense; we show this permits one to scale to greater numbers of robots.

This material is based upon work supported by the National Science Foundation under Grants 1849249 & 1849291.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   219.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   279.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   279.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    Being consistent with that above, we use \(a^{(j)}\) to denote the \(j^{\text {th}}\) element of \(\mathbf {a}\).

References

  1. Rahmani, H., Shell, D.A., O’Kane, J.M.: Planning to chronicle. In: Workshop on the Algorithmic Foundations of Robotics (WAFR XIV) (2020)

    Google Scholar 

  2. Shell, D.A., Huang, L., Becker, A.T., O’Kane, J.M.: Planning coordinated event observation for structured narratives. In: IEEE ICRA (2019)

    Google Scholar 

  3. Yu, J., LaValle, S.M.: Story validation and approximate path inference with a sparse network of heterogeneous sensors. In: IEEE ICRA (2011)

    Google Scholar 

  4. Lee, Y.J., Ghosh, J., Grauman, K.: Discovering important people and objects for egocentric video summarization. In: IEEE CVPR (2012)

    Google Scholar 

  5. Hong, R., Tang, J., Tan, H.-K., Ngo, C.-W., Yan, S., Chua, T.-S.: Beyond search: event-driven summarization for web videos. ACM Trans. Multimed. Comput. Commun. Appl. 7(4), 35 (2011)

    Article  Google Scholar 

  6. Potapov, D., Douze, M., Harchaoui, Z., Schmid, C.: Category-specific video summarization. In: ECCV (2014)

    Google Scholar 

  7. Feng, L., Li, Z., Kuang, Z., Zhang, W.: Extractive video summarizer with memory augmented neural networks. In: ACM Multimedia (2018)

    Google Scholar 

  8. Chang, P., Han, M., Gong, Y.: Extract highlights from baseball game video with hidden Markov models. In: IEEE ICIP (2002)

    Google Scholar 

  9. Kolekar, M.H., Sengupta, S.: Event-importance based customized and automatic cricket highlight generation. In: IEEE ICME (2006)

    Google Scholar 

  10. Girdhar, Y., Giguere, P., Dudek, G.: Autonomous adaptive exploration using realtime online spatiotemporal topic modeling. Int. J. Robot. Res. 33(4), 645–657 (2014)

    Article  Google Scholar 

  11. H. Hajishirzi, J. Hockenmaier, E. T. Mueller, and E. Amir, “Reasoning in Robocup Soccer Narratives,” in UAI, 2011

    Google Scholar 

  12. Rosenthal, S., Selvaraj, S.P., Veloso, M.: Verbalization: narration of autonomous robot experience. In: IJCAI (2016)

    Google Scholar 

  13. Riedl, M.O., Young, R.M.: Narrative planning: balancing plot and character. J. Artif. Intell. Res. 39, 217–268 (2010)

    Article  Google Scholar 

  14. Barot, C., et al.: Bardic: generating multimedia narrative reports for game logs. In: Working Notes of the AIIDE Workshop on Intelligent Narrative Technologies (2017)

    Google Scholar 

  15. Hopcroft, J.E., Ullman, J.D.: Introduction to Automata Theory. Languages and Computation. Adison-Wesley. Reading, Mass (1979)

    MATH  Google Scholar 

  16. Puterman, M.: Markov Decision Processes: Discrete Stochastic Dynamic Programming. Wiley, Hoboken (1994)

    Book  Google Scholar 

  17. Ephrati, E., Rosenschein, J.S.: Divide and conquer in multi-agent planning. In: AAAI-94 (1994)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Diptanil Chaudhuri .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Chaudhuri, D., Rahmani, H., Shell, D.A., O’Kane, J.M. (2022). Tractable Planning for Coordinated Story Capture: Sequential Stochastic Decoupling. In: Matsuno, F., Azuma, Si., Yamamoto, M. (eds) Distributed Autonomous Robotic Systems. DARS 2021. Springer Proceedings in Advanced Robotics, vol 22. Springer, Cham. https://doi.org/10.1007/978-3-030-92790-5_20

Download citation

Publish with us

Policies and ethics