Skip to main content
SpringerLink
Log in
Book cover

Principles of Modeling pp 162–181Cite as

Modeling Dynamical Phenomena in the Era of Big Data

  • Chapter
  • First Online:

  • 1753 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 10760))

Abstract

As the world around us gets equipped with widespread sensing, computing, communication, and actuation capabilities, opportunities to improve the quality of life arise. Smart infrastructures promise to dramatically increase safety and efficiency. While data abounds, the modeling and understanding of large-scale complex systems, such as energy distribution, transportation, or communication networks, water management systems, and buildings, presents several challenges. Deriving models from first principles via white or gray box modeling is infeasible. Classical black-box modeling is also not practical as model selection is hard, interactions change over time, and evolution can be observed passively without the chance to conduct experiments through data injection or manipulation of the system. Moreover, the causality structure of such systems is largely unknown.

We contend that determining data-driven, minimalistic models, capable of explaining dynamical phenomena and tracking their validity over time, is an essential step toward building dependable systems. In this work we will outline challenges, review existing work, and propose future research directions.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Amini, H., Minca, A.: Inhomogeneous financial networks and contagious links. Oper. Res. 64(5), 1109–1120 (2016)

    Article  MathSciNet  Google Scholar 

  2. Barnett, L., Barrett, A.B., Seth, A.K.: Granger causality and transfer entropy are equivalent for Gaussian variables. Phys. Rev. Lett. 103(23), 238701 (2009)

    Article  Google Scholar 

  3. Battistelli, G., Tesi, P.: Detecting topology variations in dynamical networks. In: 54th Conference on Decision and Control, pp. 3349–3354. IEEE (2015)

    Google Scholar 

  4. Chernoff, H.: Approaches in sequential design of experiments. Technical report, Stanford University, CA, Department of Statistics (1973)

    Google Scholar 

  5. Costanzo, J.A., Materassi, D., Sinopoli, B.: Inferring link changes in acyclic networks through power spectral density variations. In: 55th Annual Allerton Conference on Communication, Control, and Computing (2017)

    Google Scholar 

  6. Danks, D., Plis, S.: Learning causal structure from undersampled time series. In: NIPS Workshop on Causality (2013)

    Google Scholar 

  7. Etesami, J., Kiyavash, N.: Directed information graphs: a generalization of linear dynamical graphs. In: American Control Conference (ACC 2014), pp. 2563–2568. IEEE (2014)

    Google Scholar 

  8. Granger, C.: Investigating causal relations by econometric models and cross-spectral methods. Econometrica 37, 424–438 (1969)

    Article  Google Scholar 

  9. Lacerda, G., Spirtes, P.L., Ramsey, J., Hoyer, P.O.: Discovering cyclic causal models by independent components analysis. arXiv preprint arXiv:1206.3273 (2012)

  10. Massey, J.: Causality, feedback and directed information. In: Proceedings of International Symposium on Information, Theory and Application, (ISITA-1990), pp. 303–305 (1990)

    Google Scholar 

  11. Materassi, D., Salapaka, M.: On the problem of reconstructing an unknown topology via locality properties of the Wiener filter. IEEE Trans. Autom. Control 57(7), 1765–1777 (2012)

    Article  MathSciNet  Google Scholar 

  12. Materassi, D.: Norbert Wiener’s legacy in the study and inference of causation. In: 2014 IEEE Conference on Norbert Wiener in the 21st Century (21CW), pp. 1–6. IEEE (2014)

    Google Scholar 

  13. Materassi, D., Innocenti, G.: Topological identification in networks of dynamical systems. IEEE Trans. Autom. Control 55(8), 1860–1871 (2010)

    Article  MathSciNet  Google Scholar 

  14. Materassi, D., Salapaka, M.V.: Network reconstruction of dynamical polytrees with unobserved nodes. In: 51st Annual Conference on Decision and Control, pp. 4629–4634. IEEE (2012)

    Google Scholar 

  15. Materassi, D., Salapaka, M.V.: Reconstruction of directed acyclic networks of dynamical systems. In: American Control Conference (ACC 2013), pp. 4687–4692. IEEE (2013)

    Google Scholar 

  16. Materassi, D., Salapaka, M.V.: Graphoid-based methodologies in modeling, analysis, identification and control of networks of dynamic systems. In: American Control Conference (ACC 2016), pp. 4661–4675. IEEE (2016)

    Google Scholar 

  17. Mooij, J.M., Peters, J., Janzing, D., Zscheischler, J., Shölkopf, B.: Distinguishing cause from effect using observational data: methods and benchmarks. J. Mach. Learn. Res. 17, 1–102 (2016)

    MathSciNet  MATH  Google Scholar 

  18. Pearl, J.: Causality. Cambridge University Press, Cambridge (2009)

    Book  Google Scholar 

  19. Pearl, J.: Simpson’s paradox: an anatomy. Department of Statistics, UCLA (2011)

    Google Scholar 

  20. Pearl, J., Verma, T.S.: A theory of inferred causation. Stud. Logic Found. Math. 134, 789–811 (1995)

    Article  MathSciNet  Google Scholar 

  21. Quinn, C.J., Coleman, T.P., Kiyavash, N., Hatsopoulos, N.G.: Estimating the directed information to infer causal relationships in ensemble neural spike train recordings. J. Comput. Neurosci. 30(1), 17–44 (2011)

    Article  MathSciNet  Google Scholar 

  22. Rahimian, M.A., Preciado, V.M.: Detection and isolation of failures in directed networks of lti systems. IEEE Trans. Control Netw. Syst. 2(2), 183–192 (2015)

    Article  MathSciNet  Google Scholar 

  23. Sadamoto, T., Ishizaki, T., Imura, J.I.: Hierarchical distributed control for networked linear systems. In: 2014 IEEE 53rd Annual Conference on Decision and Control (CDC), pp. 2447–2452. IEEE (2014)

    Google Scholar 

  24. Schreiber, T.: Measuring information transfer. Phys. Rev. Lett. 85(2), 461 (2000)

    Article  MathSciNet  Google Scholar 

  25. Talukdar, S., Prakash, M., Materassi, D., Salapaka, M.V.: Reconstruction of networks of cyclostationary processes. In: 2015 IEEE 54th Annual Conference on Decision and Control (CDC), pp. 783–788. IEEE (2015)

    Google Scholar 

  26. Verma, T.S., Pearl, J.: Equivalence and synthesis of causal models. Technical report R-150, UCLA, Computer Science Department (1990)

    Google Scholar 

  27. Weerakkody, S., Sinopoli, B., Kar, S., Datta, A.: Information flow for security in control systems. In: 55th Annual Conference on Decision and Control, pp. 5065–5072. IEEE (2016)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Carnegie Mellon University, Pittsburgh, USA

    Bruno Sinopoli & John A. W. B. Costanzo

Authors
  1. Bruno Sinopoli
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. John A. W. B. Costanzo
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Bruno Sinopoli .

Editor information

Editors and Affiliations

  1. University of California, Berkeley, Berkeley, California, USA

    Marten Lohstroh

  2. National Instruments, Berkeley, California, USA

    Patricia Derler

  3. Mälardalen University, Västerås, Sweden, Reykjavík University, Reykjavik, Iceland

    Marjan Sirjani

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Sinopoli, B., Costanzo, J.A.W.B. (2018). Modeling Dynamical Phenomena in the Era of Big Data. In: Lohstroh, M., Derler, P., Sirjani, M. (eds) Principles of Modeling. Lecture Notes in Computer Science(), vol 10760. Springer, Cham. https://doi.org/10.1007/978-3-319-95246-8_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-95246-8_10

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-95245-1

  • Online ISBN: 978-3-319-95246-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation