Skip to main content

Provenance-Based Quality Assessment and Inference in Data-Centric Workflow Executions

  • Conference paper
On the Move to Meaningful Internet Systems: OTM 2014 Conferences (OTM 2014)

Abstract

In this article we present a rule-based quality model for data centric workflows. The goal is to build a tool assisting workflow designers and users in annotating, exploring and improving the quality of data produced by complex media mining workflow executions. Our approach combines an existing fine-grained provenance generation approach [3] with a new quality assessment model for annotating XML fragments with data/application-specific quality values and inferring new values from existing annotations and provenance dependencies. We define the formal semantics using an appropriate fixpoint operator and illustrate how it can be implemented using standard Jena inference rules provided by current semantic web infrastructures.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Alrifai, M., Risse, T., Nejdl, W.: A hybrid approach for efficient web service composition with end-to-end qos constraints. ACM Trans. Web 6(2), 1–31 (2012)

    Article  Google Scholar 

  2. Altintas, I., Berkley, C., Jaeger, E., Jones, M., Ludäscher, B., Mock, S.: Kepler: An extensible system for design and execution of scientific workflows. In: SSDBM, pp. 423–424 (2004)

    Google Scholar 

  3. Amann, B., Constantin, C., Caron, C., Giroux, P.: Weblab prov: computing fine-grained provenance links for xml artifacts. In: EDBT/ICDT Workshops, pp. 298–306 (2013)

    Google Scholar 

  4. Amsterdamer, Y., Davidson, S.B., Deutch, D., Milo, T., Stoyanovich, J., Tannen, V.: Putting lipstick on pig: enabling database-style workflow provenance. Proc. VLDB Endow. 5(4) (December 2011)

    Google Scholar 

  5. Anand, M.K., Bowers, S., McPhillips, T., Ludäscher, B.: Efficient provenance storage over nested data collections. In: EDBT, pp. 958–969 (2009)

    Google Scholar 

  6. Batini, C., Scannapieco, M.: Data quality: concepts, methodologies and techniques. Data-centric systems and applications. Springer (2006)

    Google Scholar 

  7. Benjelloun, O., Sarma, A.D., Halevy, A., Widom, J.: Uldbs: Databases with uncertainty and lineage. In: VLDB (2006)

    Google Scholar 

  8. Bowers, S., McPhillips, T., Ludäscher, B.: Declarative rules for inferring fine-grained data provenance from scientific workflow execution traces. In: Groth, P., Frew, J. (eds.) IPAW 2012. LNCS, vol. 7525, pp. 82–96. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

  9. Buneman, P., Khanna, S., Tan, W.C.: Why and where: A characterization of data provenance. In: Van den Bussche, J., Vianu, V. (eds.) ICDT 2001. LNCS, vol. 1973, pp. 316–330. Springer, Heidelberg (2000)

    Chapter  Google Scholar 

  10. Callahan, S.P., Freire, J., Santos, E., Scheidegger, C.E., Silva, C.T., Vo, H.T.: Vistrails: visualization meets data management. In: SIGMOD, pp. 745–747 (2006)

    Google Scholar 

  11. Caron, C., Amann, B., Constantin, C., Giroux, P.: Wepige: The weblab provenance information generator and explorer. In: EDBT, pp. 664–667 (2014)

    Google Scholar 

  12. Cheng, R., Chen, J., Xie, X.: Cleaning uncertain data with quality guarantees. VLDB Endow. 1(1), 722–735 (2008)

    Article  Google Scholar 

  13. Cui, Y., Widom, J.: Lineage tracing for general data warehouse transformations. The VLDB Journal 12(1), 41–58 (2003)

    Article  Google Scholar 

  14. Davidson, S.B., Freire, J.: Provenance and scientific workflows: Challenges and opportunities. In: SIGMOD, pp. 1345–1350 (2008)

    Google Scholar 

  15. Dong, X.L., Berti-Equille, L., Srivastava, D.: Integrating conflicting data: The role of source dependence. Proc. VLDB Endow. 2(1), 550–561 (2009)

    Article  Google Scholar 

  16. Fan, W.: Dependencies revisited for improving data quality. In: PODS, pp. 159–170 (2008)

    Google Scholar 

  17. Fan, W., Geerts, F.: Foundations of Data Quality Management. Morgan & Claypool Publishers (2012)

    Google Scholar 

  18. Foster, J.N., Green, T.J., Tannen, V.: Annotated xml: Queries and provenance. In: PODS, pp. 271–280 (2008)

    Google Scholar 

  19. Giroux, P., Brunessaux, S., Brunessaux, S., Doucy, J., Dupont, G., Grilhères, B., Mombrun, Y., Saval, A.: Weblab: An integration infrastructure to ease the development of multimedia processing applications. In: Int. Conf. ICSSEA (2008)

    Google Scholar 

  20. Hartig, O., Zhao, J.: Using web data provenance for quality assessment. In: Proc. of the Workshop on Semantic Web and Provenance Management at ISWC (2009)

    Google Scholar 

  21. Hull, D., Wolstencroft, K., Stevens, R., Goble, C., Pocock, M.R., Li, P., Oinn, T.: Taverna: a tool for building and running workflows of services. Nucleic Acids Research 34(Web Server issue), W729–W732 (2006)

    Google Scholar 

  22. Imieliński, T., Lipski Jr., W.: Incomplete information in relational databases. J. ACM 31(4), 761–791 (1984)

    Article  MATH  Google Scholar 

  23. Karvounarakis, G., Green, T.J., Ives, Z.G., Tannen, V.: Collaborative data sharing via update exchange and provenance. ACM Trans. Database Syst. 38(3), 19:1–19:42 (2013)

    Google Scholar 

  24. Simmhan, Y., Plale, B.: Using provenance for personalized quality ranking of scientific datasets. I. J. Comput. Appl. 18(3), 180–195 (2011)

    Google Scholar 

  25. Yu, T., Zhang, Y., Lin, K.J.: Efficient algorithms for web services selection with end-to-end qos constraints. ACM Trans. Web 1 (May 2007)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Caron, C., Amann, B., Constantin, C., Giroux, P., Santanchè, A. (2014). Provenance-Based Quality Assessment and Inference in Data-Centric Workflow Executions. In: Meersman, R., et al. On the Move to Meaningful Internet Systems: OTM 2014 Conferences. OTM 2014. Lecture Notes in Computer Science, vol 8841. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-45563-0_8

Download citation

  • DOI: https://doi.org/10.1007/978-3-662-45563-0_8

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-662-45562-3

  • Online ISBN: 978-3-662-45563-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics