research-article

RepFrame: An Efficient and Transparent Framework for Dynamic Program Analysis

Authors:

Junfeng YangAuthors Info & Claims

APSys '15: Proceedings of the 6th Asia-Pacific Workshop on Systems

Article No.: 13, Pages 1 - 9

https://doi.org/10.1145/2797022.2797033

Published: 27 July 2015 Publication History

Abstract

Dynamic program analysis frameworks greatly improve software quality as they enable a wide range of powerful analysis tools (e.g., reliability, profiling, and logging) at runtime. However, because existing frameworks run only one actual execution for each software application, the execution is fully or partially coupled with an analysis tool in order to transfer execution states (e.g., accessed memory and thread interleavings) to the analysis tool, easily causing a prohibitive slowdown for the execution. To reduce the portions of execution states that require transfer, many frameworks require significantly carving analysis tools as well as the frameworks themselves. Thus, these frameworks significantly trade off transparency with analysis tools and allow only one type of tools to run within one execution.

This paper presents RepFrame, an efficient and transparent framework that fully decouples execution and analysis by constructing multiple equivalent executions. To do so, RepFrame leverages a recent fault-tolerant technique: transparent state machine replication, which runs the same software application on a set of machines (or replicas), and ensures that all replicas see the same sequence of inputs and process these inputs with the same efficient thread interleavings automatically. In addition, this paper discusses potential directions in which REPFRAME can further strengthen existing analyses. Evaluation shows that REPFRAME is easy to run two asynchronous analysis tools together and has reasonable overhead.

References

[1]

ZooKeeper. http://hadoop.apache.org/zookeeper/.

[2]

A. Aviram, S.-C. Weng, S. Hu, and B. Ford. Efficient system-enforced deterministic parallelism. In Proceedings of the Ninth Symposium on Operating Systems Design and Implementation (OSDI '10), Oct. 2010.

Digital Library

[3]

T. Bergan, O. Anderson, J. Devietti, L. Ceze, and D. Grossman. CoreDet: a compiler and runtime system for deterministic multithreaded execution. In Fifteenth International Conference on Architecture Support for Programming Languages and Operating Systems (ASPLOS '10), pages 53--64, Mar. 2010.

Digital Library

[4]

T. Bergan, N. Hunt, L. Ceze, and S. D. Gribble. Deterministic process groups in dOS. In Proceedings of the Ninth Symposium on Operating Systems Design and Implementation (OSDI '10), Oct. 2010.

Digital Library

[5]

T. Bergan, L. Ceze, and D. Grossman. Input-covering schedules for multithreaded programs. In Proceedings of the 2013 ACM SIGPLAN international conference on Object oriented programming systems languages & applications, pages 677--692. ACM, 2013.

Digital Library

[6]

R. L. Bocchino, Jr., V. S. Adve, D. Dig, S. V. Adve, S. Heumann, R. Komuravelli, J. Overbey, P. Simmons, H. Sung, and M. Vakilian. A type and effect system for deterministic parallel java. In Conference on Object-Oriented Programming Systems, Languages, and Applications (OOPSLA '09), pages 97--116, Oct. 2009.

Digital Library

[7]

T. C. Bressoud and F. B. Schneider. Hypervisor-based fault tolerance. In Proceedings of the 15th ACM Symposium on Operating Systems Principles (SOSP '95), Dec. 1995.

Digital Library

[8]

D. L. Bruening. Efficient, transparent, and comprehensive runtime code manipulation. PhD thesis, 2004. Supervisor-Amarasinghe, Saman.

Digital Library

[9]

M. Burrows. The chubby lock service for loosely-coupled distributed systems. In Proceedings of the Seventh Symposium on Operating Systems Design and Implementation (OSDI '06), pages 335--350, 2006.

Digital Library

[10]

J. Chow, T. Garfinkel, and P. M. Chen. Decoupling dynamic program analysis from execution in virtual environments. In Proceedings of the USENIX Annual Technical Conference (USENIX '08), June 2008.

Digital Library

[11]

Clam AntiVirus. http://www.clamav.net/.

[12]

criu. Criu. http://criu.org, 2015.

[13]

H. Cui, J. Wu, C.-C. Tsai, and J. Yang. Stable deterministic multithreading through schedule memoization. In Proceedings of the Ninth Symposium on Operating Systems Design and Implementation (OSDI '10), Oct. 2010.

Digital Library

[14]

H. Cui, J. Wu, J. Gallagher, H. Guo, and J. Yang. Efficient deterministic multithreading through schedule relaxation. In Proceedings of the 23rd ACM Symposium on Operating Systems Principles (SOSP '11), pages 337--351, Oct. 2011.

Digital Library

[15]

H. Cui, J. Simsa, Y.-H. Lin, H. Li, B. Blum, X. Xu, J. Yang, G. A. Gibson, and R. E. Bryant. Parrot: a practical runtime for deterministic, stable, and reliable threads. In Proceedings of the 24th ACM Symposium on Operating Systems Principles (SOSP '13), Nov. 2013.

Digital Library

[16]

H. Cui, R. Gu, C. Liu, and J. Yang. Paxos made transparent. In Proceedings of the 25th ACM Symposium on Operating Systems Principles (SOSP '15), Oct. 2015.

Digital Library

[17]

J. Devietti, B. Lucia, L. Ceze, and M. Oskin. DMP: deterministic shared memory multiprocessing. In Fourteenth International Conference on Architecture Support for Programming Languages and Operating Systems (ASPLOS '09), pages 85--96, Mar. 2009.

Digital Library

[18]

J. Erickson, M. Musuvathi, S. Burckhardt, and K. Olynyk. Effective data-race detection for the kernel. In Proceedings of the Ninth Symposium on Operating Systems Design and Implementation (OSDI '10), Oct. 2010.

Digital Library

[19]

Z. Guo, C. Hong, M. Yang, D. Zhou, L. Zhou, and L. Zhuang. Rex: Replication at the speed of multi-core. In Proceedings of the 2014 ACM European Conference on Computer Systems (EUROSYS '14), page 11. ACM, 2014.

Digital Library

[20]

J. Ha, M. Arnold, S. M. Blackburn, and K. S. McKinley. A concurrent dynamic analysis framework for multicore hardware. In Proceedings of the 24th ACM SIGPLAN Conference on Object Oriented Programming Systems Languages and Applications, OOPSLA '09, 2009.

Digital Library

[21]

N. Hunt, T. Bergan, L. Ceze, and S. Gribble. DDOS: Taming nondeterminism in distributed systems. In Eighteenth International Conference on Architecture Support for Programming Languages and Operating Systems (ASPLOS '13), pages 499--508, 2013.

Digital Library

[22]

K. Jee, V. P. Kemerlis, A. D. Keromytis, and G. Portokalidis. Shadowreplica: Efficient parallelization of dynamic data flow tracking. In Proceedings of the 9th ACM conference on Computer and communications security, 2013.

Digital Library

[23]

M. Kapritsos, Y. Wang, V. Quema, A. Clement, L. Alvisi, M. Dahlin, et al. All about eve: Execute-verify replication for multi-core servers. In Proceedings of the Tenth Symposium on Operating Systems Design and Implementation (OSDI '12), volume 12, pages 237--250, 2012.

Digital Library

[24]

O. Laadan, N. Viennot, and J. Nieh. Transparent, lightweight application execution replay on commodity multiprocessor operating systems. In ACM SIGMETRICS Performance Evaluation Review, volume 38, pages 155--166, 2010.

Digital Library

[25]

O. Laadan, N. Viennot, C. che Tsai, C. Blinn, J. Yang, and J. Nieh. Pervasive detection of process races in deployed systems. In Proceedings of the 23rd ACM Symposium on Operating Systems Principles (SOSP '11), Oct. 2011.

Digital Library

[26]

L. Lamport. Paxos made simple. http://research.microsoft.com/en-us/um/people/lamport/pubs/paxos-simple.pdf.

[27]

L. Lamport. Time, clocks, and the ordering of events in a distributed system. Comm. ACM, 21 (7):558--565, 1978.

Digital Library

[28]

L. Lamport. The part-time parliament. ACM Trans. Comput. Syst., 16(2):133--169, 1998.

Digital Library

[29]

D. Lee, B. Wester, K. Veeraraghavan, S. Narayanasamy, P. M. Chen, and J. Flinn. Respec: efficient online multiprocessor replayvia speculation and external determinism. In Fifteenth International Conference on Architecture Support for Programming Languages and Operating Systems (ASPLOS '10), pages 77--90, Mar. 2010.

Digital Library

[30]

T. Liu, C. Curtsinger, and E. D. Berger. DTHREADS: efficient deterministic multithreading. In Proceedings of the 23rd ACM Symposium on Operating Systems Principles (SOSP '11), pages 327--336, Oct. 2011.

Digital Library

[31]

C. Luk, R. Cohn, R. Muth, H. Patil, A. Klauser, G. Lowney, S. Wallace, V. Reddi, and K. Hazelwood. Pin: building customized program analysis tools with dynamic instrumentation. In Proceedings of the ACM SIGPLAN 2005 Conference on Programming Language Design and Implementation (PLDI '05), pages 190--200, 2005.

Digital Library

[32]

Y. Mao, F. P. Junqueira, and K. Marzullo. Mencius: building efficient replicated state machines for wans. In Proceedings of the 8th USENIX conference on Operating systems design and implementation, volume 8, pages 369--384, 2008.

Digital Library

[33]

D. Mazieres. Paxos made practical. Technical report, Technical report, 2007. http://www. scs. Stanford. edu/dm/home/papers, 2007.

[34]

N. Nethercote and J. Seward. Valgrind: a framework for heavyweight dynamic binary instrumentation. In Proceedings of the ACM SIGPLAN 2007 Conference on Programming Language Design and Implementation (PLDI '07), pages 89-- 100, June 2007.

Digital Library

[35]

E. B. Nightingale, D. Peek, P. M. Chen, and J. Flinn. Parallelizing security checks on commodity hardware. In Thirteenth International Conference on Architecture Support for Programming Languages and Operating Systems (ASPLOS '08), pages 308--318, 2008.

Digital Library

[36]

M. Olszewski, J. Ansel, and S. Amarasinghe. Kendo: efficient deterministic multithreading in software. In Fourteenth International Conference on Architecture Support for Programming Languages and Operating Systems (ASPLOS '09), pages 97--108, Mar. 2009.

Digital Library

[37]

S. Park, Y. Zhou, W. Xiong, Z. Yin, R. Kaushik, K. H. Lee, and S. Lu. PRES: probabilistic replay with execution sketching on multiprocessors. In Proceedings of the 22nd ACM Symposium on Operating Systems Principles (SOSP '09), pages 177-- 192, Oct. 2009.

Digital Library

[38]

F. Qin, C. Wang, Z. Li, H.-s. Kim, Y. Zhou, and Y. Wu. Lift: A low-overhead practical information flow tracking system for detecting security attacks. In MICRO 39: Proceedings of the 39th Annual IEEE/ACM International Symposium on Microarchitecture, pages 135--148, 2006.

Digital Library

[39]

J. Rao, E. J. Shekita, and S. Tata. Using paxos to build a scalable, consistent, and highly available datastore. Proc. VLDB Endow., 4(4):243--254, Jan. 2011. ISSN 2150-8097. 10.1145/2797022.279703310.14778/1938545.1938549. URL http://dx.doi.org/10.14778/1938545.1938549.

Digital Library

[40]

F. B. Schneider. Implementing fault-tolerant services using the state machine approach: A tutorial. ACM Computing Surveys (CSUR), 22(4):299--319, 1990.

Digital Library

[41]

tsan. Threadsanitizer. https://code.google.com/p/data-race-test/wiki/ThreadSanitizer, 2015.

[42]

S. Wallace and K. Hazelwood. Superpin: Parallelizing dynamic instrumentation for real-time performance. In Proceedings of the International Symposium on Code Generation and Optimization, 2007.

Digital Library

[43]

B. Wester, D. Devecsery, P. M. Chen, J. Flinn, and S. Narayanasamy. Parallelizing data race detection. In Eighteenth International Conference on Architecture Support for Programming Languages and Operating Systems (ASPLOS '13), pages 27--38, Mar. 2013.

Digital Library

[44]

D. Yuan, H. Mai, W. Xiong, L. Tan, Y. Zhou, and S. Pasupathy. SherLog: error diagnosis by connecting clues from run-time logs. In Fifteenth International Conference on Architecture Support for Programming Languages and Operating Systems (ASPLOS '10), pages 143--154, Mar. 2010.

Digital Library

Cited By

Pina LAndronidis ACadar CKaeli DPericàs M(2018)FreeDAProceedings of the 15th ACM International Conference on Computing Frontiers10.1145/3203217.3203237(1-10)Online publication date: 8-May-2018
https://dl.acm.org/doi/10.1145/3203217.3203237
Cui HGu RLiu CChen TYang JMiller EHand S(2015)Paxos made transparentProceedings of the 25th Symposium on Operating Systems Principles10.1145/2815400.2815427(105-120)Online publication date: 4-Oct-2015
https://dl.acm.org/doi/10.1145/2815400.2815427

RepFrame: An Efficient and Transparent Framework for Dynamic Program Analysis
1. Software and its engineering
  1. Software creation and management
    1. Software verification and validation
      1. Software defect analysis
  2. Software organization and properties
    1. Software system structures

Recommendations

Efficient Java exception handling in just-in-time compilation
Research Articles

Java uses exceptions to provide elegant error handling capabilities during program execution. However, the presence of exception handlers complicates the job of the just-in-time (JIT) compiler, while exceptions are rarely used in most programs. This ...
Exception Handling during Asynchronous Method Invocation (Research Note)
Euro-Par '02: Proceedings of the 8th International Euro-Par Conference on Parallel Processing

Exception handling mechanisms provided by sequential programming languages rely upon the call stack for the propagation of exceptions. Unfortunately, this is inadequate for handling exceptions thrown from asynchronously invoked methods. For instance, ...
A rule-based approach to proactive exception handling in business processes

Effectively handling exceptions in business process is an important capability of enterprises in the current global market environment, since their business processes are becoming more complex. Effective exception handling requires systematic support ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

APSys '15: Proceedings of the 6th Asia-Pacific Workshop on Systems

July 2015

152 pages

ISBN:9781450335546

DOI:10.1145/2797022

General Chair:
Kenji Kono
Keio Univ.
,
Publications Chair:
Takahiro Shinagawa
Univ. of Tokyo

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGOPS: ACM Special Interest Group on Operating Systems

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 July 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article
Research
Refereed limited

Conference

APSys '15

Sponsor:

SIGOPS

APSys '15: Asia-Pacific Workshop on Systems

July 27 - 28, 2015

Tokyo, Japan

Acceptance Rates

APSys '15 Paper Acceptance Rate 20 of 68 submissions, 29%;

Overall Acceptance Rate 169 of 430 submissions, 39%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
98
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)0

Reflects downloads up to 01 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Pina LAndronidis ACadar CKaeli DPericàs M(2018)FreeDAProceedings of the 15th ACM International Conference on Computing Frontiers10.1145/3203217.3203237(1-10)Online publication date: 8-May-2018
https://dl.acm.org/doi/10.1145/3203217.3203237
Cui HGu RLiu CChen TYang JMiller EHand S(2015)Paxos made transparentProceedings of the 25th Symposium on Operating Systems Principles10.1145/2815400.2815427(105-120)Online publication date: 4-Oct-2015
https://dl.acm.org/doi/10.1145/2815400.2815427

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten