Conferencia

Kicillof, N.; Grieskamp, W.; Tillmann, N.; Braberman, V. "Achieving both model and code coverage with automated gray-box testing" (2007) Proceedings of the 3rd International Workshop Advances in Model Based Testing, AMOST 2007:1-11
La versión final de este artículo es de uso interno de la institución.
Consulte el artículo en la página del editor

Abstract:

We have devised a novel technique to automatically generate test cases for a software system, combining black-box model-based testing with white-box parameterized unit testing. The former provides general guidance for the structure of the tests in the form of test sequences, as well as the oracle to check for conformance of an application under test with respect to a behavioral model. The latter finds a set of concrete parameter values that maximize code coverage using symbolic analysis. By applying these techniques together, we can produce test definitions (expressed as code to be run in a test management framework) that exercise all selected paths in the model, while also covering code branches specific to the implementation. These results cannot be obtained from any of the individual approaches alone, as the model cannot predict what values are significant to a particular implementation, while parameterized unit testing requires manually written test sequences and correctness validations. We provide tool support, integrated into our model-based testing tool. Copyright 2007 ACM.

Registro:

Documento: Conferencia
Título:Achieving both model and code coverage with automated gray-box testing
Autor:Kicillof, N.; Grieskamp, W.; Tillmann, N.; Braberman, V.
Ciudad:London
Filiación:FCEyN -UBA
Microsoft Research
FCEyN- UBA/CONICET
Idioma: Inglés
Palabras clave:Concolic execution; Model-based testing; Parameterized unit testing; Symbolic execution; Test-case generation; Concolic execution; Model-based testing; Parameterized unit testing; Symbolic execution; Test-case generation; Behavioral research; Mathematical models; Parameter estimation; Parameterization; Computer software
Año:2007
Página de inicio:1
Página de fin:11
DOI: http://dx.doi.org/10.1145/1291535.1291536
Título revista:Proceedings of the 3rd International Workshop Advances in Model Based Testing, AMOST 2007
Título revista abreviado:Proc. Int. Workshop Adv. Model Based Testing AMOST
Registro:https://bibliotecadigital.exactas.uba.ar/collection/paper/document/paper_97815959_v_n_p1_Kicillof

Referencias:

  • Alur, R., Henzinger, T.A., Kupferman, O., Vardi, M., Alternating refinement relations (1998) LNCS, 1466, pp. 163-178. , Proceedings of the 9th International Conference on Concurrency Theory CONCUR'98, of
  • Artho, C., Barringer, H., Goldberg, A., Havelund, K., Khurshid, S., Lowry, M., Pasareanu, C., Washington, R., Combining test ease generation and runtime verification (2005) Theor. Comput. Sci, 336 (2-3), pp. 209-234
  • Barnett, M., Grieskamp, W., Nachmanson, L., Schulte, W., Tillmann, N., Veanes, M., Towards a tool environment for model-based testing with AsmL (2003) LNCS, 2931, pp. 264-280. , Petrenko and Ulrich, editors, Formal Approaches to Software Testing, FATES 2003, of, Springer
  • Beck, K., (2001) Extreme Programming Explained: Embrace Change, , Addison-Wesley
  • Beck, K., (2002) Test-Driven Development: By Example, , Addison-Wesley
  • Campbell, C., Grieskamp, W., Nachmanson, L., Schulte, W., Tillmann, N., Veanes, M., Testing concurrent object-oriented systems with spec explorer (2005) Lecture Notes in Computer Science, 3582, pp. 542-547. , J. Fitzgerald, I. J. Hayes, and A. Tarlecki, editors, FM 2005: Formal Methods, International Symposium of Formal Methods Europe, of, Springer
  • de Alfaro, L., Henzinger, T.A., Interface automata (2001) Proceedings of the 8th European Software Engineering Conference and the 9th ACM SIGSOFT Symposium on the Foundations of Software Engineering (ESEC/FSE), pp. 109-120. , ACM
  • Gamma, E., Beck, K., (2001) JUnit: A regression testing framework, , http://www.junit.org
  • Godefroid, P., Klarlund, N., Sen, K., DART: Directed automated random testing (2005) ACM SlGPLAN 2005 Conference on Programming Language Design and Implementation (PLDI'05), pp. 213-223
  • Grieskamp, W., Multi-paradigmatic model-based testing (2006) Lecture Notes in Computer Science, 4262, pp. 1-19. , K. Havelund, M. Núñez, G. Rosu, and B. Wolff, editors, FATES/RV 2006: Formal Approaches to Testing and Runtime Verification, of, Springer, invited contribution
  • Grieskamp, W., Gurevich, Y., Schulte, W., Veanes, M., Generating finite state machines from abstract state machines (2002) ISSTA'02, volume 27 of Software Engineering Notes, pp. 112-122. , ACM
  • Grieskamp, W., Kicillof, N., A schema language for coordinating construction and composition of partial behavior descriptions (2006) SCESM, pp. 59-66. , J. Whittle, L. Geiger, and M. Meisinger, editors, ACM
  • Grieskamp, W., Kicillof, N., Tillmann, N., Action machines: A framework for encoding and composing partial behaviors (2006) International Journal of Software Engineering and Knowledge Engineering, 16 (5), pp. 705-726
  • Grosu, R., Smolka, S.A., Monte carlo model checking (2005) Lecture Notes in Computer Science, 3440, pp. 271-286. , N. Halbwachs and L. D. Zuck, editors, TACAS, of, Springer
  • King, J.C., Symbolic execution and program testing (1976) Commun. ACM, 19 (7), pp. 385-394
  • Li, Z., Tan, L., Wang, X., Lu, S., Zhou, Y., Zhai, C., Have things changed now? - An empirical study of bug characteristics in modern open source software (2007) ICSE: Proceedings 29th International Conference on Software Engineering
  • Robinson, H., Proceedings of the International Conference on Software Testing Analysis and Review (STARWEST 1999), Software Quality Engineering, San Jose, CA, USA, October 1999, , Finite state model-based testing on a shoestring In
  • Sen, K., Agha, G., Cute and jCUTE : Concolic unit testing and explicit path model-checking tools (2006) Lecture Notes in Computer Science, 4144, pp. 419-423. , 18th International Conference on Computer Aided Verification CAV06, of, Springer, Tool Paper
  • Stobie, K., Model based testing in practice at microsoft (2004) Electronic Notes in Theoretical Computer Science, 111. , Proceedings of the Workshop on Model Based Testing MBT 2004, of, Elsevier
  • Tillmann, N., Schulte, W., Unit tests reloaded: Parameterized unit testing with symbolic execution (2006) IEEE software, 23, pp. 38-47
  • O. Tkachuk, M. B. Dwyer, and C. S. Pasareanu. Automated environment generation for software model checking. In ASE, pages 116-129. IEEE Computer Society, 2003Tretmans, J., Belinfante, A., Automatic testing with formal methods. In EuroSTAR'99: 7th European Int. Conference on Software Testing, Analysis & Review, Barcelona, Spain (1999) EuroStar Conferences, , November 8-12, Galway, Ireland
  • Utting, M., Legeard, B., (2006) Practical Model-Based Testing: A Tools Approach, , Morgan Kaufmann Publishers Inc, San Francisco, CA, USA
  • Venolia, G., DeLine, R., LaToza, T., Software development at microsoft observed (2005), Technical Report MSR-TR-2005-140, Microsoft Research, OctoberW. Visser, C. S. Pasareanu, and R. Pelánek. Test input generation for red-black trees using abstraction. In D. F. Redmiles, T. Ellman, and A. Zisman, editors, ASE, pages 414-417. ACM, 2005@@@!v9015!ACM Special Interest Group on Programming Languages

Citas:

---------- APA ----------
Kicillof, N., Grieskamp, W., Tillmann, N. & Braberman, V. (2007) . Achieving both model and code coverage with automated gray-box testing. Proceedings of the 3rd International Workshop Advances in Model Based Testing, AMOST 2007, 1-11.
http://dx.doi.org/10.1145/1291535.1291536
---------- CHICAGO ----------
Kicillof, N., Grieskamp, W., Tillmann, N., Braberman, V. "Achieving both model and code coverage with automated gray-box testing" . Proceedings of the 3rd International Workshop Advances in Model Based Testing, AMOST 2007 (2007) : 1-11.
http://dx.doi.org/10.1145/1291535.1291536
---------- MLA ----------
Kicillof, N., Grieskamp, W., Tillmann, N., Braberman, V. "Achieving both model and code coverage with automated gray-box testing" . Proceedings of the 3rd International Workshop Advances in Model Based Testing, AMOST 2007, 2007, pp. 1-11.
http://dx.doi.org/10.1145/1291535.1291536
---------- VANCOUVER ----------
Kicillof, N., Grieskamp, W., Tillmann, N., Braberman, V. Achieving both model and code coverage with automated gray-box testing. Proc. Int. Workshop Adv. Model Based Testing AMOST. 2007:1-11.
http://dx.doi.org/10.1145/1291535.1291536