Empirical Model Building and Methods: Exercise
Empirical Model Building and Methods: Exercise
Exercise
Liliana Guzmn Introduction
Outline
` ` ` ` `
Slide 1 - 2
Purpose
`
Discussing and complementing the content of the lecture Gathering experience in the empirical evaluation of software technologies Learning to document and review empirical evaluations Preparing the examination
Slide 1 - 3
Organization
`
Overview
`
At the beginning of the semester, students will build teams of 4 members. During the semester, each team will be responsible for:
` ` ` `
Planning and designing an empirical evaluation of a software technology Taking part in an empirical evaluation of a software technology Analyzing empirical data Presenting and documenting their results
The planning and design of an empirical evaluation (along with the submission of the corresponding reports) during the semester time is mandatory for being allowed to take the exam.
Slide 1 - 4
Organization
`
How to?
`
Exercise sheet will be published 1 week before the exercise class Teams are expected to:
` ` `
Solve the assigned tasks Document their results using the predefined templates Present their solutions during the exercise class
Students and tutor will discuss the proposed solutions together in the exercise class. Teams are expected to enhance their solutions based on the previous discussions
Empirical Model Building and Methods
Slide 1 - 5
Schedule
` `
20.04.2012 Administrative Information and topic assignments 27.04.2012 Research plan (1): Problem statement: Understanding object of study and quality focus 11.05.2012 Research plan (II): Problem statement: Research purpose, research goal, hypotheses and preliminary operationalization 25.05.2012 Research design I: Problem statement, sampling strategy, study selection and overview of evaluation design (Postpone to 01.06.2012) 08.06.2012 Research design II: Concrete Design. Separates deadlines for each team. (15/22/29.06.2012) 22/29.06.2012 and 06.07.2012 Submission of final version of research plan and design. 06.07.2012 Empirical evaluation 13.07.2012 Data analysis(2 session) and summary of the lecture.
Slide 1 - 6 Empirical Model Building and Methods
` ` `
Literature
`
Wohlin, C. , Runeson, P., Hst, M., Ohlsson, M., Regnell, B., Wessln, A.: Experimentation in Software Engineering: An Introduction, Kluwer Academic Publishers, 2000 Boehm, Rombach, Zelkowitz (Eds): Foundations of Empirical Software Engineering Legacy of Victor R. Basili, Springer Berlin Heidelberg New York, 2005 Juristo, N., and Moreno, A.: Basics of Software Engineering Experimentation, Kluwer Academic Publishers, 2001
Slide 1 - 7
Administrative information
`
Exercise class
` `
Tutor: Liliana Guzmn Contact: [email protected] Location: Building 32 Room 426 Website: http://wwwagse.informatik.unikl.de/teaching/ese/ss2012/
Slide 1 - 8
Topics
`
Project management
`
Characterizing expert estimation of software development effort with respect to the factors used and accuracy from the perspective of a project manager in the context of incremental software development
Evaluating SPECULA with respect to its usability and ease to use from the perspective of project manager and software developers in the context of software development
Slide 1 - 10
Topics
`
Process modeling
`
Evaluating the Software & Systems Process Engineering MetaModel (SPEM) with respect to its understandability and process compliance for modeling software development processes from the perspective of quality manager in the context of software development
Comparison of SPEM models and MVP-L models with respect to the generality from the perspective of quality managers in the context of software development
Comparison of SPEM models and MVP-L models with respect to the changeability from the perspective of quality managers in the context of software development
Empirical Model Building and Methods
Slide 1 - 11
Topics
`
Evaluating GQM+ tool with respect to its usability for modeling measureable goals and its impact on the collaboration during the modeling process from the perspective of a quality manager in the context of software organizations
Slide 1 - 12
Topics
`
Safety modeling
`
Characterizing safety modeling techniques with respect to their state of the practice in the context of embedded systems in the avionic domain from the perspective of project manager in the context of the development of software-based safety critical systems
Comparison of safety models (i.e. Fault trees and Component fault trees models) with respect to their impact on the communication among stakeholders from the perspective of software and system engineers in the context of the development of software-based safety critical systems
Slide 1 - 13
Topic assignment
` ` ` ` ` `
S. Lutsch, S.A. Scherr, S. Hupp and M. Koch Z. Dai, M. Mlitat and A. Guschkwoski A. Selleri Rocha and A. Bogo P. Iraguha and B. Palanisamy A. Atalar and A. C. Kurur D, Krovachenko, A. Schrer and P. Feth
Empirical Model Building and Methods
Purpose:
` `
Specification of the study object Specification of the quality focus (preliminary draft)
Documentation:
`
Presentation (27.04.2012)
`
Slide 1 - 15