Managing projects by data

Version: 2.0
Author: Le The Hung

Sep 25, 2002

Instructor: Le The Hung

Head of SEPG

© 2001 FPT-SOFT 04e-BM/NS/HDCV/FSOFT

 Introduction

Course duration: 1 hour 45’

Purpose: Practical use of data for managing projects
Targeted attendees: Team leaders, SEPG, SQA,
project managers
Tests/quiz: Quiz in 15’ for new attendants

FPT-Soft Confidential TRAINING MATERIALS 2

 Objectives

After the course, student will:

 Understand Fsoft metric system.

 Know about Fsoft PCBs and norms.

 Be able to use data for managing projects.

FPT-Soft Confidential TRAINING MATERIALS 3

 Table of contents

 Fsoft metric system – 45’

 Fsoft PCBs and Norms – 45’
 Project database template – 15’
 Quiz – 15’

FPT-Soft Confidential TRAINING MATERIALS 4

 Fsoft metric system
 Why it’s needed?
 Metric set
 Analysis tools
 Fsoft SLC in quantitative management

FPT-Soft Confidential TRAINING MATERIALS 5

 Why: Fsoft quality objective

“FPT-SOFT is committed to deliver

products that fully meet
customer’s requirements on
schedule defined in the project
plan”

FPT-Soft Confidential TRAINING MATERIALS 6

 Why: International standards
 ISO 9001:2001
 8.2.3 Monitoring and measurement of the processes
 8.4 Analysis of data

 CMM/SEI 1.1:
 PA.G1: The quantitative process management activities
are planned
 PA.G2: The process performance of the project's defined
software process is controlled quantitatively
 PA.G3: The process capability of the organization's
standard software process is known in quantitative terms

FPT-Soft Confidential TRAINING MATERIALS 7

 Why: Production improvements

FPT-Soft Confidential TRAINING MATERIALS 8

 Metric set: System view

Process Capability Baseline

Process Database and FPT-Soft norms

Quality Managing& Post

Estimation Planning Devmnt
Control Monitoring Mortem
Project

Project Database

FPT-Soft Confidential TRAINING MATERIALS 9

 Metric set: Collected data
 Effort (Project, work product, process, type
of activity): Weekly

 Schedule (Start-date, expected end-date,

actual end-date, delivery): At milestones

 Defect (Project, work product, stage

detected, QC activities, stage injected,
process origin, severity, classification type,
priority): Weekly

 Size (Total, work product, activity): At

milestones

 Requirement (Total, size, status): Weekly

 Customer complaints, customer

satisfaction survey point, NC

 Tools: Fsoft management suite (Timesheet,

DMS, Project database, Dashboard, Fsoft
Insight)
FPT-Soft Confidential TRAINING MATERIALS 10
 Metric set: Calculated indicators

 Effort (Effectiveness, deviation): Weekly

 Schedule (Timeliness, deviation): At

milestones

 Defect (Defect rate, leakage): Weekly

 Size (Deviation): At milestones

 Requirement (Completeness): Weekly

 Productivity, customer satisfaction,

process compliance, distribution (Effort,
defects): At the end of project

 Status (Effort, Schedule, Defect): Weekly

 Tools: Fsoft management suite (Timesheet,

DMS, Project database, Dashboard, Fsoft
Insight)

FPT-Soft Confidential TRAINING MATERIALS 11

 Metric set: Work Flow

Collect project Calculate project Analyze to

Create Metric Plan
data metrics manage project

FPT-SOFT Norms Project Database Process Database Collect process

data

Create process Calculate process

Establish Norms
baseline metrics

Analyze to
manage process
Process Capability
Data verification
Baseline (PCB)
Input Report
Output

Flow

FPT-Soft Confidential TRAINING MATERIALS 12

 Fsoft SLC models: Manage by data

FPT-Soft Confidential TRAINING MATERIALS 13

 Initiation stage: Norms for WO
1. Overview
The Initiation stage is the start of the SLC, in which:
 Project's software scope and boundary conditions, including the operational
vision and proposed products, are established.
 Overall cost and schedule of the project are estimated.
 Potential risks are defined.

2. Metrics
 Estimated size, estimated effort and planned schedule for the project.
 Target value of the quality goals for the project: Timeliness, Completeness,
Leakage, Correct Cost, Customer Satisfaction, Process Compliance, Response
Time.
 Actual data of the stage: Actual effort and actual schedule for the stage.

3. Help
 Use Fsoft norms for overall estimating and setting goals.
 Record in the WO, Estimation sheets, Project database

FPT-Soft Confidential TRAINING MATERIALS 14

 Definition stage: PCB for Planning
1. Overview
 Studying and clarifying user requirements.
 Preparing and releasing SRS.
 Negotiating Acceptance Criteria with customer.
 Updating and releasing complete project plan.

2. Metrics
 Estimated size for the project, estimated effort and planned schedule for the
stage.
 Progress values of the quality goals: Timeliness, Completeness, Correct Cost.
 Actual data of the stage: Actual effort and actual schedule for the stage, actual
size and defects of the project plan, URD and SRS.

3. Help
 Use Fsoft norms for detail estimating and planning.
 Fill data in the Project database
 Analyse by viewing the Charts/Status and log issue in the
Issue sheet

FPT-Soft Confidential TRAINING MATERIALS 15

 Solution stage: Review metrics
1. Overview
The main purpose of this stage is to define an effective solution to meet customer
requirements.
Analyzing and creating a good design for the software package are the main
activities.

2. Metrics
 Estimated effort and planned schedule for the stage.
 Progress values of the quality goals : Timeliness, Completeness, Correct Cost,
Process Compliance.
 Actual data of the stage: Actual effort and actual schedule for the stage, actual
size and defects of the ADD and Test Plan.

3. Help
 Use Fsoft norms for re-estimating and re-planning.
 Fill data in the Project database
 Analyse by viewing the Charts/Status and log issue in the
Issue sheet

FPT-Soft Confidential TRAINING MATERIALS 16

 Construction stage: Data analysis
1. Overview
The goal of the construction stage is to develop the system.
Coding and testing for the software package are the main activities.

2. Metrics
 Estimated effort and planned schedule for the stage.
 Progress values of the quality goals : Timeliness, Completeness, Correct Cost,
Process Compliance.
 Actual data of the stage: Actual effort and actual schedule for the stage, actual
size and defects of the DDD, Test case and Test Data, modules and unit
programs.

3. Help
 Use Fsoft norms for re-estimating and re-planning.
 Fill data in the Project database
 Analyse by viewing the Charts/Status and log issue in the
Issue sheet

FPT-Soft Confidential TRAINING MATERIALS 17

 Transition stage: Leakage
1. Overview
 The focus of the Transition stage is to ensure that software is available for its
end users. Delivering software to customer, implementing software systems on
customer site and conducting test activities for acceptance are main activities
of this stage.

2. Metrics
 Estimated effort and planned schedule for the stage.
 Progress values of the quality goals: Timeliness, Completeness, Leakage,
Correct Cost, Process Compliance.
 Actual data of the stage: Actual effort and actual schedule for the stage, actual
size and defects of the software package.

3. Help
 Use Fsoft norms for re-estimating and re-planning.
 Fill data in the Project database
 Analyse by viewing the Charts/Status and log issue in the
Issue sheet

FPT-Soft Confidential TRAINING MATERIALS 18

 Termination stage: Fsoft Data
1. Overview
 The project closes at this stage when customer accepts the whole project and
signs off the contract. Project assets must be collected and transferred to Fsoft
process asset library.
 The goal of this stage is to summarize the results of the project and to provide
the project knowledge and experiences for other projects.

2. Metrics
 Estimated effort and planned schedule for the stage.
 Final values of the quality goals: Timeliness, Completeness, Leakage, Correct
Cost, Customer Satisfaction, Process Compliance.
 Actual data of the stage: Actual effort and actual schedule for the stage,
customer satisfaction point.

3. Help
 Compare Actual metrics with Fsoft norms and Project norms
 Analyse in post mortem report

FPT-Soft Confidential TRAINING MATERIALS 19

 Analysis tools: Cause-Effect
1. Purpose
 It help to accurately identify causes (or results) of a problem.

2. How to use
 Brainstorming.

Test Code Design Analysis

Defect
rate is
high

SQA Technology Team Time

FPT-Soft Confidential TRAINING MATERIALS 20

 Analysis tools: Pareto Chart
1. Purpose
 It helps identify most important issues by data.

2. How to use
 The rule 80:20.

50 120%
45
40 100%
Correction cost

35 80%
30
25 60%
20
15 40%
10 20%
5
0 0% Value
Code Analysis Design Test Others Accrued

FPT-Soft Confidential TRAINING MATERIALS 21

 Analysis tools: Control Chart
1. Purpose
 It helps to define and forecast uncontrolled cases.

2. How to use
 Average, Stdev, UCL, LCL of series of data

35.00%
30.00%
25.00%
20.00%
15.00%
10.00%
5.00%
0.00% Deviation
Average
UCL
LCL

FPT-Soft Confidential TRAINING MATERIALS 22

 Exercise
 Create the Control chart and conduct Causal
analysis

FPT-Soft Confidential TRAINING MATERIALS 23

 Fsoft PCBs and Norms
 Fsoft PCBs:
 PCB: Process capability baseline
 Based on data of post mortem projects and support
activities
 1.0: June 30, 2001
 Release Period: Quarterly, 6 months
 Prepared by SEPG, reviewed and approved by BOM
 Fsoft norms
 Based on PCBs and Fsoft business goals
 Established for 6 months
 Suggested by SEPG, reviewed and approved by BOM

FPT-Soft Confidential TRAINING MATERIALS 24

 Software PCB: Overview
 All projects have postmortem in the reporting
period
 Methodology:
 Average, Sigma, UCL, LCL
 Causal analysis of out of control limits
 Extraordinary cases are excluded
 Summary:
 The PCB of the period before the last period, the last PCB
 Last norms, suggested norm
 Improvement, issues

FPT-Soft Confidential TRAINING MATERIALS 25

 Software PCB: Conclusions
 Planned actions for last period
 Collect customer related metrics
 To use data effectively
 Results of these actions
 All mandatory software metrics are calculated
 Metrics have been used for setting project norms
 Issues in last period:
 Schedule deviation is high
 Review efficiency is low
 Suggested actions for next period
 Schedule estimation, customer communication, milestone
control
 Effort for review, review workshops, review guru

FPT-Soft Confidential TRAINING MATERIALS 26

 Software PCB: Requirement

 Accepted deliverable (%) 90|95|94.4

 Requirement completeness (%) 90|95|93.83
 Requirement stability (%) 7.5|5|11.3

80.0%
70.0%
60.0%
50.0%
40.0%
30.0%
20.0%
10.0%
0.0%

FPT-Soft Confidential TRAINING MATERIALS 27

 Software PCB: Schedule

 Schedule control is the most serious problem

 Timeliness (%) 84.9|95|58.6
 Project Schedule Deviation (%)
 Development: 23.5|10|62.5
 Maintenance: 5|10|30.6
 Delivery Schedule Deviation (%)
 Development: 13|10|25.0
 Maintenance: 5|10|6.0

FPT-Soft Confidential TRAINING MATERIALS 28

 Software PCB: Effort

 Effort Deviation (%)

 Development: 29.8|10|40.48
 Maintenance: 4.9|10|32.97
 Project management effort (%)
 Development: 4.5|7.5|6.33
 Maintenance: 3.8|7.5|6.78
 Quality Cost (%)
 Development: 39|30|34.49
 Maintenance: 34.8|30|47.66
 Correction Cost (%)
 Development: 16.3|12|11.65
 Maintenance: 18.4|12|12.49

FPT-Soft Confidential TRAINING MATERIALS 29

 Software PCB: Quality

 Review efficiency is too low

 Defect Rate (WDef/UCP): 9.5|8.5|9.0
 Leakage (WDef/UCP) 0.5|0.3|0.4
 Defect Removal Efficiency (%)
 Review 35|40|36.4
 Test 52|55|57.9
 Customer Satisfaction (Point) 80|85|73.5
120.0%

V alue

100.0%
A v erage
UCL
LCL
80.0%

60.0%

40.0%

20.0%

0.0%

FPT-Soft Confidential TRAINING MATERIALS 30

 Software PCB: Productivity

 Productivity (UCP/pd) 0.43|0.4|0.53

 Review Effectiveness (WDef/pd) 13.2|15|16.1
 Test Effectiveness (WDef/pd) 8.3|10|12.4

FPT-Soft Confidential TRAINING MATERIALS 31

 Fsoft norms

1. For a period of 6 months

2. Improvement requirements
based on last PCB

3. To use data effectively

 Using PCB for plan: All
processes
 Re-estimate size: After SRS
completion and at the end of
the project
 Analysis in progress: All
milestones
 Verification: SEPG

FPT-Soft Confidential TRAINING MATERIALS 32

 Fsoft norms

1. Requirement
 Accepted deliverable: 95%
 Requirement completeness:
95%

2. Schedule
 Timeliness: 75%
 Schedule Deviation: 10%
 Delivery Schedule Deviation:
10%

3. Effort
 Effort Deviation: 10%
 Management Effort: 7.5%
 Quality Cost: 30%
 Correction Cost: 12%

FPT-Soft Confidential TRAINING MATERIALS 33

 Fsoft norms

3. Product Quality
 Defect Rate: 10WDef/UCP
 Leakage: 0.4WDef/UCP
 Review efficiency: 45%
 Test efficiency: 50%
 Customer Satisfaction: 90 points

4. Productivity
 Coding: 0.5UCP/pd
 Review: 15WDef/pd
 Test: 12WDef/pd

FPT-Soft Confidential TRAINING MATERIALS 34

 Project database template
 To plan project using Norms
 To manage project by data
 To help for creating a project report
Process complaince
Customer's complaints
Defect
Completeness
Timeliness
Size
Effort
Duration
Tracking Metrics

0% 20% 40% 60% 80% 100%

Expensed Remain

FPT-Soft Confidential TRAINING MATERIALS 35

 3 rules
 Customer is our God
 Most of the World could be changed
 Managing Quality is always profitable

FPT-Soft Confidential TRAINING MATERIALS 36

 Sources & references
 Sources
 Fsoft manual
 Fsoft standard life cycle models and tailoring guidelines
 Fsoft metric guidelines and project database template
 Assessment and analysis tools guidelines
 Fsoft process databases
 Fsoft PCB reports
 Fsoft norms
 Recommended readings
 TTVN/SYS/Fsoft QMS/document/master list
 TTVN/SYS/ Fsoft QMS/Data/
 TTVN/SYS/ Fsoft QMS/PCB&Norm/

FPT-Soft Confidential TRAINING MATERIALS 37

Questions and Answers
 Conclusion
 Pls. give your assessment

FPT-Soft Confidential TRAINING MATERIALS 39

 Quiz
 Total 100 points = 20 questions x 5 points/question
 Duration: 15’
 Pass criteria: 75 points
 Feel free to use any available material
 Don’t brainstorm.

FPT-Soft Confidential TRAINING MATERIALS 40