ºÝºÝߣ

ºÝºÝߣShare a Scribd company logo
Implementing a successful metrics system in an IT company
Muntean Ramona
Measurements & Best Practices @ISDC
IT¡¯S IMPORTANT TO YOU
IT¡¯S REDUCING UNCERTAINTY
TELLS YOU MORE THAN YOU KNEW BEFORE

Better informed decisions
Tracking the progress of the objectives
Managing the achievements of goals

WE CAN MANAGE WHAT WE CAN EASILY MEASURE
GOALS

Goal

Business growth rate
Profit margin
Bids success rate
Personnel turnover

Success
Factors

SUCCES FACTORS

Key Performance
Indicators

Productivity
Predictability
Quality
Competitiveness
Client Satisfaction
Employee Satisfaction

Metrics / Data

Projects, Processes, People

TOP DOWN APPROACH ¨C COMPANY GOALS
QUALITY
Cost of Quality
(CoQ)
Cost of Appraisal
(CoA)

Reviews (1st time)
Code
Requirements
Design
Test plans, test scripts

Testing (1st time)
Audits

Cost of Prevention
(CoP)

Training
Procedures, methods
Tools, systems
Planning
Quality improvement
Measurements

Cost of Non-Conformance
(CNC)

Fixing defects
Re-work code review
Re-work doc review
Re-reviews
Re-testing
QUALITY TRENDS
Improve

KPI¡¯s
Productivity
Predictability
Quality
Client Satisfaction
Team Satisfaction

Metrics,
Trends
Key Performance
Indicators

METRICS ANALIZED
Velocity: Story Points/sprint
Estimation deviation
%Re-work, DDR, CoQ trends
Demo / Release success score

Tooling, Data

Projects, Processes, People

BOTTOM UP APPROACH ¨C PROJECT¡¯S KPI
TRENDS
Story Points done / sprint
60
55
50
45
40
35
30
25
20
15
10

55
43

41

43
32
29
23

22

S4

S5

S6

S8

S9

S10

22

S11

S12

S13
TRENDS
Defect Detection Rate (DDR)
90.00%

We can learn how
review is
influencing the
product quality in
correlation with
defects found by
testers.

80.00%
70.00%
60.00%
50.00%
40.00%
30.00%
20.00%
10.00%
0.00%

S4

S5

S6

DDR_Review

S7

S8
DDR_Testing

S9

S10

S11

DDR_Customer

S12

S13
DEVELOPING MEASUREMENT PROCESS
DO

PLAN
Define procedures:

Collect metrics:

- Metrics to be collected
- Collection practices & tooling
- Analysis & reporting
- Feedback integration

- Tailor procedures (if the case)
- Record and store data
- Use proper tools & templates
- Check data accuracy

Identify scope:
- Goals, objectives
- ¡°Problems¡± that need answer
- Measurements needs

Evolve process:
- Evaluate progress
- Evaluate process
- Recommend improvements

ACT

Analyze metrics:
- Aggregate, correlate data
- Prepare reports
- Discuss trends, identify thresholds
- Revise procedures

CHECK
MEASUREMENT PARADOX?
I want a car that uses as little petrol as possible.
I have chosen 2 cars and will do 3 test drives with both of them.
Test drive 1

Test drive 2

Test drive 3

Average

Car A

1 km/l

1 km/l

4 km/l

2 km/l

Car B

1.5 km/l

1.5 km/l

1.5 km/l

1.5 km/l

Test drive 1

Test drive 2

Test drive 3

Average

Car A

1 l/km

1 l/km

0.25 l/km

0.75 l/km

Car B

0.667 l/km

0.667 l/km

0.667 l/km

0.667 l/km

The car that uses less
petrol is car A which does
more kilometres per litre.
But, if I had measured
litres per kilometre, car B
uses less litres per
kilometre and is the better
car.
Implementing a successful metrics system

More Related Content

Viewers also liked (20)

Maximizing the Effectiveness of the Partnership with your CRO
Maximizing the Effectiveness of the Partnership with your CROMaximizing the Effectiveness of the Partnership with your CRO
Maximizing the Effectiveness of the Partnership with your CRO
Medpace
?
Outsourcing
OutsourcingOutsourcing
Outsourcing
clinicaloutsourcing
?
IIR Partnerships- CRO Alliances in 2015
IIR Partnerships- CRO Alliances in 2015IIR Partnerships- CRO Alliances in 2015
IIR Partnerships- CRO Alliances in 2015
guest4954d3
?
Lean Workbench For Creating And Tracking Metrics That Matter
Lean Workbench For Creating And Tracking Metrics That MatterLean Workbench For Creating And Tracking Metrics That Matter
Lean Workbench For Creating And Tracking Metrics That Matter
Jennifer Rubinovitz
?
Ç°¶ËµÄ¼ÛÖµÌåÏÖ
Ç°¶ËµÄ¼ÛÖµÌåÏÖÇ°¶ËµÄ¼ÛÖµÌåÏÖ
Ç°¶ËµÄ¼ÛÖµÌåÏÖ
asapphire
?
Maritz: Avoiding financial penalties with improved quality and performance
Maritz: Avoiding financial penalties with improved quality and performanceMaritz: Avoiding financial penalties with improved quality and performance
Maritz: Avoiding financial penalties with improved quality and performance
CAST
?
11 apr13 1130 manage and report spend in third party interactions canonica wh...
11 apr13 1130 manage and report spend in third party interactions canonica wh...11 apr13 1130 manage and report spend in third party interactions canonica wh...
11 apr13 1130 manage and report spend in third party interactions canonica wh...
Agn¨¨s Canonica
?
SelfieCap
SelfieCapSelfieCap
SelfieCap
Jennifer Rubinovitz
?
Five Event Marketing Metrics that Matter
Five Event Marketing Metrics that MatterFive Event Marketing Metrics that Matter
Five Event Marketing Metrics that Matter
EventMatrix
?
Let's Talk Business: Outsourcing event, 3 april 2012
Let's Talk Business: Outsourcing event, 3 april 2012Let's Talk Business: Outsourcing event, 3 april 2012
Let's Talk Business: Outsourcing event, 3 april 2012
The Events Agency
?
Outsourve vs inhouse events
Outsourve vs inhouse eventsOutsourve vs inhouse events
Outsourve vs inhouse events
Delphes Francoise
?
Background and Professional Work Examples
Background and Professional Work ExamplesBackground and Professional Work Examples
Background and Professional Work Examples
Distributor One, LLC
?
Recruitment trends
Recruitment trendsRecruitment trends
Recruitment trends
Pradeep Sahay
?
Bayer Commerzbank German Investment Seminar
Bayer Commerzbank German Investment SeminarBayer Commerzbank German Investment Seminar
Bayer Commerzbank German Investment Seminar
Bayer
?
Neocom2013 - Strategien und Ma?nahmen zur Senkung der Retourenquote im E-Comm...Neocom2013 - Strategien und Ma?nahmen zur Senkung der Retourenquote im E-Comm...
Neocom2013 - Strategien und Ma?nahmen zur Senkung der Retourenquote im E-Comm...
Roland Peter Schaefer
?
TechNexxus Outsourcing Fundamentals
TechNexxus Outsourcing FundamentalsTechNexxus Outsourcing Fundamentals
TechNexxus Outsourcing Fundamentals
TechNexxus, LLC
?
Engagement: The Ultimate Metric to Demonstrate Event ROI
Engagement: The Ultimate Metric to Demonstrate Event ROIEngagement: The Ultimate Metric to Demonstrate Event ROI
Engagement: The Ultimate Metric to Demonstrate Event ROI
DoubleDutch
?
Lean Six Sigma How To Conduct A Lean Event
Lean Six Sigma How To Conduct A Lean EventLean Six Sigma How To Conduct A Lean Event
Lean Six Sigma How To Conduct A Lean Event
Stephen Deas
?
Outsourcing: Best Practices at Pandemic Studios [GDC 2008]
Outsourcing: Best Practices at Pandemic Studios [GDC 2008]Outsourcing: Best Practices at Pandemic Studios [GDC 2008]
Outsourcing: Best Practices at Pandemic Studios [GDC 2008]
Kay Kim
?
FAMD OUTSOURCING EXPERIENCE - CCT Meeting - Gokarn1
FAMD OUTSOURCING EXPERIENCE - CCT Meeting - Gokarn1 FAMD OUTSOURCING EXPERIENCE - CCT Meeting - Gokarn1
FAMD OUTSOURCING EXPERIENCE - CCT Meeting - Gokarn1
PRABHASH GOKARN
?
Maximizing the Effectiveness of the Partnership with your CRO
Maximizing the Effectiveness of the Partnership with your CROMaximizing the Effectiveness of the Partnership with your CRO
Maximizing the Effectiveness of the Partnership with your CRO
Medpace
?
IIR Partnerships- CRO Alliances in 2015
IIR Partnerships- CRO Alliances in 2015IIR Partnerships- CRO Alliances in 2015
IIR Partnerships- CRO Alliances in 2015
guest4954d3
?
Lean Workbench For Creating And Tracking Metrics That Matter
Lean Workbench For Creating And Tracking Metrics That MatterLean Workbench For Creating And Tracking Metrics That Matter
Lean Workbench For Creating And Tracking Metrics That Matter
Jennifer Rubinovitz
?
Ç°¶ËµÄ¼ÛÖµÌåÏÖ
Ç°¶ËµÄ¼ÛÖµÌåÏÖÇ°¶ËµÄ¼ÛÖµÌåÏÖ
Ç°¶ËµÄ¼ÛÖµÌåÏÖ
asapphire
?
Maritz: Avoiding financial penalties with improved quality and performance
Maritz: Avoiding financial penalties with improved quality and performanceMaritz: Avoiding financial penalties with improved quality and performance
Maritz: Avoiding financial penalties with improved quality and performance
CAST
?
11 apr13 1130 manage and report spend in third party interactions canonica wh...
11 apr13 1130 manage and report spend in third party interactions canonica wh...11 apr13 1130 manage and report spend in third party interactions canonica wh...
11 apr13 1130 manage and report spend in third party interactions canonica wh...
Agn¨¨s Canonica
?
Five Event Marketing Metrics that Matter
Five Event Marketing Metrics that MatterFive Event Marketing Metrics that Matter
Five Event Marketing Metrics that Matter
EventMatrix
?
Let's Talk Business: Outsourcing event, 3 april 2012
Let's Talk Business: Outsourcing event, 3 april 2012Let's Talk Business: Outsourcing event, 3 april 2012
Let's Talk Business: Outsourcing event, 3 april 2012
The Events Agency
?
Background and Professional Work Examples
Background and Professional Work ExamplesBackground and Professional Work Examples
Background and Professional Work Examples
Distributor One, LLC
?
Bayer Commerzbank German Investment Seminar
Bayer Commerzbank German Investment SeminarBayer Commerzbank German Investment Seminar
Bayer Commerzbank German Investment Seminar
Bayer
?
Neocom2013 - Strategien und Ma?nahmen zur Senkung der Retourenquote im E-Comm...Neocom2013 - Strategien und Ma?nahmen zur Senkung der Retourenquote im E-Comm...
Neocom2013 - Strategien und Ma?nahmen zur Senkung der Retourenquote im E-Comm...
Roland Peter Schaefer
?
TechNexxus Outsourcing Fundamentals
TechNexxus Outsourcing FundamentalsTechNexxus Outsourcing Fundamentals
TechNexxus Outsourcing Fundamentals
TechNexxus, LLC
?
Engagement: The Ultimate Metric to Demonstrate Event ROI
Engagement: The Ultimate Metric to Demonstrate Event ROIEngagement: The Ultimate Metric to Demonstrate Event ROI
Engagement: The Ultimate Metric to Demonstrate Event ROI
DoubleDutch
?
Lean Six Sigma How To Conduct A Lean Event
Lean Six Sigma How To Conduct A Lean EventLean Six Sigma How To Conduct A Lean Event
Lean Six Sigma How To Conduct A Lean Event
Stephen Deas
?
Outsourcing: Best Practices at Pandemic Studios [GDC 2008]
Outsourcing: Best Practices at Pandemic Studios [GDC 2008]Outsourcing: Best Practices at Pandemic Studios [GDC 2008]
Outsourcing: Best Practices at Pandemic Studios [GDC 2008]
Kay Kim
?
FAMD OUTSOURCING EXPERIENCE - CCT Meeting - Gokarn1
FAMD OUTSOURCING EXPERIENCE - CCT Meeting - Gokarn1 FAMD OUTSOURCING EXPERIENCE - CCT Meeting - Gokarn1
FAMD OUTSOURCING EXPERIENCE - CCT Meeting - Gokarn1
PRABHASH GOKARN
?

Similar to Implementing a successful metrics system (20)

CMMI & Six Sigma Integration
CMMI & Six Sigma IntegrationCMMI & Six Sigma Integration
CMMI & Six Sigma Integration
Anand Subramaniam
?
DMAIC Vs. DMADV
DMAIC Vs. DMADVDMAIC Vs. DMADV
DMAIC Vs. DMADV
Anand Subramaniam
?
WWAsia14_IFMA_Speaker-_RAO
WWAsia14_IFMA_Speaker-_RAOWWAsia14_IFMA_Speaker-_RAO
WWAsia14_IFMA_Speaker-_RAO
Rao Srinivasa MRICS
?
DMAIC Components
DMAIC ComponentsDMAIC Components
DMAIC Components
Anand Subramaniam
?
Six Sigma & Process Capability
Six Sigma & Process CapabilitySix Sigma & Process Capability
Six Sigma & Process Capability
Eric Blumenfeld
?
Use the Windshield, Not the Mirror Predictive Metrics that Drive Successful ...
 Use the Windshield, Not the Mirror Predictive Metrics that Drive Successful ... Use the Windshield, Not the Mirror Predictive Metrics that Drive Successful ...
Use the Windshield, Not the Mirror Predictive Metrics that Drive Successful ...
Seapine Software
?
Basic Six Sigma Presentation
Basic Six Sigma PresentationBasic Six Sigma Presentation
Basic Six Sigma Presentation
vivekissar
?
PrADS Introduction & offerings 2017
PrADS Introduction & offerings 2017 PrADS Introduction & offerings 2017
PrADS Introduction & offerings 2017
Kiran Kumar Muthyala
?
Pbd Benchmarking
Pbd BenchmarkingPbd Benchmarking
Pbd Benchmarking
Palmers_Business_Development
?
Software Testing Competencies - Rishabh Software
Software Testing Competencies - Rishabh SoftwareSoftware Testing Competencies - Rishabh Software
Software Testing Competencies - Rishabh Software
Rishabh Software
?
Software Testing Process & Trend
Software Testing Process & TrendSoftware Testing Process & Trend
Software Testing Process & Trend
KMS Technology
?
Quality Course 1
Quality Course 1Quality Course 1
Quality Course 1
Fin1
?
Nesma autumn conference 2015 - Functional testing miniguide - Ignacio L¨®pez C...
Nesma autumn conference 2015 - Functional testing miniguide - Ignacio L¨®pez C...Nesma autumn conference 2015 - Functional testing miniguide - Ignacio L¨®pez C...
Nesma autumn conference 2015 - Functional testing miniguide - Ignacio L¨®pez C...
Nesma
?
1 marty howard_asq_qm_qe_resume
1 marty howard_asq_qm_qe_resume1 marty howard_asq_qm_qe_resume
1 marty howard_asq_qm_qe_resume
Marty Howard
?
generic Benchmarking for Continuous improvement
generic Benchmarking for Continuous improvementgeneric Benchmarking for Continuous improvement
generic Benchmarking for Continuous improvement
YKTang5
?
Heizer 06
Heizer 06Heizer 06
Heizer 06
shagitu
?
project QA&QC system training
project QA&QC system trainingproject QA&QC system training
project QA&QC system training
nagareddayya subbagari
?
Costof quality
Costof qualityCostof quality
Costof quality
Omnex Inc.
?
Super factory
Super factorySuper factory
Super factory
Manoj Verma
?
June2008 Hdi Quality Presentation
June2008   Hdi Quality PresentationJune2008   Hdi Quality Presentation
June2008 Hdi Quality Presentation
IT Service and Support
?
Six Sigma & Process Capability
Six Sigma & Process CapabilitySix Sigma & Process Capability
Six Sigma & Process Capability
Eric Blumenfeld
?
Use the Windshield, Not the Mirror Predictive Metrics that Drive Successful ...
 Use the Windshield, Not the Mirror Predictive Metrics that Drive Successful ... Use the Windshield, Not the Mirror Predictive Metrics that Drive Successful ...
Use the Windshield, Not the Mirror Predictive Metrics that Drive Successful ...
Seapine Software
?
Basic Six Sigma Presentation
Basic Six Sigma PresentationBasic Six Sigma Presentation
Basic Six Sigma Presentation
vivekissar
?
Software Testing Competencies - Rishabh Software
Software Testing Competencies - Rishabh SoftwareSoftware Testing Competencies - Rishabh Software
Software Testing Competencies - Rishabh Software
Rishabh Software
?
Software Testing Process & Trend
Software Testing Process & TrendSoftware Testing Process & Trend
Software Testing Process & Trend
KMS Technology
?
Quality Course 1
Quality Course 1Quality Course 1
Quality Course 1
Fin1
?
Nesma autumn conference 2015 - Functional testing miniguide - Ignacio L¨®pez C...
Nesma autumn conference 2015 - Functional testing miniguide - Ignacio L¨®pez C...Nesma autumn conference 2015 - Functional testing miniguide - Ignacio L¨®pez C...
Nesma autumn conference 2015 - Functional testing miniguide - Ignacio L¨®pez C...
Nesma
?
1 marty howard_asq_qm_qe_resume
1 marty howard_asq_qm_qe_resume1 marty howard_asq_qm_qe_resume
1 marty howard_asq_qm_qe_resume
Marty Howard
?
generic Benchmarking for Continuous improvement
generic Benchmarking for Continuous improvementgeneric Benchmarking for Continuous improvement
generic Benchmarking for Continuous improvement
YKTang5
?

Recently uploaded (20)

Presentation Session 2 -Context Grounding.pdf
Presentation Session 2 -Context Grounding.pdfPresentation Session 2 -Context Grounding.pdf
Presentation Session 2 -Context Grounding.pdf
Mukesh Kala
?
selection of competencies requiring ICT integration.pptx
selection of competencies requiring ICT integration.pptxselection of competencies requiring ICT integration.pptx
selection of competencies requiring ICT integration.pptx
escuyoscherrymae
?
All-Data, Any-AI Integration: FME & Amazon Bedrock in the Real-World
All-Data, Any-AI Integration: FME & Amazon Bedrock in the Real-WorldAll-Data, Any-AI Integration: FME & Amazon Bedrock in the Real-World
All-Data, Any-AI Integration: FME & Amazon Bedrock in the Real-World
Safe Software
?
Dev Dives: Unleash the power of macOS Automation with UiPath
Dev Dives: Unleash the power of macOS Automation with UiPathDev Dives: Unleash the power of macOS Automation with UiPath
Dev Dives: Unleash the power of macOS Automation with UiPath
UiPathCommunity
?
How to manage technology risk and corporate growth
How to manage technology risk and corporate growthHow to manage technology risk and corporate growth
How to manage technology risk and corporate growth
Arlen Meyers, MD, MBA
?
Rens van de Schoot - Mensen, machines en de zoektocht naar het laatste releva...
Rens van de Schoot - Mensen, machines en de zoektocht naar het laatste releva...Rens van de Schoot - Mensen, machines en de zoektocht naar het laatste releva...
Rens van de Schoot - Mensen, machines en de zoektocht naar het laatste releva...
voginip
?
Automated Engineering of Domain-Specific Metamorphic Testing Environments
Automated Engineering of Domain-Specific Metamorphic Testing EnvironmentsAutomated Engineering of Domain-Specific Metamorphic Testing Environments
Automated Engineering of Domain-Specific Metamorphic Testing Environments
Pablo G¨®mez Abajo
?
Java on AWS Without the Headaches - Fast Builds, Cheap Deploys, No Kubernetes
Java on AWS Without the Headaches - Fast Builds, Cheap Deploys, No KubernetesJava on AWS Without the Headaches - Fast Builds, Cheap Deploys, No Kubernetes
Java on AWS Without the Headaches - Fast Builds, Cheap Deploys, No Kubernetes
VictorSzoltysek
?
Windows Client Privilege Escalation-Shared.pptx
Windows Client Privilege Escalation-Shared.pptxWindows Client Privilege Escalation-Shared.pptx
Windows Client Privilege Escalation-Shared.pptx
Oddvar Moe
?
AI-Driven Digital Transformation Using Agentic AI
AI-Driven Digital Transformation Using Agentic AIAI-Driven Digital Transformation Using Agentic AI
AI-Driven Digital Transformation Using Agentic AI
Kris Verlaenen
?
ºÝºÝߣs from Perth MuleSoft Meetup March 2025
ºÝºÝߣs from Perth MuleSoft Meetup March 2025ºÝºÝߣs from Perth MuleSoft Meetup March 2025
ºÝºÝߣs from Perth MuleSoft Meetup March 2025
Michael Price
?
RBM - PIXIAGE - AskPixi Page - Inpixon-MWC 2025.pptx
RBM - PIXIAGE - AskPixi Page - Inpixon-MWC 2025.pptxRBM - PIXIAGE - AskPixi Page - Inpixon-MWC 2025.pptx
RBM - PIXIAGE - AskPixi Page - Inpixon-MWC 2025.pptx
quinlan4
?
HHUG-04-2025-Close-more-deals-from-your-existing-pipeline-FOR SLIDESHARE.pptx
HHUG-04-2025-Close-more-deals-from-your-existing-pipeline-FOR SLIDESHARE.pptxHHUG-04-2025-Close-more-deals-from-your-existing-pipeline-FOR SLIDESHARE.pptx
HHUG-04-2025-Close-more-deals-from-your-existing-pipeline-FOR SLIDESHARE.pptx
HampshireHUG
?
SAP Automation with UiPath: SAP Test Automation - Part 5 of 8
SAP Automation with UiPath: SAP Test Automation - Part 5 of 8SAP Automation with UiPath: SAP Test Automation - Part 5 of 8
SAP Automation with UiPath: SAP Test Automation - Part 5 of 8
DianaGray10
?
Recruiting Tech: A Look at Why AI is Actually OG
Recruiting Tech: A Look at Why AI is Actually OGRecruiting Tech: A Look at Why AI is Actually OG
Recruiting Tech: A Look at Why AI is Actually OG
Matt Charney
?
Harnessing the Power of AI in Salesforce.pdf
Harnessing the Power of AI in Salesforce.pdfHarnessing the Power of AI in Salesforce.pdf
Harnessing the Power of AI in Salesforce.pdf
rabiabajaj1
?
build-with-ai-sydney AI for web devs Tamas Piros
build-with-ai-sydney AI for web devs Tamas Pirosbuild-with-ai-sydney AI for web devs Tamas Piros
build-with-ai-sydney AI for web devs Tamas Piros
Geshan Manandhar
?
Graphs & GraphRAG - Essential Ingredients for GenAI
Graphs & GraphRAG - Essential Ingredients for GenAIGraphs & GraphRAG - Essential Ingredients for GenAI
Graphs & GraphRAG - Essential Ingredients for GenAI
Neo4j
?
Packaging your App for AppExchange ¨C Managed Vs Unmanaged.pptx
Packaging your App for AppExchange ¨C Managed Vs Unmanaged.pptxPackaging your App for AppExchange ¨C Managed Vs Unmanaged.pptx
Packaging your App for AppExchange ¨C Managed Vs Unmanaged.pptx
mohayyudin7826
?
Sugarlab AI: How Much Does an XXX AI Porn Generator Cost in 2025
Sugarlab AI: How Much Does an XXX AI Porn Generator Cost in 2025Sugarlab AI: How Much Does an XXX AI Porn Generator Cost in 2025
Sugarlab AI: How Much Does an XXX AI Porn Generator Cost in 2025
Sugarlab AI
?
Presentation Session 2 -Context Grounding.pdf
Presentation Session 2 -Context Grounding.pdfPresentation Session 2 -Context Grounding.pdf
Presentation Session 2 -Context Grounding.pdf
Mukesh Kala
?
selection of competencies requiring ICT integration.pptx
selection of competencies requiring ICT integration.pptxselection of competencies requiring ICT integration.pptx
selection of competencies requiring ICT integration.pptx
escuyoscherrymae
?
All-Data, Any-AI Integration: FME & Amazon Bedrock in the Real-World
All-Data, Any-AI Integration: FME & Amazon Bedrock in the Real-WorldAll-Data, Any-AI Integration: FME & Amazon Bedrock in the Real-World
All-Data, Any-AI Integration: FME & Amazon Bedrock in the Real-World
Safe Software
?
Dev Dives: Unleash the power of macOS Automation with UiPath
Dev Dives: Unleash the power of macOS Automation with UiPathDev Dives: Unleash the power of macOS Automation with UiPath
Dev Dives: Unleash the power of macOS Automation with UiPath
UiPathCommunity
?
How to manage technology risk and corporate growth
How to manage technology risk and corporate growthHow to manage technology risk and corporate growth
How to manage technology risk and corporate growth
Arlen Meyers, MD, MBA
?
Rens van de Schoot - Mensen, machines en de zoektocht naar het laatste releva...
Rens van de Schoot - Mensen, machines en de zoektocht naar het laatste releva...Rens van de Schoot - Mensen, machines en de zoektocht naar het laatste releva...
Rens van de Schoot - Mensen, machines en de zoektocht naar het laatste releva...
voginip
?
Automated Engineering of Domain-Specific Metamorphic Testing Environments
Automated Engineering of Domain-Specific Metamorphic Testing EnvironmentsAutomated Engineering of Domain-Specific Metamorphic Testing Environments
Automated Engineering of Domain-Specific Metamorphic Testing Environments
Pablo G¨®mez Abajo
?
Java on AWS Without the Headaches - Fast Builds, Cheap Deploys, No Kubernetes
Java on AWS Without the Headaches - Fast Builds, Cheap Deploys, No KubernetesJava on AWS Without the Headaches - Fast Builds, Cheap Deploys, No Kubernetes
Java on AWS Without the Headaches - Fast Builds, Cheap Deploys, No Kubernetes
VictorSzoltysek
?
Windows Client Privilege Escalation-Shared.pptx
Windows Client Privilege Escalation-Shared.pptxWindows Client Privilege Escalation-Shared.pptx
Windows Client Privilege Escalation-Shared.pptx
Oddvar Moe
?
AI-Driven Digital Transformation Using Agentic AI
AI-Driven Digital Transformation Using Agentic AIAI-Driven Digital Transformation Using Agentic AI
AI-Driven Digital Transformation Using Agentic AI
Kris Verlaenen
?
ºÝºÝߣs from Perth MuleSoft Meetup March 2025
ºÝºÝߣs from Perth MuleSoft Meetup March 2025ºÝºÝߣs from Perth MuleSoft Meetup March 2025
ºÝºÝߣs from Perth MuleSoft Meetup March 2025
Michael Price
?
RBM - PIXIAGE - AskPixi Page - Inpixon-MWC 2025.pptx
RBM - PIXIAGE - AskPixi Page - Inpixon-MWC 2025.pptxRBM - PIXIAGE - AskPixi Page - Inpixon-MWC 2025.pptx
RBM - PIXIAGE - AskPixi Page - Inpixon-MWC 2025.pptx
quinlan4
?
HHUG-04-2025-Close-more-deals-from-your-existing-pipeline-FOR SLIDESHARE.pptx
HHUG-04-2025-Close-more-deals-from-your-existing-pipeline-FOR SLIDESHARE.pptxHHUG-04-2025-Close-more-deals-from-your-existing-pipeline-FOR SLIDESHARE.pptx
HHUG-04-2025-Close-more-deals-from-your-existing-pipeline-FOR SLIDESHARE.pptx
HampshireHUG
?
SAP Automation with UiPath: SAP Test Automation - Part 5 of 8
SAP Automation with UiPath: SAP Test Automation - Part 5 of 8SAP Automation with UiPath: SAP Test Automation - Part 5 of 8
SAP Automation with UiPath: SAP Test Automation - Part 5 of 8
DianaGray10
?
Recruiting Tech: A Look at Why AI is Actually OG
Recruiting Tech: A Look at Why AI is Actually OGRecruiting Tech: A Look at Why AI is Actually OG
Recruiting Tech: A Look at Why AI is Actually OG
Matt Charney
?
Harnessing the Power of AI in Salesforce.pdf
Harnessing the Power of AI in Salesforce.pdfHarnessing the Power of AI in Salesforce.pdf
Harnessing the Power of AI in Salesforce.pdf
rabiabajaj1
?
build-with-ai-sydney AI for web devs Tamas Piros
build-with-ai-sydney AI for web devs Tamas Pirosbuild-with-ai-sydney AI for web devs Tamas Piros
build-with-ai-sydney AI for web devs Tamas Piros
Geshan Manandhar
?
Graphs & GraphRAG - Essential Ingredients for GenAI
Graphs & GraphRAG - Essential Ingredients for GenAIGraphs & GraphRAG - Essential Ingredients for GenAI
Graphs & GraphRAG - Essential Ingredients for GenAI
Neo4j
?
Packaging your App for AppExchange ¨C Managed Vs Unmanaged.pptx
Packaging your App for AppExchange ¨C Managed Vs Unmanaged.pptxPackaging your App for AppExchange ¨C Managed Vs Unmanaged.pptx
Packaging your App for AppExchange ¨C Managed Vs Unmanaged.pptx
mohayyudin7826
?
Sugarlab AI: How Much Does an XXX AI Porn Generator Cost in 2025
Sugarlab AI: How Much Does an XXX AI Porn Generator Cost in 2025Sugarlab AI: How Much Does an XXX AI Porn Generator Cost in 2025
Sugarlab AI: How Much Does an XXX AI Porn Generator Cost in 2025
Sugarlab AI
?

Implementing a successful metrics system

  • 1. Implementing a successful metrics system in an IT company Muntean Ramona Measurements & Best Practices @ISDC
  • 2. IT¡¯S IMPORTANT TO YOU IT¡¯S REDUCING UNCERTAINTY TELLS YOU MORE THAN YOU KNEW BEFORE Better informed decisions Tracking the progress of the objectives Managing the achievements of goals WE CAN MANAGE WHAT WE CAN EASILY MEASURE
  • 3. GOALS Goal Business growth rate Profit margin Bids success rate Personnel turnover Success Factors SUCCES FACTORS Key Performance Indicators Productivity Predictability Quality Competitiveness Client Satisfaction Employee Satisfaction Metrics / Data Projects, Processes, People TOP DOWN APPROACH ¨C COMPANY GOALS
  • 4. QUALITY Cost of Quality (CoQ) Cost of Appraisal (CoA) Reviews (1st time) Code Requirements Design Test plans, test scripts Testing (1st time) Audits Cost of Prevention (CoP) Training Procedures, methods Tools, systems Planning Quality improvement Measurements Cost of Non-Conformance (CNC) Fixing defects Re-work code review Re-work doc review Re-reviews Re-testing
  • 6. Improve KPI¡¯s Productivity Predictability Quality Client Satisfaction Team Satisfaction Metrics, Trends Key Performance Indicators METRICS ANALIZED Velocity: Story Points/sprint Estimation deviation %Re-work, DDR, CoQ trends Demo / Release success score Tooling, Data Projects, Processes, People BOTTOM UP APPROACH ¨C PROJECT¡¯S KPI
  • 7. TRENDS Story Points done / sprint 60 55 50 45 40 35 30 25 20 15 10 55 43 41 43 32 29 23 22 S4 S5 S6 S8 S9 S10 22 S11 S12 S13
  • 8. TRENDS Defect Detection Rate (DDR) 90.00% We can learn how review is influencing the product quality in correlation with defects found by testers. 80.00% 70.00% 60.00% 50.00% 40.00% 30.00% 20.00% 10.00% 0.00% S4 S5 S6 DDR_Review S7 S8 DDR_Testing S9 S10 S11 DDR_Customer S12 S13
  • 9. DEVELOPING MEASUREMENT PROCESS DO PLAN Define procedures: Collect metrics: - Metrics to be collected - Collection practices & tooling - Analysis & reporting - Feedback integration - Tailor procedures (if the case) - Record and store data - Use proper tools & templates - Check data accuracy Identify scope: - Goals, objectives - ¡°Problems¡± that need answer - Measurements needs Evolve process: - Evaluate progress - Evaluate process - Recommend improvements ACT Analyze metrics: - Aggregate, correlate data - Prepare reports - Discuss trends, identify thresholds - Revise procedures CHECK
  • 10. MEASUREMENT PARADOX? I want a car that uses as little petrol as possible. I have chosen 2 cars and will do 3 test drives with both of them. Test drive 1 Test drive 2 Test drive 3 Average Car A 1 km/l 1 km/l 4 km/l 2 km/l Car B 1.5 km/l 1.5 km/l 1.5 km/l 1.5 km/l Test drive 1 Test drive 2 Test drive 3 Average Car A 1 l/km 1 l/km 0.25 l/km 0.75 l/km Car B 0.667 l/km 0.667 l/km 0.667 l/km 0.667 l/km The car that uses less petrol is car A which does more kilometres per litre. But, if I had measured litres per kilometre, car B uses less litres per kilometre and is the better car.