ºÝºÝߣ

ºÝºÝߣShare a Scribd company logo
StickyMinds.com and Better Software magazine presents…
How to Build a Testing Center of Excellence
Sponsored by QAProgrammer
This event aired on July 8, 2008.
Testing centers of Excellence
Building
© Confidential
TCOE
© Confidential
Agenda
Testing CoE
 Voice of Customers
 TCoE Models
 Scope
 Activities
 Critical Success Factors
 Key Considerations
TCoE Ecosystem
Q&A
Testing
Process CoE
• Definition | Development |
Maintenance of test processes,
standards & templates
• Facilitation of Test Management
Community
• Metrics Reporting &
Management
• Test Process Training
• Continuous Process
Improvement (CPI)
• Provision | Administration |
Support of Test Infrastructure
and Test Tools
• Provision of NFT Services &
Test Automation Services
• Technical Test Consultancy
• Provision of Functional, UAT
& liaison services
• Flexible resource pool creation
• Provision of specialized testing
services
Testing
Tools/
Infrastructure
CoE
NFT &
Automation CoE
Shared
Testing Team
Decentralized
centralized
• Process definitions & Roll-out
• Process facilitation & maintenance
• Process Compliance Audit
• Facilitation of Test management community
• Continuous process improvement
Services
• Assessment of existing process assets
• Define/Refine and standardize processes
• Institute metrics framework
• Usage guidelines and communication plan
• Establish centralized process framework
PreSetup
Activities
• Organizational strategy alignment
• Effective Communication & Training
• Effective Piloting and Evaluation
• Process compliance review mechanism
Critical Success Factors
• Representation of key stakeholders from various
groups
• Seed change agents to facilitate propagation
• Closed loop feedback mechanism
Key Considerations
Testing Process CoE
• Communicating, Piloting & Training
• Process audits
• Change management
• Industry benchmarking
PostSetup
• Tool evaluation
• Testing tools technical support
• Test tool license management & administration
• Tool process standardization
• Tool optimization
Services
• Tools inventory
• Tool evaluation
• Capacity planning & Platform optimization
• ROI Analysis
• Tool licensing & procurement policy
PreSetup
Activities
• Clear understanding of opportunities for operational
efficiencies
• Demand forecasting mechanism
• Tool/Infrastructure utilization & Optimization
• Service Level Agreements
Critical Success Factors
• Tool standardization for testing activities such as
requirement management, defect management etc.
• Leverage vendor organization’s tool partnership
• Tool set integration
• Alternative tool pricing model
Key Considerations
Infrastructure & Tools CoE
• Maintain tools inventory
• Tool administration, upgrades, license
management & tools training
• Monitoring & maintenance
• Incident management workflow
PostSetup
Confidential
• Review/Refine & publish scripting standards and
guidelines
• Resource sharing & allocation models
• ROI Analysis
• Team identification
PreSetup
Activities
• Uniform Automation/Performance Testing guidelines
& scripting standards
• Reusable Automation/Performance testing framework
& work load models
• Defined Non Functional/automation testing
requirements
Critical Success Factors
• Scope for Regression & Test Automation based on
scheduled releases
• Utilize Tools CoE for standards & guidelines
definition
• Utilize Process CoE for propagation of best practices
Key Considerations
NFT & Automation CoE
• Feasibility analysis & Proof of concepts
• Construct reusable frameworks
• Technical Training/Support
• Technical test consulting
PostSetup
Services
• Performance testing
• Security testing
• Usability testing
• Workload Modeling
NFT
• Test Automation
• Framework design and Implementation
Automation
Value-Adds
• Technical consultancy
• Feasibility analysis
Confidential
• Establish test management office
• Scope analysis & demand forecasting
• Engagement & Sourcing model
• Institute training program
• KPI definition
PreSetup
Activities
• Identification of core vs. non-core business functions.
• Strong Governance Model
• KPI identifications
• Management by Metrics
Critical Success Factors
• Tracking mechanism to measure achievements over
period of time against established goals
• Cross-functional training
• Effective collaboration of Business Analysts and QA
Key Considerations
Shared Testing Team
• Resource allocation
• Skill assessment and training
• Test program management
• Construct knowledge assets
PostSetup
Services
• Functional testing
• System testing/SIT
• Acceptance testing
Basic
Specialized
Support &
Consultancy
• Defect Management
• Test Life Cycle
modeling
• Test Strategy
conceptualization
• Compliance testing
• DW testing
• Agile testing
• SOA testing
• Product/Package testing
Confidential
Confidential
Piloting for Success
Shared Testing Tools
Defined basic processes Standardized tool management
Defined scope and schedule Tool licensing & procurement policy
System Testing
System Integration Testing
UAT support
3-6 months 4-8 weeks
High Medium
Data Generation & Sanitization Reporting utilities, portlets
Knowledge Repository
Dash-boards
Increased Test Coverage Traceability
Established Quality gates Effective defect management
Objective Go/No-Go decisions
Improved productivity & test effectiveness
Reduced defect leakage
Cycle time reduction
Quality Gains
New project OR AVM Project Existing projects
Pilot Accelerators
Project types
BenefitRealization
Test Management
Management by metrics
Short-term
Long Term
Pre-requisites
Scope
Pilot Length
Business Disruption
Piloting for Success
Automation Non-functional testing
Defined automation scripting standards
&guidelines
Defined NFT requirements
Tools Inventory Defined NFT scripting standards & guidelines
Tool Evaluation Feasibility analysis
Tool licensing & procurement policy
Feasibility Analysis
ROI Analysis Performance
Proof of Concepts Security (Application Vulnerability Assessment &
Reusable framework Usability
Proof of concepts
Minimum 4 releases per year 6-8 weeks
Low Medium
Automation framework Tool driven testing
Skilled resources Leveraging existing labs
Skilled resources
Consistency Identifying bottlenecks & vulnerabilities
Improved Coverage
Reusability Enhanced user experience
Reduced maintenance Customer retention
Cost Savings
Release-based New projects AND Web-based
Short-term
Long Term
Pre-requisites
Scope
Pilot Length
Business Disruption
Pilot Accelerators
Project types
BenefitRealization
Test
Planning &
Estimation
Test Design
&
Build
Test
Execution &
Management
Test
Reporting
Test
Metrics
Management
Test
Program
Management
Testing
Center of
Excellence
Infrastructure &
Tools COE
 Tool Maintenance &
Support
 Test Automation
 Tool Implementation
 Tool Provision
Process COE
 Process Maintenance
 Process Definition
 Metrics Program
 Test Process Training
 Continuous Process
Improvement
 Best Practice
implementation
>
>
T e s t i n g C e n t e r O f E x c e l l e n c e
Service Spectrum
System Testing
System
Integration
testing
Regression
Testing
Test
Automation
UAT
Core – Flexible
resourcing
Standard process
& Frameworks
Common Tools,
Infrastructure &
Automation
Solution
Accelerations/
Best practices
Governance
structure
>
TCoE Ecosystem
Good Luck
on your TCOE Journey
Have a question for the speaker?
Ask now.
Qaprogrammer.com , +9140-65 70 57 57 or +91- 93 92 91 89 89
support@qaprogrammer.com
Q & A

More Related Content

kalyanasundaram,sripriya_tcoepresentation

  • 1. StickyMinds.com and Better Software magazine presents… How to Build a Testing Center of Excellence Sponsored by QAProgrammer This event aired on July 8, 2008.
  • 2. Testing centers of Excellence Building © Confidential TCOE
  • 3. © Confidential Agenda Testing CoE  Voice of Customers  TCoE Models  Scope  Activities  Critical Success Factors  Key Considerations TCoE Ecosystem Q&A
  • 4. Testing Process CoE • Definition | Development | Maintenance of test processes, standards & templates • Facilitation of Test Management Community • Metrics Reporting & Management • Test Process Training • Continuous Process Improvement (CPI) • Provision | Administration | Support of Test Infrastructure and Test Tools • Provision of NFT Services & Test Automation Services • Technical Test Consultancy • Provision of Functional, UAT & liaison services • Flexible resource pool creation • Provision of specialized testing services Testing Tools/ Infrastructure CoE NFT & Automation CoE Shared Testing Team Decentralized centralized
  • 5. • Process definitions & Roll-out • Process facilitation & maintenance • Process Compliance Audit • Facilitation of Test management community • Continuous process improvement Services • Assessment of existing process assets • Define/Refine and standardize processes • Institute metrics framework • Usage guidelines and communication plan • Establish centralized process framework PreSetup Activities • Organizational strategy alignment • Effective Communication & Training • Effective Piloting and Evaluation • Process compliance review mechanism Critical Success Factors • Representation of key stakeholders from various groups • Seed change agents to facilitate propagation • Closed loop feedback mechanism Key Considerations Testing Process CoE • Communicating, Piloting & Training • Process audits • Change management • Industry benchmarking PostSetup
  • 6. • Tool evaluation • Testing tools technical support • Test tool license management & administration • Tool process standardization • Tool optimization Services • Tools inventory • Tool evaluation • Capacity planning & Platform optimization • ROI Analysis • Tool licensing & procurement policy PreSetup Activities • Clear understanding of opportunities for operational efficiencies • Demand forecasting mechanism • Tool/Infrastructure utilization & Optimization • Service Level Agreements Critical Success Factors • Tool standardization for testing activities such as requirement management, defect management etc. • Leverage vendor organization’s tool partnership • Tool set integration • Alternative tool pricing model Key Considerations Infrastructure & Tools CoE • Maintain tools inventory • Tool administration, upgrades, license management & tools training • Monitoring & maintenance • Incident management workflow PostSetup Confidential
  • 7. • Review/Refine & publish scripting standards and guidelines • Resource sharing & allocation models • ROI Analysis • Team identification PreSetup Activities • Uniform Automation/Performance Testing guidelines & scripting standards • Reusable Automation/Performance testing framework & work load models • Defined Non Functional/automation testing requirements Critical Success Factors • Scope for Regression & Test Automation based on scheduled releases • Utilize Tools CoE for standards & guidelines definition • Utilize Process CoE for propagation of best practices Key Considerations NFT & Automation CoE • Feasibility analysis & Proof of concepts • Construct reusable frameworks • Technical Training/Support • Technical test consulting PostSetup Services • Performance testing • Security testing • Usability testing • Workload Modeling NFT • Test Automation • Framework design and Implementation Automation Value-Adds • Technical consultancy • Feasibility analysis Confidential
  • 8. • Establish test management office • Scope analysis & demand forecasting • Engagement & Sourcing model • Institute training program • KPI definition PreSetup Activities • Identification of core vs. non-core business functions. • Strong Governance Model • KPI identifications • Management by Metrics Critical Success Factors • Tracking mechanism to measure achievements over period of time against established goals • Cross-functional training • Effective collaboration of Business Analysts and QA Key Considerations Shared Testing Team • Resource allocation • Skill assessment and training • Test program management • Construct knowledge assets PostSetup Services • Functional testing • System testing/SIT • Acceptance testing Basic Specialized Support & Consultancy • Defect Management • Test Life Cycle modeling • Test Strategy conceptualization • Compliance testing • DW testing • Agile testing • SOA testing • Product/Package testing Confidential
  • 9. Confidential Piloting for Success Shared Testing Tools Defined basic processes Standardized tool management Defined scope and schedule Tool licensing & procurement policy System Testing System Integration Testing UAT support 3-6 months 4-8 weeks High Medium Data Generation & Sanitization Reporting utilities, portlets Knowledge Repository Dash-boards Increased Test Coverage Traceability Established Quality gates Effective defect management Objective Go/No-Go decisions Improved productivity & test effectiveness Reduced defect leakage Cycle time reduction Quality Gains New project OR AVM Project Existing projects Pilot Accelerators Project types BenefitRealization Test Management Management by metrics Short-term Long Term Pre-requisites Scope Pilot Length Business Disruption
  • 10. Piloting for Success Automation Non-functional testing Defined automation scripting standards &guidelines Defined NFT requirements Tools Inventory Defined NFT scripting standards & guidelines Tool Evaluation Feasibility analysis Tool licensing & procurement policy Feasibility Analysis ROI Analysis Performance Proof of Concepts Security (Application Vulnerability Assessment & Reusable framework Usability Proof of concepts Minimum 4 releases per year 6-8 weeks Low Medium Automation framework Tool driven testing Skilled resources Leveraging existing labs Skilled resources Consistency Identifying bottlenecks & vulnerabilities Improved Coverage Reusability Enhanced user experience Reduced maintenance Customer retention Cost Savings Release-based New projects AND Web-based Short-term Long Term Pre-requisites Scope Pilot Length Business Disruption Pilot Accelerators Project types BenefitRealization
  • 11. Test Planning & Estimation Test Design & Build Test Execution & Management Test Reporting Test Metrics Management Test Program Management Testing Center of Excellence Infrastructure & Tools COE  Tool Maintenance & Support  Test Automation  Tool Implementation  Tool Provision Process COE  Process Maintenance  Process Definition  Metrics Program  Test Process Training  Continuous Process Improvement  Best Practice implementation > > T e s t i n g C e n t e r O f E x c e l l e n c e Service Spectrum System Testing System Integration testing Regression Testing Test Automation UAT Core – Flexible resourcing Standard process & Frameworks Common Tools, Infrastructure & Automation Solution Accelerations/ Best practices Governance structure > TCoE Ecosystem
  • 12. Good Luck on your TCOE Journey
  • 13. Have a question for the speaker? Ask now. Qaprogrammer.com , +9140-65 70 57 57 or +91- 93 92 91 89 89 support@qaprogrammer.com Q & A

Editor's Notes

  • #13: QAProgrammer.com
  • #14: QAProgrammer.com