ºÝºÝߣ

ºÝºÝߣShare a Scribd company logo
Real-Life
    Test Management
  Challenges & Solutions
                STP September 2010 Webinar

                           Selena Delesie
         Consulting Software Tester, Agile Coach
                    Delesie Solutions
               www.delesiesolutions.com
             selena@delesiesolutions.com


                                                                Last updated September 20, 2010
                                                              Copyright (c) 2010, Delesie Solutions
This work is licensed under the Creative Commons Attribution 3.0 Canada License.
                            View a copy of this license.
About Me...

                          People
                          Manager:
Test Program /            8 years                           Wireless,
Project Lead:                                            Client, Server,
   8 years                                                   Web,
                                                          Embedded


    Family &                                               Health
    Friends                                                 Nut

                 Copyright (c) 2010, Delesie Solutions                     2
Some Types of
Test Management Challenges


        Team-Based

      Project-Based

    Stakeholder-Based




      Copyright (c) 2010, Delesie Solutions   3
Team-Based Challenges


?
    Staff not Getting Along
?
    Training Staff
?
    Rapid Growth
?
    Staff not Working to Potential
?
 Project, Staff, Budget, & Test
Environment Co-ordination


         Copyright (c) 2010, Delesie Solutions   4
A Story about a Team

?
    I'm the new Test Manager
?
    Starting team size: 3
?
    Ad-hoc process, lacking critical thinking
?
    I did all project planning
?
    Team size in 1 year: 10
?
    Team members rely on me to make decisions
?
    Some team members under-performing


               Copyright (c) 2010, Delesie Solutions   5
Team Takeaways
?
 Delegate project planning & leadership to
senior team members
?
    Stop providing all the answers
?
  Coach team members on new skill areas &
techniques so they can succeed
?
    Provide regular training workshops
?
    Regular 1:1's with all team members
?
    Learn about motivators for each person
?
    Build relationships & a fun environment

              Copyright (c) 2010, Delesie Solutions   6
Team Results
?
    Team members grow & develop
?
    More work accomplished
?
    Team members took ownership
?
 People spoke up, shared idea's, and
made decisions
?
 Team members held each other
accountable
?
    Everyone worked hard, and had fun
?
 Department highly regarded in the
company
          Copyright (c) 2010, Delesie Solutions   7
Management vs. Leadership


       Management
 is about doing things right.

         Leadership
is about doing the right thing.




       Copyright (c) 2010, Delesie Solutions   8
¡°The best executive is the one who
has sense enough to pick good men
     to do what he wants done,
    and self-restraint enough to
   keep from meddling with them
          while they do it.¡±
             ~ Theodore Roosevelt




         Copyright (c) 2010, Delesie Solutions   9
Servant Leadership

?
  Objective: Enhance growth of individuals, and
increase teamwork & personal involvement.
?
 Conscious decision to lead in order to better
serve others, not to increase own power.
?
 Emphasizes collaboration, trust, empathy, &
ethical use of power.
?
 Servant Leader Qualities: listening, empathy,
healing, awareness, persuasion, foresight,
conceptualization, stewardship, growth &
building community.

              Copyright (c) 2010, Delesie Solutions   10
Managers ¨C Change Your Perspective

To be a great manager, stop control
tactics, and be a servant-leader to:
?
    Gain respect
?
    Improve morale and motivation
?
    Increase productivity
?
    Build a strong successful team
?
    Improve value of testing in your
    organization

             Copyright (c) 2010, Delesie Solutions   11
Coaching, Not Telling
    ¡°You get the best effort from others not by lighting a fire
         beneath them, but by building a fire within.¡±
                               ~ Bob Nelson
?
  Goal: Help coachee recognize ways they can
improve their effectiveness.
?
  Provide positive support & feedback.
?
  Offer occasional advice.
?
  Ask questions & rely on staff, who become the
experts, to provide information.
?
  One-on-one, or in a group.
?
  Improves leadership, employee accountability,
teamwork, communication, goal setting, specific
skills.
                     Copyright (c) 2010, Delesie Solutions        12
Create a Healthy Environment
?
    Build Relationships
?
    Open Communication
?
    Collaboration
?
    Work Hard, Play Hard
?
    Responsibility & Accountability
?
    Team Commitment & Team Results
?
    Reflect & Adapt
?
    Be a Learning Organization
?
    Lead by Example

           Copyright (c) 2010, Delesie Solutions   13
Project-Based


?
    Non-Functional Requirements
?
    Not Enough Time
?
    Not Enough People
?
    Test Environment Lacking
?
    Quality is not a Priority



         Copyright (c) 2010, Delesie Solutions   14
A Story about Projects

?
    30 testers across 10 projects
?
 Minimum recommended testing
outpaced capacity by 400%
?
 Testers expected to work weekends
and evenings for months
?
    Not enough people or time
?
 Quality was said to be important,
but not invested in or understood


           Copyright (c) 2010, Delesie Solutions   15
Takeaways from Projects

?
 Deciding what testing to do is like grocery
shopping: Choose what to buy without going
over budget, and buy what's needed most.
?
 Put 'test buying process' into hands of project
managers
?
 They decided what projects & what testing
would be completed within available budget,
with our guidance.



            Copyright (c) 2010, Delesie Solutions   16
Results from Projects


?
  Stakeholders gained immense respect for
testing process, and trusted our decisions.
?
  Test group brought into new projects at same
time as development.
?
  Existing projects re-prioritized & schedules
revised.




            Copyright (c) 2010, Delesie Solutions   17
Learn to Say 'No'


?
    Don't be a victim of circumstance
?
    It's okay for people to want something
?
    Don't commit the impossible
?
    Educate on what testing can do
?
    Provide value every step of the way



            Copyright (c) 2010, Delesie Solutions   18
Tie Testing to Money

?
 How much do they want to spend to
get the information they need?
?
  Put decision in their hands ¨C they set
the priorities
?
 Eliminate mandatory overtime ¨C if
needed, get it paid for over & above
salaries


         Copyright (c) 2010, Delesie Solutions   19
Early Project Involvement


?
    Get testing involved at start of projects
?
    Educate & show how you add value
?
    Don't become a roadblock
?
    Be a top-tier service provider
?
    Focus on 'we', not 'you' and 'me'



             Copyright (c) 2010, Delesie Solutions   20
Agreed Upon Target Quality Levels


?
    Decision makers determine priorities
?
  Provide guidance & information to help
them make best decisions possible
?
 Find out what risks are acceptable &
which are not; publish & sign-off




              Copyright (c) 2010, Delesie Solutions   21
Stakeholder-Based


?
    Developers & Testers Blaming
?
    Test not Included in Meetings
Code Changes Result in many
?


New/Reopened Bugs
?
    Unrealistic Expectations of Test Team
?
    Reporting the Right Information


          Copyright (c) 2010, Delesie Solutions   22
A Story about Stakeholders

?
    I was the new Test Manager
?
    He was the new Development Manager
?
 Told me he didn't want testers to interact
with developers
?
  Reason: We would intentionally use
information we learn to make them look bad.


                             What?!


            Copyright (c) 2010, Delesie Solutions   23
Stakeholder Takeaways
?
    Used active listening to learn more
?
    It wasn't about us
?
    Built relationships
?
    Spoke openly, honestly, & respectfully
?
    ¡°We¡±, not ¡°you¡± and ¡°me¡±
?
    Built trust
     Result: Became a big supporter of my
      department, sought our advice, and
     advocated for changes to help us be a
                better service.
            Copyright (c) 2010, Delesie Solutions   24
Communication Techniques


?
    Be Personable
?
    Listen, and Understand
?
    Foster Open Communication
?
    The Whole Team Approach
?
    Build Trust



        Copyright (c) 2010, Delesie Solutions   25
Communication
  Approach




Copyright (c) 2010, Delesie Solutions                                      26
                                        Marc Archambault, Papershine.com
Make Your Information...




    Copyright (c) 2010, Delesie Solutions   27
Information is Relevant




    Copyright (c) 2010, Delesie Solutions   28
Information is Meaningful & Useful

    They understand the
    information and find
         value in it.

If they don't...
?
  Was it the wrong
information?
?
  Was it the right
information presented in
the wrong way?

                   Copyright (c) 2010, Delesie Solutions   29
Information is Accurate & Complete


   Don't Risk:


    Wrong Decisions Being Made
         Losing Credibility
        Causing More Work



         Copyright (c) 2010, Delesie Solutions   30
Information is Timely




     Mark Thaler




  Copyright (c) 2010, Delesie Solutions   31
Information is Actionable

                                                       That was
                                                      interesting,
                                                      what's next?
Clear on Next Steps
?
    Decision to be made?
?
    Need support?
?
    What do they need to do?



              Copyright (c) 2010, Delesie Solutions                  32
What About Your
Test Management Challenges?



Things to Consider...
?
    People Involved
?
    Leadership vs. Management
?
    Communication Techniques




         Copyright (c) 2010, Delesie Solutions   33
Copyright (c) 2010, Delesie Solutions   34
Related & Recommended
    Agile Testing: A Practical Guide for Agile Testers and Teams
                     ¨C Lisa Crispin and Janet Gregory
        Behind Closed Doors: Secrets of Great Management
                 ¨C Esther Derby and Johanna Rothman
               Difficult Conversations ¨C Anne Dickson
        The 5 Essential People Skills ¨C Dale Carnegie Training
    Lessons Learned in Software Testing ¨C Kaner, Bach & Pettichord
         The Five Dysfunctions of a Team ¨C Patrick Lencioni
       Surviving the Top Ten Challenges of Software Testing
                   ¨C Wiliam E. Perry and Randall W. Rice
Listen For Success: A Guide to Effective Listening ¨C Arthur K. Robertson
                      Anything by Virgina Satir
            The Social Styles Handbook ¨C Wilson Learning

         http://www.geraldmweinberg.com ¨C Gerald M. Weinberg
                  http://www.nkarten.com/ ¨C Naomi Karten
            http://www.ayeconference.com/ ¨C AYE Conference

                        Copyright (c) 2010, Delesie Solutions              35

More Related Content

Test Management Challenges + Solutions - Selena Delesie

  • 1. Real-Life Test Management Challenges & Solutions STP September 2010 Webinar Selena Delesie Consulting Software Tester, Agile Coach Delesie Solutions www.delesiesolutions.com selena@delesiesolutions.com Last updated September 20, 2010 Copyright (c) 2010, Delesie Solutions This work is licensed under the Creative Commons Attribution 3.0 Canada License. View a copy of this license.
  • 2. About Me... People Manager: Test Program / 8 years Wireless, Project Lead: Client, Server, 8 years Web, Embedded Family & Health Friends Nut Copyright (c) 2010, Delesie Solutions 2
  • 3. Some Types of Test Management Challenges Team-Based Project-Based Stakeholder-Based Copyright (c) 2010, Delesie Solutions 3
  • 4. Team-Based Challenges ? Staff not Getting Along ? Training Staff ? Rapid Growth ? Staff not Working to Potential ? Project, Staff, Budget, & Test Environment Co-ordination Copyright (c) 2010, Delesie Solutions 4
  • 5. A Story about a Team ? I'm the new Test Manager ? Starting team size: 3 ? Ad-hoc process, lacking critical thinking ? I did all project planning ? Team size in 1 year: 10 ? Team members rely on me to make decisions ? Some team members under-performing Copyright (c) 2010, Delesie Solutions 5
  • 6. Team Takeaways ? Delegate project planning & leadership to senior team members ? Stop providing all the answers ? Coach team members on new skill areas & techniques so they can succeed ? Provide regular training workshops ? Regular 1:1's with all team members ? Learn about motivators for each person ? Build relationships & a fun environment Copyright (c) 2010, Delesie Solutions 6
  • 7. Team Results ? Team members grow & develop ? More work accomplished ? Team members took ownership ? People spoke up, shared idea's, and made decisions ? Team members held each other accountable ? Everyone worked hard, and had fun ? Department highly regarded in the company Copyright (c) 2010, Delesie Solutions 7
  • 8. Management vs. Leadership Management is about doing things right. Leadership is about doing the right thing. Copyright (c) 2010, Delesie Solutions 8
  • 9. ¡°The best executive is the one who has sense enough to pick good men to do what he wants done, and self-restraint enough to keep from meddling with them while they do it.¡± ~ Theodore Roosevelt Copyright (c) 2010, Delesie Solutions 9
  • 10. Servant Leadership ? Objective: Enhance growth of individuals, and increase teamwork & personal involvement. ? Conscious decision to lead in order to better serve others, not to increase own power. ? Emphasizes collaboration, trust, empathy, & ethical use of power. ? Servant Leader Qualities: listening, empathy, healing, awareness, persuasion, foresight, conceptualization, stewardship, growth & building community. Copyright (c) 2010, Delesie Solutions 10
  • 11. Managers ¨C Change Your Perspective To be a great manager, stop control tactics, and be a servant-leader to: ? Gain respect ? Improve morale and motivation ? Increase productivity ? Build a strong successful team ? Improve value of testing in your organization Copyright (c) 2010, Delesie Solutions 11
  • 12. Coaching, Not Telling ¡°You get the best effort from others not by lighting a fire beneath them, but by building a fire within.¡± ~ Bob Nelson ? Goal: Help coachee recognize ways they can improve their effectiveness. ? Provide positive support & feedback. ? Offer occasional advice. ? Ask questions & rely on staff, who become the experts, to provide information. ? One-on-one, or in a group. ? Improves leadership, employee accountability, teamwork, communication, goal setting, specific skills. Copyright (c) 2010, Delesie Solutions 12
  • 13. Create a Healthy Environment ? Build Relationships ? Open Communication ? Collaboration ? Work Hard, Play Hard ? Responsibility & Accountability ? Team Commitment & Team Results ? Reflect & Adapt ? Be a Learning Organization ? Lead by Example Copyright (c) 2010, Delesie Solutions 13
  • 14. Project-Based ? Non-Functional Requirements ? Not Enough Time ? Not Enough People ? Test Environment Lacking ? Quality is not a Priority Copyright (c) 2010, Delesie Solutions 14
  • 15. A Story about Projects ? 30 testers across 10 projects ? Minimum recommended testing outpaced capacity by 400% ? Testers expected to work weekends and evenings for months ? Not enough people or time ? Quality was said to be important, but not invested in or understood Copyright (c) 2010, Delesie Solutions 15
  • 16. Takeaways from Projects ? Deciding what testing to do is like grocery shopping: Choose what to buy without going over budget, and buy what's needed most. ? Put 'test buying process' into hands of project managers ? They decided what projects & what testing would be completed within available budget, with our guidance. Copyright (c) 2010, Delesie Solutions 16
  • 17. Results from Projects ? Stakeholders gained immense respect for testing process, and trusted our decisions. ? Test group brought into new projects at same time as development. ? Existing projects re-prioritized & schedules revised. Copyright (c) 2010, Delesie Solutions 17
  • 18. Learn to Say 'No' ? Don't be a victim of circumstance ? It's okay for people to want something ? Don't commit the impossible ? Educate on what testing can do ? Provide value every step of the way Copyright (c) 2010, Delesie Solutions 18
  • 19. Tie Testing to Money ? How much do they want to spend to get the information they need? ? Put decision in their hands ¨C they set the priorities ? Eliminate mandatory overtime ¨C if needed, get it paid for over & above salaries Copyright (c) 2010, Delesie Solutions 19
  • 20. Early Project Involvement ? Get testing involved at start of projects ? Educate & show how you add value ? Don't become a roadblock ? Be a top-tier service provider ? Focus on 'we', not 'you' and 'me' Copyright (c) 2010, Delesie Solutions 20
  • 21. Agreed Upon Target Quality Levels ? Decision makers determine priorities ? Provide guidance & information to help them make best decisions possible ? Find out what risks are acceptable & which are not; publish & sign-off Copyright (c) 2010, Delesie Solutions 21
  • 22. Stakeholder-Based ? Developers & Testers Blaming ? Test not Included in Meetings Code Changes Result in many ? New/Reopened Bugs ? Unrealistic Expectations of Test Team ? Reporting the Right Information Copyright (c) 2010, Delesie Solutions 22
  • 23. A Story about Stakeholders ? I was the new Test Manager ? He was the new Development Manager ? Told me he didn't want testers to interact with developers ? Reason: We would intentionally use information we learn to make them look bad. What?! Copyright (c) 2010, Delesie Solutions 23
  • 24. Stakeholder Takeaways ? Used active listening to learn more ? It wasn't about us ? Built relationships ? Spoke openly, honestly, & respectfully ? ¡°We¡±, not ¡°you¡± and ¡°me¡± ? Built trust Result: Became a big supporter of my department, sought our advice, and advocated for changes to help us be a better service. Copyright (c) 2010, Delesie Solutions 24
  • 25. Communication Techniques ? Be Personable ? Listen, and Understand ? Foster Open Communication ? The Whole Team Approach ? Build Trust Copyright (c) 2010, Delesie Solutions 25
  • 26. Communication Approach Copyright (c) 2010, Delesie Solutions 26 Marc Archambault, Papershine.com
  • 27. Make Your Information... Copyright (c) 2010, Delesie Solutions 27
  • 28. Information is Relevant Copyright (c) 2010, Delesie Solutions 28
  • 29. Information is Meaningful & Useful They understand the information and find value in it. If they don't... ? Was it the wrong information? ? Was it the right information presented in the wrong way? Copyright (c) 2010, Delesie Solutions 29
  • 30. Information is Accurate & Complete Don't Risk: Wrong Decisions Being Made Losing Credibility Causing More Work Copyright (c) 2010, Delesie Solutions 30
  • 31. Information is Timely Mark Thaler Copyright (c) 2010, Delesie Solutions 31
  • 32. Information is Actionable That was interesting, what's next? Clear on Next Steps ? Decision to be made? ? Need support? ? What do they need to do? Copyright (c) 2010, Delesie Solutions 32
  • 33. What About Your Test Management Challenges? Things to Consider... ? People Involved ? Leadership vs. Management ? Communication Techniques Copyright (c) 2010, Delesie Solutions 33
  • 34. Copyright (c) 2010, Delesie Solutions 34
  • 35. Related & Recommended Agile Testing: A Practical Guide for Agile Testers and Teams ¨C Lisa Crispin and Janet Gregory Behind Closed Doors: Secrets of Great Management ¨C Esther Derby and Johanna Rothman Difficult Conversations ¨C Anne Dickson The 5 Essential People Skills ¨C Dale Carnegie Training Lessons Learned in Software Testing ¨C Kaner, Bach & Pettichord The Five Dysfunctions of a Team ¨C Patrick Lencioni Surviving the Top Ten Challenges of Software Testing ¨C Wiliam E. Perry and Randall W. Rice Listen For Success: A Guide to Effective Listening ¨C Arthur K. Robertson Anything by Virgina Satir The Social Styles Handbook ¨C Wilson Learning http://www.geraldmweinberg.com ¨C Gerald M. Weinberg http://www.nkarten.com/ ¨C Naomi Karten http://www.ayeconference.com/ ¨C AYE Conference Copyright (c) 2010, Delesie Solutions 35