際際滷

際際滷Share a Scribd company logo
WHY DO NEWCOMERS ABANDON
OPEN SOURCE SOFTWARE
PROJECTS?
Igor Steinmacher
Igor Scaliante Wiese
Ana Paula Chaves
Marco Aur辿lio Gerosa
CONTEXT
... and need support on their
first steps
2
Newcomers are explorers who must
orient themselves within an
unfamiliar landscape...
[Degenais et al. 2010]
B. Dagenais, H. Ossher, R.K.E Bellamy, M.P. Robillard and J.P.
de Vries, Moving into a new software project landscape, in
ICSE 2010.
GOAL
Research Question
4
Does the absence of response, politeness, usefulness or the
author of answers influence the retention of newcomers in an
open source project?
Specific goals:
 During newcomers first interactions with the project
 check if they receive answers;
 observe who are the authors of the answers to their questions;
 classify the answers received by the newcomers.
DATA
Hadoop Common Project
60 months
 Mailing lists
 9285 threads
 50128 messages
 Issue tracker discussions (Jira)
 7721 issues
 76065 comments
5
Issue
Tracker
Mailing
List
Identification of
Existant Members
(36 months)
Newcomers
Identification
(6 months)
Newcomers that
Returned
(6 months)
Retained
Newcomers
(+ 12 months)
Newcomers that
Abandoned
(6 months)
Survey
Extractors
6
1 2
3
3
4
# users % of existant % of newcomers
Existant members (interval 1) 677
Newcomers (interval 2) 67 9.90%
Remaining (interval 3) 20 2.95% 29.85%
Retained (interval 4) 12 1.77% 17.91%
RESULTS (RETENTION)
7
Mailing list newcomers
# users % of existant % of newcomers
Existant members (interval 1) 483
Newcomers (interval 2) 127 26.29%
Remaining (interval 3) 30 6.21% 23.62%
Retained (interval 4) 17 3.52% 13.39%
Issue tracker newcomers (Jira)
SG1: ARE NEWCOMERS ANSWERED?
8
# people Abandoned Appear on
intervals 3 and 4
Answered 13 11 (84.6%) 2 (15.4%)
Not answered 34 30 (88.2%) 4 (11.8%)
# people Abandoned Appear on
intervals 3 and 4
Not commented 7 6 (85.7%) 1 (14.3%)
Received comments 71 55 (77.5%) 16 (22.5%)
Issue tracker newcomers (Jira)
Mailing list newcomers
20 threads
triggered by
newcomers
that abandoned
the project had
some answer
from other
newcomer
SG2: WHO ANSWERS NEWCOMERS?
9
Mailing list
No message sent by a
remaining newcomer
was answered only by
other newcomers.
 There are some hints that the authors of answere influence the newcomers
 After manual analysis: content of the answers seems to be more relevant
SG2: WHO ANSWERS NEWCOMERS?
10
Jira
Very
heterogeneous
participation
 Discussions are contextualized and focused
 Higher amount of messages exchanged per thread (issue)
SG3: WHAT KIND OF ANSWER
DO NEWCOMERS RECEIVE?
Answer type Left the project Remained
Useful / On Topic 20 7
Not Useful / Another question 5 0
Not Useful / Offtopic 3 0
Indifferent 1 0
Other 4 0
11
 Answers are in topic, contextualized and bring useful information
Mailing List
Issue tracker
RESULTS  QUESTIONNAIRE
1. Do you remember sending an email to hadoop-common-dev mailing list?
2. At that time, were you interested to keep contributing to Hadoop project?
2a. In case you answered YES to question 2, why did you give up?
2b. In case you answered NO to question 2, what was the goal of the messages
sent to developers list?
3. Have you contributed to the project after June 2009?
4. Have you contributed to other Open Source project BEFORE 2009?
12
Question 1 Question 2 Question 3 Question 4
Yes 13 11 1 7
No 0 2 12 6
11
RESULTS  QUESTIONNAIRE
Type of answer
Answer to question 2
Yes (2a) No (2b)
i. The user just wanted to clarify some doubt 0 2
ii. Question not answered or answer did not help 2 0
iii. Lack of help to choose a task 3 0
iv. Not accepted by the Project 1 0
v. Changed focus or company 4 0
vi. Resumed the contributions later 1 0
13
2a. In case you answered YES to question 2, why did you give up?
2b. In case you answered NO to question 2, what was the goal of the
messages sent to developers list?
... My issue was how to start contributing If I could have got some hand
holding that might have helped 
I got no answer for my question
CONCLUSIONS
 absence of answer
politeness of answers  receptiveness (survey)
usefulness of answer
 type of author
 Initial interactions influence newcomers decision to recontribute to
the project
 Social skills are required
14
Does the absence of response, politeness, usefulness or the
author of answers influence the retention of newcomers in an
open source project?
QUESTIONS?
Igor Steinmacher
igorfs@utfpr.edu.br
Igor Scaliante Wiese
igor@utfpr.edu.br
Ana Paula Chaves
anachaves@utfpr.edu.br
Marco Aur辿lio Gerosa
gerosa@ime.usp.br

More Related Content

Similar to Why do newcomers abandon open source software projects? (20)

ICSE 2016 - Overcoming Open Source Project Entry Barriers with a Portal for N...
ICSE 2016 - Overcoming Open Source Project Entry Barriers with a Portal for N...ICSE 2016 - Overcoming Open Source Project Entry Barriers with a Portal for N...
ICSE 2016 - Overcoming Open Source Project Entry Barriers with a Portal for N...
Igor Steinmacher
TIGed Education for Social Innovation Course: Session 4
TIGed Education for Social Innovation Course: Session 4TIGed Education for Social Innovation Course: Session 4
TIGed Education for Social Innovation Course: Session 4
Jennifer Corriero
Looking at project protocols
Looking at project protocolsLooking at project protocols
Looking at project protocols
Aaron Maurer
Introduction to Design Thinking Workshop
Introduction to Design Thinking WorkshopIntroduction to Design Thinking Workshop
Introduction to Design Thinking Workshop
Molly B. Zielezinski PhD
JMS480 Research Proposal
JMS480 Research ProposalJMS480 Research Proposal
JMS480 Research Proposal
Allison Bawden
Expectations of Reciprocity? An Analysis of Critique in Facebook Posts by Stu...
Expectations of Reciprocity? An Analysis of Critique in Facebook Posts by Stu...Expectations of Reciprocity? An Analysis of Critique in Facebook Posts by Stu...
Expectations of Reciprocity? An Analysis of Critique in Facebook Posts by Stu...
colin gray
Designing courses for significant learning
Designing courses for significant learningDesigning courses for significant learning
Designing courses for significant learning
Bronwyn Hegarty
10 Lessons about Virtual Network Leadership Development | Panelist: June Holley
10 Lessons about Virtual Network Leadership Development | Panelist: June Holley10 Lessons about Virtual Network Leadership Development | Panelist: June Holley
10 Lessons about Virtual Network Leadership Development | Panelist: June Holley
Leadership Learning Community
Hive february meet up deck 2.25.14 final
Hive february meet up deck 2.25.14 finalHive february meet up deck 2.25.14 final
Hive february meet up deck 2.25.14 final
valleraj
Motivational Interviewing (MI) Club - The 4 MI Processes
Motivational Interviewing (MI) Club - The 4 MI ProcessesMotivational Interviewing (MI) Club - The 4 MI Processes
Motivational Interviewing (MI) Club - The 4 MI Processes
John Russell
Motivational Interviewing Club - The 4 MI Processes
Motivational Interviewing Club - The 4 MI ProcessesMotivational Interviewing Club - The 4 MI Processes
Motivational Interviewing Club - The 4 MI Processes
John Russell
Feedback loops: How SREs benefit and what is needed to realize their potential
Feedback loops: How SREs benefit and what is needed to realize their potentialFeedback loops: How SREs benefit and what is needed to realize their potential
Feedback loops: How SREs benefit and what is needed to realize their potential
Pooja Tangi
How to Ask for Technical Help? Evidence-based Guidelines for Writing Question...
How to Ask for Technical Help? Evidence-based Guidelines for Writing Question...How to Ask for Technical Help? Evidence-based Guidelines for Writing Question...
How to Ask for Technical Help? Evidence-based Guidelines for Writing Question...
Fabio Calefato
Ikeda ica2017
Ikeda ica2017Ikeda ica2017
Ikeda ica2017
siramatu-lab
Socratic seminar powerpoint
Socratic seminar powerpointSocratic seminar powerpoint
Socratic seminar powerpoint
Danny Norwood
tugas persentasi kelompok 5 dan selamat menyaksikan
tugas persentasi kelompok 5 dan selamat menyaksikantugas persentasi kelompok 5 dan selamat menyaksikan
tugas persentasi kelompok 5 dan selamat menyaksikan
Nadilacahyaputri
Using Developer Conversations to Resolve Uncertainty in Software Development:...
Using Developer Conversations to Resolve Uncertainty in Software Development:...Using Developer Conversations to Resolve Uncertainty in Software Development:...
Using Developer Conversations to Resolve Uncertainty in Software Development:...
Michalis Famelis
Enabling Expert Critique with Chatbots and Micro-Guidance - Ci 2018
Enabling Expert Critique with Chatbots and Micro-Guidance - Ci 2018Enabling Expert Critique with Chatbots and Micro-Guidance - Ci 2018
Enabling Expert Critique with Chatbots and Micro-Guidance - Ci 2018
Carlos Toxtli
UXPA 2023: UX research: Optimizing collaboration with project research sponsors
UXPA 2023: UX research: Optimizing collaboration with project research sponsorsUXPA 2023: UX research: Optimizing collaboration with project research sponsors
UXPA 2023: UX research: Optimizing collaboration with project research sponsors
UXPA International
Using Instagram to investigate the role of social presence in intermediate-le...
Using Instagram to investigate the role of social presence in intermediate-le...Using Instagram to investigate the role of social presence in intermediate-le...
Using Instagram to investigate the role of social presence in intermediate-le...
Fabrizio Fornara
ICSE 2016 - Overcoming Open Source Project Entry Barriers with a Portal for N...
ICSE 2016 - Overcoming Open Source Project Entry Barriers with a Portal for N...ICSE 2016 - Overcoming Open Source Project Entry Barriers with a Portal for N...
ICSE 2016 - Overcoming Open Source Project Entry Barriers with a Portal for N...
Igor Steinmacher
TIGed Education for Social Innovation Course: Session 4
TIGed Education for Social Innovation Course: Session 4TIGed Education for Social Innovation Course: Session 4
TIGed Education for Social Innovation Course: Session 4
Jennifer Corriero
Looking at project protocols
Looking at project protocolsLooking at project protocols
Looking at project protocols
Aaron Maurer
Introduction to Design Thinking Workshop
Introduction to Design Thinking WorkshopIntroduction to Design Thinking Workshop
Introduction to Design Thinking Workshop
Molly B. Zielezinski PhD
JMS480 Research Proposal
JMS480 Research ProposalJMS480 Research Proposal
JMS480 Research Proposal
Allison Bawden
Expectations of Reciprocity? An Analysis of Critique in Facebook Posts by Stu...
Expectations of Reciprocity? An Analysis of Critique in Facebook Posts by Stu...Expectations of Reciprocity? An Analysis of Critique in Facebook Posts by Stu...
Expectations of Reciprocity? An Analysis of Critique in Facebook Posts by Stu...
colin gray
Designing courses for significant learning
Designing courses for significant learningDesigning courses for significant learning
Designing courses for significant learning
Bronwyn Hegarty
10 Lessons about Virtual Network Leadership Development | Panelist: June Holley
10 Lessons about Virtual Network Leadership Development | Panelist: June Holley10 Lessons about Virtual Network Leadership Development | Panelist: June Holley
10 Lessons about Virtual Network Leadership Development | Panelist: June Holley
Leadership Learning Community
Hive february meet up deck 2.25.14 final
Hive february meet up deck 2.25.14 finalHive february meet up deck 2.25.14 final
Hive february meet up deck 2.25.14 final
valleraj
Motivational Interviewing (MI) Club - The 4 MI Processes
Motivational Interviewing (MI) Club - The 4 MI ProcessesMotivational Interviewing (MI) Club - The 4 MI Processes
Motivational Interviewing (MI) Club - The 4 MI Processes
John Russell
Motivational Interviewing Club - The 4 MI Processes
Motivational Interviewing Club - The 4 MI ProcessesMotivational Interviewing Club - The 4 MI Processes
Motivational Interviewing Club - The 4 MI Processes
John Russell
Feedback loops: How SREs benefit and what is needed to realize their potential
Feedback loops: How SREs benefit and what is needed to realize their potentialFeedback loops: How SREs benefit and what is needed to realize their potential
Feedback loops: How SREs benefit and what is needed to realize their potential
Pooja Tangi
How to Ask for Technical Help? Evidence-based Guidelines for Writing Question...
How to Ask for Technical Help? Evidence-based Guidelines for Writing Question...How to Ask for Technical Help? Evidence-based Guidelines for Writing Question...
How to Ask for Technical Help? Evidence-based Guidelines for Writing Question...
Fabio Calefato
Socratic seminar powerpoint
Socratic seminar powerpointSocratic seminar powerpoint
Socratic seminar powerpoint
Danny Norwood
tugas persentasi kelompok 5 dan selamat menyaksikan
tugas persentasi kelompok 5 dan selamat menyaksikantugas persentasi kelompok 5 dan selamat menyaksikan
tugas persentasi kelompok 5 dan selamat menyaksikan
Nadilacahyaputri
Using Developer Conversations to Resolve Uncertainty in Software Development:...
Using Developer Conversations to Resolve Uncertainty in Software Development:...Using Developer Conversations to Resolve Uncertainty in Software Development:...
Using Developer Conversations to Resolve Uncertainty in Software Development:...
Michalis Famelis
Enabling Expert Critique with Chatbots and Micro-Guidance - Ci 2018
Enabling Expert Critique with Chatbots and Micro-Guidance - Ci 2018Enabling Expert Critique with Chatbots and Micro-Guidance - Ci 2018
Enabling Expert Critique with Chatbots and Micro-Guidance - Ci 2018
Carlos Toxtli
UXPA 2023: UX research: Optimizing collaboration with project research sponsors
UXPA 2023: UX research: Optimizing collaboration with project research sponsorsUXPA 2023: UX research: Optimizing collaboration with project research sponsors
UXPA 2023: UX research: Optimizing collaboration with project research sponsors
UXPA International
Using Instagram to investigate the role of social presence in intermediate-le...
Using Instagram to investigate the role of social presence in intermediate-le...Using Instagram to investigate the role of social presence in intermediate-le...
Using Instagram to investigate the role of social presence in intermediate-le...
Fabrizio Fornara

More from Igor Steinmacher (7)

Almost there a study on quasi contributors in open source software projects ...
Almost there  a study on quasi contributors in open source software projects ...Almost there  a study on quasi contributors in open source software projects ...
Almost there a study on quasi contributors in open source software projects ...
Igor Steinmacher
Introdu巽達o ao GitHub  e GitIntrodu巽達o ao GitHub  e Git
Introdu巽達o ao GitHub e Git
Igor Steinmacher
Apresenta巽ao do Grupo de Pesquisa (Eng. Software e Sistemas Colaborativos) UT...Apresenta巽ao do Grupo de Pesquisa (Eng. Software e Sistemas Colaborativos) UT...
Apresenta巽ao do Grupo de Pesquisa (Eng. Software e Sistemas Colaborativos) UT...
Igor Steinmacher
Barreiras  entrada de novatos em projetos de software livre - Forum Goiano d...Barreiras  entrada de novatos em projetos de software livre - Forum Goiano d...
Barreiras entrada de novatos em projetos de software livre - Forum Goiano d...
Igor Steinmacher
CHASE 2014 - The hard of newcomers to OSS projects
CHASE 2014 - The hard of newcomers to OSS projectsCHASE 2014 - The hard of newcomers to OSS projects
CHASE 2014 - The hard of newcomers to OSS projects
Igor Steinmacher
An叩lise da Desist棚ncia de Novatos em Projetos de Software Livre: Caso do Proj...An叩lise da Desist棚ncia de Novatos em Projetos de Software Livre: Caso do Proj...
An叩lise da Desist棚ncia de Novatos em Projetos de Software Livre: Caso do Proj...
Igor Steinmacher
MinerAll: Uma ferramenta para extra巽達o e minera巽達o de dados de reposit坦rios d...MinerAll: Uma ferramenta para extra巽達o e minera巽達o de dados de reposit坦rios d...
MinerAll: Uma ferramenta para extra巽達o e minera巽達o de dados de reposit坦rios d...
Igor Steinmacher
Almost there a study on quasi contributors in open source software projects ...
Almost there  a study on quasi contributors in open source software projects ...Almost there  a study on quasi contributors in open source software projects ...
Almost there a study on quasi contributors in open source software projects ...
Igor Steinmacher
Introdu巽達o ao GitHub  e GitIntrodu巽達o ao GitHub  e Git
Introdu巽達o ao GitHub e Git
Igor Steinmacher
Apresenta巽ao do Grupo de Pesquisa (Eng. Software e Sistemas Colaborativos) UT...Apresenta巽ao do Grupo de Pesquisa (Eng. Software e Sistemas Colaborativos) UT...
Apresenta巽ao do Grupo de Pesquisa (Eng. Software e Sistemas Colaborativos) UT...
Igor Steinmacher
Barreiras  entrada de novatos em projetos de software livre - Forum Goiano d...Barreiras  entrada de novatos em projetos de software livre - Forum Goiano d...
Barreiras entrada de novatos em projetos de software livre - Forum Goiano d...
Igor Steinmacher
CHASE 2014 - The hard of newcomers to OSS projects
CHASE 2014 - The hard of newcomers to OSS projectsCHASE 2014 - The hard of newcomers to OSS projects
CHASE 2014 - The hard of newcomers to OSS projects
Igor Steinmacher
An叩lise da Desist棚ncia de Novatos em Projetos de Software Livre: Caso do Proj...An叩lise da Desist棚ncia de Novatos em Projetos de Software Livre: Caso do Proj...
An叩lise da Desist棚ncia de Novatos em Projetos de Software Livre: Caso do Proj...
Igor Steinmacher
MinerAll: Uma ferramenta para extra巽達o e minera巽達o de dados de reposit坦rios d...MinerAll: Uma ferramenta para extra巽達o e minera巽達o de dados de reposit坦rios d...
MinerAll: Uma ferramenta para extra巽達o e minera巽達o de dados de reposit坦rios d...
Igor Steinmacher

Why do newcomers abandon open source software projects?

  • 1. WHY DO NEWCOMERS ABANDON OPEN SOURCE SOFTWARE PROJECTS? Igor Steinmacher Igor Scaliante Wiese Ana Paula Chaves Marco Aur辿lio Gerosa
  • 2. CONTEXT ... and need support on their first steps 2 Newcomers are explorers who must orient themselves within an unfamiliar landscape... [Degenais et al. 2010] B. Dagenais, H. Ossher, R.K.E Bellamy, M.P. Robillard and J.P. de Vries, Moving into a new software project landscape, in ICSE 2010.
  • 3. GOAL Research Question 4 Does the absence of response, politeness, usefulness or the author of answers influence the retention of newcomers in an open source project? Specific goals: During newcomers first interactions with the project check if they receive answers; observe who are the authors of the answers to their questions; classify the answers received by the newcomers.
  • 4. DATA Hadoop Common Project 60 months Mailing lists 9285 threads 50128 messages Issue tracker discussions (Jira) 7721 issues 76065 comments 5
  • 5. Issue Tracker Mailing List Identification of Existant Members (36 months) Newcomers Identification (6 months) Newcomers that Returned (6 months) Retained Newcomers (+ 12 months) Newcomers that Abandoned (6 months) Survey Extractors 6 1 2 3 3 4
  • 6. # users % of existant % of newcomers Existant members (interval 1) 677 Newcomers (interval 2) 67 9.90% Remaining (interval 3) 20 2.95% 29.85% Retained (interval 4) 12 1.77% 17.91% RESULTS (RETENTION) 7 Mailing list newcomers # users % of existant % of newcomers Existant members (interval 1) 483 Newcomers (interval 2) 127 26.29% Remaining (interval 3) 30 6.21% 23.62% Retained (interval 4) 17 3.52% 13.39% Issue tracker newcomers (Jira)
  • 7. SG1: ARE NEWCOMERS ANSWERED? 8 # people Abandoned Appear on intervals 3 and 4 Answered 13 11 (84.6%) 2 (15.4%) Not answered 34 30 (88.2%) 4 (11.8%) # people Abandoned Appear on intervals 3 and 4 Not commented 7 6 (85.7%) 1 (14.3%) Received comments 71 55 (77.5%) 16 (22.5%) Issue tracker newcomers (Jira) Mailing list newcomers
  • 8. 20 threads triggered by newcomers that abandoned the project had some answer from other newcomer SG2: WHO ANSWERS NEWCOMERS? 9 Mailing list No message sent by a remaining newcomer was answered only by other newcomers. There are some hints that the authors of answere influence the newcomers After manual analysis: content of the answers seems to be more relevant
  • 9. SG2: WHO ANSWERS NEWCOMERS? 10 Jira Very heterogeneous participation Discussions are contextualized and focused Higher amount of messages exchanged per thread (issue)
  • 10. SG3: WHAT KIND OF ANSWER DO NEWCOMERS RECEIVE? Answer type Left the project Remained Useful / On Topic 20 7 Not Useful / Another question 5 0 Not Useful / Offtopic 3 0 Indifferent 1 0 Other 4 0 11 Answers are in topic, contextualized and bring useful information Mailing List Issue tracker
  • 11. RESULTS QUESTIONNAIRE 1. Do you remember sending an email to hadoop-common-dev mailing list? 2. At that time, were you interested to keep contributing to Hadoop project? 2a. In case you answered YES to question 2, why did you give up? 2b. In case you answered NO to question 2, what was the goal of the messages sent to developers list? 3. Have you contributed to the project after June 2009? 4. Have you contributed to other Open Source project BEFORE 2009? 12 Question 1 Question 2 Question 3 Question 4 Yes 13 11 1 7 No 0 2 12 6 11
  • 12. RESULTS QUESTIONNAIRE Type of answer Answer to question 2 Yes (2a) No (2b) i. The user just wanted to clarify some doubt 0 2 ii. Question not answered or answer did not help 2 0 iii. Lack of help to choose a task 3 0 iv. Not accepted by the Project 1 0 v. Changed focus or company 4 0 vi. Resumed the contributions later 1 0 13 2a. In case you answered YES to question 2, why did you give up? 2b. In case you answered NO to question 2, what was the goal of the messages sent to developers list? ... My issue was how to start contributing If I could have got some hand holding that might have helped I got no answer for my question
  • 13. CONCLUSIONS absence of answer politeness of answers receptiveness (survey) usefulness of answer type of author Initial interactions influence newcomers decision to recontribute to the project Social skills are required 14 Does the absence of response, politeness, usefulness or the author of answers influence the retention of newcomers in an open source project?
  • 14. QUESTIONS? Igor Steinmacher igorfs@utfpr.edu.br Igor Scaliante Wiese igor@utfpr.edu.br Ana Paula Chaves anachaves@utfpr.edu.br Marco Aur辿lio Gerosa gerosa@ime.usp.br