ºÝºÝߣ

ºÝºÝߣShare a Scribd company logo
TopCoder
Developing software through crowdsourcing
How TopCoder came
about?Jack Hughes
Tallan Inc. (Business
Data Services)
Sold for $920M
Lessons learnt from
Tallan?
Not happy with the operations of Tallan
Expensive and time consuming recruitment
process
Evolving technologies results in high employee
turnover rate
More can be done to save clients time and money
Crowdsourcing was the solution!
TopCoder v1.0
Consulting Business Model
Host competitions with monetary rewards from
sponsors
Build community strength
Gain popularity
Winner gets a job with the sponsor
HR firm
? Looking to
hire
Client
? Held
Competitions
TopCoder ? Winner got
hired
Crowd
TopCoder v2.0
Competition Based Model
Crowd sourcing Software Development
Tasks of Software Development Process
Task
Conceptual
ization
Specificatio
n
Architec
ture
Component
Production
Application
Assembly
Certific
ation
Deploy
ment
v.2.0 PM PM PM COM PM PM PM
? Looking for
software
application
Client
? Held
Competitions
TopCoder ? Winner got
rewarded
Crowd
TopCoder v2.1
Competition Based Model
Dissatisfied with $20 mln in revenue
Platform Managers costs too high
Tasks of Software Development Process
? Looking for
software
application
Client
? Held
Competitions
TopCoder ? Winner got
rewarded
Crowd
Task
Conceptual
ization
Specificatio
n
Architec
ture
Component
Production
Application
Assembly
Certific
ation
Deploy
ment
v.2.0 PM PM PM COM PM PM PM
v2.1 PM & COM PM & COM COM COM COM PM
PM &
COM
Did it work?
2007 2008 2009
Total Revenue
(million)
$18.31 $18.75 $8.44
Cost of Platform
Managers
(million)
$4.89 $4.59 $1.88
Cost of PM vs
TR (%)
26.7% 24.5% 22.3%
Decrease in contest from 2008 to 2009
Switched from hourly based consultation to monthly
fee
Types of Competition
Algorithm Competition
Attract new members
Retain existing members
Software Development Competition
Provide clients with specific solutions
Expand TopCoder¡¯s catalog
Top coder
Algorithm Competitions
Timed competitions
Available in Java, C#, C++ & VB.Net
Single Round Match consists:
Coding Phase
Challenging Phase
System Testing Phase
Algorithm Competitions
Coding Phase
Lasts 75 mins
Contestants presented with the same 3 questions
Points awarded for successfully compiled solutions
Total time elapsed
Challenging Phase
Lasts 15 mins
Challenge the functionality of other competitors¡¯ code
Successful challenge:
Defendant ¨C loss of original submission points
Challenger ¨C 50 point reward
Unsuccessful challenge:
Challenger ¨C reduction of 25 points
Algorithm Competitions
System Testing Phase
Applied to all submitted code (not successfully
challenged)
Flawed code submission will lose all points
Automated tester applies a set of inputs
if submission¡¯s output does not match expected
output, submission is considered flawed
All successful challenges will be added to the set of
inputs for the System Testing Phase
Top coder
Example of an Algorithm
Competition
Example of Algorithm
Competition
011100011
Encrypt by adding to each digit to the sum of the
adjacent digits
[0+1], [0+1+1], [1+1+1] etc.
123210122
How does it attract & retain the
TopCoder Community
Think about your lab practices/tests
Challenging
Prove your worth
Self improvement
Community
TopCoder Community Activeness & Earning
Distribution
Latent
Pool
Normal
Active
Pool
82.5% 17.5% 95%
5%
Motivating the Community
Money is the most attractive thing
TopCoder ratings
Top coder
How to motivate the latent
pool?
Monetary Award
$50 for successful compilation of code by latent
pool (for 5 rounds)
1.5 times prize money if they are the winner
Prospective Jobs
Ad

Recommended

Probytes delivery methodology
Probytes delivery methodology
Jointviews
?
Why software testing
Why software testing
transformtoit
?
New Resource
New Resource
Md Joynal Abaden
?
Incorporating VM Technology Into Your Automated Testing
Incorporating VM Technology Into Your Automated Testing
dmyakovlev
?
Continuous Improvement & Flow
Continuous Improvement & Flow
Agile Software Community of India
?
Qtp - Introduction values
Qtp - Introduction values
Vibrant Technologies & Computers
?
Agel China
Agel China
Zaven Tatevyan
?
Intel technology manual
Intel technology manual
Plaza de la Tecnolog¨ªa
?
Top coder
Top coder
Ming Hong Lim
?
Top Coder Platform Overview 92209
Top Coder Platform Overview 92209
Brian
?
1
1
Helga7
?
Topcoder Reflections: Observations from a Decade of Crowdsourcing with the Pu...
Topcoder Reflections: Observations from a Decade of Crowdsourcing with the Pu...
Crowdsourcing Week
?
Topcoder Reflections: Observations from a Decade of Crowdsourcing with the Pu...
Topcoder Reflections: Observations from a Decade of Crowdsourcing with the Pu...
Epi Ludvik Nekaj Óî ºÕ
?
TC Crowdsourcing Presentation
TC Crowdsourcing Presentation
guestb0b31
?
Interviews
Interviews
Kaushik Raghupathi
?
How to get placed in product based companies as a software developer
How to get placed in product based companies as a software developer
varunbhatt23
?
Cracking the coding interview u penn - sept 30 2010
Cracking the coding interview u penn - sept 30 2010
careercup
?
Cracking The Technical Interview Uw
Cracking The Technical Interview Uw
careercup
?
Cracking the Coding Interview (Oct 2012)
Cracking the Coding Interview (Oct 2012)
careercup
?
Cracking The Technical Interview
Cracking The Technical Interview
careercup
?
Stepping Outside
Stepping Outside
Lasse Koskela
?
Cracking the coding interview columbia - march 23 2011
Cracking the coding interview columbia - march 23 2011
careercup
?
Ace the Tech Interviews - www.hiredintech.com
Ace the Tech Interviews - www.hiredintech.com
Anton Dimitrov
?
Kiev Coding Dojo
Kiev Coding Dojo
Johannes Brodwall
?
Crowd Sourcing Presentation10 30
Crowd Sourcing Presentation10 30
guest46410
?
How to get a job 2016
How to get a job 2016
John Clegg
?
Software coding and testing
Software coding and testing
Sandeep Kumar Nayak
?
An introduction to Competitive Programming
An introduction to Competitive Programming
Gaurav Agarwal
?
OWASP Barcelona 2025 Threat Model Library
OWASP Barcelona 2025 Threat Model Library
PetraVukmirovic
?
Enabling BIM / GIS integrations with Other Systems with FME
Enabling BIM / GIS integrations with Other Systems with FME
Safe Software
?

More Related Content

Similar to Top coder (20)

Top coder
Top coder
Ming Hong Lim
?
Top Coder Platform Overview 92209
Top Coder Platform Overview 92209
Brian
?
1
1
Helga7
?
Topcoder Reflections: Observations from a Decade of Crowdsourcing with the Pu...
Topcoder Reflections: Observations from a Decade of Crowdsourcing with the Pu...
Crowdsourcing Week
?
Topcoder Reflections: Observations from a Decade of Crowdsourcing with the Pu...
Topcoder Reflections: Observations from a Decade of Crowdsourcing with the Pu...
Epi Ludvik Nekaj Óî ºÕ
?
TC Crowdsourcing Presentation
TC Crowdsourcing Presentation
guestb0b31
?
Interviews
Interviews
Kaushik Raghupathi
?
How to get placed in product based companies as a software developer
How to get placed in product based companies as a software developer
varunbhatt23
?
Cracking the coding interview u penn - sept 30 2010
Cracking the coding interview u penn - sept 30 2010
careercup
?
Cracking The Technical Interview Uw
Cracking The Technical Interview Uw
careercup
?
Cracking the Coding Interview (Oct 2012)
Cracking the Coding Interview (Oct 2012)
careercup
?
Cracking The Technical Interview
Cracking The Technical Interview
careercup
?
Stepping Outside
Stepping Outside
Lasse Koskela
?
Cracking the coding interview columbia - march 23 2011
Cracking the coding interview columbia - march 23 2011
careercup
?
Ace the Tech Interviews - www.hiredintech.com
Ace the Tech Interviews - www.hiredintech.com
Anton Dimitrov
?
Kiev Coding Dojo
Kiev Coding Dojo
Johannes Brodwall
?
Crowd Sourcing Presentation10 30
Crowd Sourcing Presentation10 30
guest46410
?
How to get a job 2016
How to get a job 2016
John Clegg
?
Software coding and testing
Software coding and testing
Sandeep Kumar Nayak
?
An introduction to Competitive Programming
An introduction to Competitive Programming
Gaurav Agarwal
?
Top Coder Platform Overview 92209
Top Coder Platform Overview 92209
Brian
?
Topcoder Reflections: Observations from a Decade of Crowdsourcing with the Pu...
Topcoder Reflections: Observations from a Decade of Crowdsourcing with the Pu...
Crowdsourcing Week
?
Topcoder Reflections: Observations from a Decade of Crowdsourcing with the Pu...
Topcoder Reflections: Observations from a Decade of Crowdsourcing with the Pu...
Epi Ludvik Nekaj Óî ºÕ
?
TC Crowdsourcing Presentation
TC Crowdsourcing Presentation
guestb0b31
?
How to get placed in product based companies as a software developer
How to get placed in product based companies as a software developer
varunbhatt23
?
Cracking the coding interview u penn - sept 30 2010
Cracking the coding interview u penn - sept 30 2010
careercup
?
Cracking The Technical Interview Uw
Cracking The Technical Interview Uw
careercup
?
Cracking the Coding Interview (Oct 2012)
Cracking the Coding Interview (Oct 2012)
careercup
?
Cracking The Technical Interview
Cracking The Technical Interview
careercup
?
Cracking the coding interview columbia - march 23 2011
Cracking the coding interview columbia - march 23 2011
careercup
?
Ace the Tech Interviews - www.hiredintech.com
Ace the Tech Interviews - www.hiredintech.com
Anton Dimitrov
?
Crowd Sourcing Presentation10 30
Crowd Sourcing Presentation10 30
guest46410
?
How to get a job 2016
How to get a job 2016
John Clegg
?
An introduction to Competitive Programming
An introduction to Competitive Programming
Gaurav Agarwal
?

Recently uploaded (20)

OWASP Barcelona 2025 Threat Model Library
OWASP Barcelona 2025 Threat Model Library
PetraVukmirovic
?
Enabling BIM / GIS integrations with Other Systems with FME
Enabling BIM / GIS integrations with Other Systems with FME
Safe Software
?
FME for Distribution & Transmission Integrity Management Program (DIMP & TIMP)
FME for Distribution & Transmission Integrity Management Program (DIMP & TIMP)
Safe Software
?
High Availability On-Premises FME Flow.pdf
High Availability On-Premises FME Flow.pdf
Safe Software
?
Viral>Wondershare Filmora 14.5.18.12900 Crack Free Download
Viral>Wondershare Filmora 14.5.18.12900 Crack Free Download
Puppy jhon
?
ENERGY CONSUMPTION CALCULATION IN ENERGY-EFFICIENT AIR CONDITIONER.pdf
ENERGY CONSUMPTION CALCULATION IN ENERGY-EFFICIENT AIR CONDITIONER.pdf
Muhammad Rizwan Akram
?
AudGram Review: Build Visually Appealing, AI-Enhanced Audiograms to Engage Yo...
AudGram Review: Build Visually Appealing, AI-Enhanced Audiograms to Engage Yo...
SOFTTECHHUB
?
Kubernetes Security Act Now Before It¡¯s Too Late
Kubernetes Security Act Now Before It¡¯s Too Late
Michael Furman
?
FIDO Seminar: Evolving Landscape of Post-Quantum Cryptography.pptx
FIDO Seminar: Evolving Landscape of Post-Quantum Cryptography.pptx
FIDO Alliance
?
Security Tips for Enterprise Azure Solutions
Security Tips for Enterprise Azure Solutions
Michele Leroux Bustamante
?
Creating Inclusive Digital Learning with AI: A Smarter, Fairer Future
Creating Inclusive Digital Learning with AI: A Smarter, Fairer Future
Impelsys Inc.
?
MuleSoft for AgentForce : Topic Center and API Catalog
MuleSoft for AgentForce : Topic Center and API Catalog
shyamraj55
?
Data Validation and System Interoperability
Data Validation and System Interoperability
Safe Software
?
¡°Addressing Evolving AI Model Challenges Through Memory and Storage,¡± a Prese...
¡°Addressing Evolving AI Model Challenges Through Memory and Storage,¡± a Prese...
Edge AI and Vision Alliance
?
Artificial Intelligence in the Nonprofit Boardroom.pdf
Artificial Intelligence in the Nonprofit Boardroom.pdf
OnBoard
?
FIDO Seminar: New Data: Passkey Adoption in the Workforce.pptx
FIDO Seminar: New Data: Passkey Adoption in the Workforce.pptx
FIDO Alliance
?
FIDO Alliance Seminar State of Passkeys.pptx
FIDO Alliance Seminar State of Passkeys.pptx
FIDO Alliance
?
Edge-banding-machines-edgeteq-s-200-en-.pdf
Edge-banding-machines-edgeteq-s-200-en-.pdf
AmirStern2
?
Murdledescargadarkweb.pdfvolumen1 100 elementary
Murdledescargadarkweb.pdfvolumen1 100 elementary
JorgeSemperteguiMont
?
FIDO Seminar: Authentication for a Billion Consumers - Amazon.pptx
FIDO Seminar: Authentication for a Billion Consumers - Amazon.pptx
FIDO Alliance
?
OWASP Barcelona 2025 Threat Model Library
OWASP Barcelona 2025 Threat Model Library
PetraVukmirovic
?
Enabling BIM / GIS integrations with Other Systems with FME
Enabling BIM / GIS integrations with Other Systems with FME
Safe Software
?
FME for Distribution & Transmission Integrity Management Program (DIMP & TIMP)
FME for Distribution & Transmission Integrity Management Program (DIMP & TIMP)
Safe Software
?
High Availability On-Premises FME Flow.pdf
High Availability On-Premises FME Flow.pdf
Safe Software
?
Viral>Wondershare Filmora 14.5.18.12900 Crack Free Download
Viral>Wondershare Filmora 14.5.18.12900 Crack Free Download
Puppy jhon
?
ENERGY CONSUMPTION CALCULATION IN ENERGY-EFFICIENT AIR CONDITIONER.pdf
ENERGY CONSUMPTION CALCULATION IN ENERGY-EFFICIENT AIR CONDITIONER.pdf
Muhammad Rizwan Akram
?
AudGram Review: Build Visually Appealing, AI-Enhanced Audiograms to Engage Yo...
AudGram Review: Build Visually Appealing, AI-Enhanced Audiograms to Engage Yo...
SOFTTECHHUB
?
Kubernetes Security Act Now Before It¡¯s Too Late
Kubernetes Security Act Now Before It¡¯s Too Late
Michael Furman
?
FIDO Seminar: Evolving Landscape of Post-Quantum Cryptography.pptx
FIDO Seminar: Evolving Landscape of Post-Quantum Cryptography.pptx
FIDO Alliance
?
Creating Inclusive Digital Learning with AI: A Smarter, Fairer Future
Creating Inclusive Digital Learning with AI: A Smarter, Fairer Future
Impelsys Inc.
?
MuleSoft for AgentForce : Topic Center and API Catalog
MuleSoft for AgentForce : Topic Center and API Catalog
shyamraj55
?
Data Validation and System Interoperability
Data Validation and System Interoperability
Safe Software
?
¡°Addressing Evolving AI Model Challenges Through Memory and Storage,¡± a Prese...
¡°Addressing Evolving AI Model Challenges Through Memory and Storage,¡± a Prese...
Edge AI and Vision Alliance
?
Artificial Intelligence in the Nonprofit Boardroom.pdf
Artificial Intelligence in the Nonprofit Boardroom.pdf
OnBoard
?
FIDO Seminar: New Data: Passkey Adoption in the Workforce.pptx
FIDO Seminar: New Data: Passkey Adoption in the Workforce.pptx
FIDO Alliance
?
FIDO Alliance Seminar State of Passkeys.pptx
FIDO Alliance Seminar State of Passkeys.pptx
FIDO Alliance
?
Edge-banding-machines-edgeteq-s-200-en-.pdf
Edge-banding-machines-edgeteq-s-200-en-.pdf
AmirStern2
?
Murdledescargadarkweb.pdfvolumen1 100 elementary
Murdledescargadarkweb.pdfvolumen1 100 elementary
JorgeSemperteguiMont
?
FIDO Seminar: Authentication for a Billion Consumers - Amazon.pptx
FIDO Seminar: Authentication for a Billion Consumers - Amazon.pptx
FIDO Alliance
?
Ad

Top coder

  • 2. How TopCoder came about?Jack Hughes Tallan Inc. (Business Data Services) Sold for $920M
  • 3. Lessons learnt from Tallan? Not happy with the operations of Tallan Expensive and time consuming recruitment process Evolving technologies results in high employee turnover rate More can be done to save clients time and money Crowdsourcing was the solution!
  • 4. TopCoder v1.0 Consulting Business Model Host competitions with monetary rewards from sponsors Build community strength Gain popularity Winner gets a job with the sponsor HR firm ? Looking to hire Client ? Held Competitions TopCoder ? Winner got hired Crowd
  • 5. TopCoder v2.0 Competition Based Model Crowd sourcing Software Development Tasks of Software Development Process Task Conceptual ization Specificatio n Architec ture Component Production Application Assembly Certific ation Deploy ment v.2.0 PM PM PM COM PM PM PM ? Looking for software application Client ? Held Competitions TopCoder ? Winner got rewarded Crowd
  • 6. TopCoder v2.1 Competition Based Model Dissatisfied with $20 mln in revenue Platform Managers costs too high Tasks of Software Development Process ? Looking for software application Client ? Held Competitions TopCoder ? Winner got rewarded Crowd Task Conceptual ization Specificatio n Architec ture Component Production Application Assembly Certific ation Deploy ment v.2.0 PM PM PM COM PM PM PM v2.1 PM & COM PM & COM COM COM COM PM PM & COM
  • 7. Did it work? 2007 2008 2009 Total Revenue (million) $18.31 $18.75 $8.44 Cost of Platform Managers (million) $4.89 $4.59 $1.88 Cost of PM vs TR (%) 26.7% 24.5% 22.3% Decrease in contest from 2008 to 2009 Switched from hourly based consultation to monthly fee
  • 8. Types of Competition Algorithm Competition Attract new members Retain existing members Software Development Competition Provide clients with specific solutions Expand TopCoder¡¯s catalog
  • 10. Algorithm Competitions Timed competitions Available in Java, C#, C++ & VB.Net Single Round Match consists: Coding Phase Challenging Phase System Testing Phase
  • 11. Algorithm Competitions Coding Phase Lasts 75 mins Contestants presented with the same 3 questions Points awarded for successfully compiled solutions Total time elapsed Challenging Phase Lasts 15 mins Challenge the functionality of other competitors¡¯ code Successful challenge: Defendant ¨C loss of original submission points Challenger ¨C 50 point reward Unsuccessful challenge: Challenger ¨C reduction of 25 points
  • 12. Algorithm Competitions System Testing Phase Applied to all submitted code (not successfully challenged) Flawed code submission will lose all points Automated tester applies a set of inputs if submission¡¯s output does not match expected output, submission is considered flawed All successful challenges will be added to the set of inputs for the System Testing Phase
  • 14. Example of an Algorithm Competition
  • 15. Example of Algorithm Competition 011100011 Encrypt by adding to each digit to the sum of the adjacent digits [0+1], [0+1+1], [1+1+1] etc. 123210122
  • 16. How does it attract & retain the TopCoder Community Think about your lab practices/tests Challenging Prove your worth Self improvement
  • 17. Community TopCoder Community Activeness & Earning Distribution Latent Pool Normal Active Pool 82.5% 17.5% 95% 5%
  • 18. Motivating the Community Money is the most attractive thing TopCoder ratings
  • 20. How to motivate the latent pool? Monetary Award $50 for successful compilation of code by latent pool (for 5 rounds) 1.5 times prize money if they are the winner Prospective Jobs

Editor's Notes

  • #3: http://news.cnet.com/CMGI-to-buy-Tallan-for-920-million/2100-12_3-264732.html