際際滷

際際滷Share a Scribd company logo
Amplify Your Testing Efforts Automatically
With STAMP Open Source Tools
Olivier Bouzereau
ob@ow2.org
06/12/2018
2
PSA Java Framework
OW2 in a nutshell

Non-Profit Open Source Organization with EU roots
 An open source infrastructure code base

25 mature projects, 35 incubation, 40 archived (100 projects)
 A Community of 2400+ individual OSS developers

to share expertise, experience and opportunities
 25 Academic, Public & Private org., SMEs Members

Orange, INRIA, Airbus, Fraunhofer Fokus, Oslo University

ActiveEon, Bluemind, Bonitasoft, City of Paris, Teclib, XWiki...
 Five R&D Collaborative Projects in 2019

STAMP, CROSSMINER, DECODER, FASTEN, REACHOUT
 A Governance to Define the Strategy, Initiatives & Values

Board of Directors + Technology Council

Management Office
BPM
Lutece
CMS
Security SIEM
ex-SpagoBI
Managed File
Transfer Solution
3
OW2, a Community Platform
4
Software Testing Amplification

STAMP Project
 Software
 Testing
 AMPlification

An Horizon 2020 project
 EU support during three years 2017-2019

A consortium of 10 partners
5
STAMP or Sisyphus Made Happy

Software testers may feel like Sisyphus, in perpetual testing efforts

Research angle:
 Could software code automatic perturbations offer more stability & reliability?
 A Bug Absorbing Zone to improve the Correctness Attraction*

We must imagine Sisyphus happy, Albert Camus (1913-1960)
* Read IEEE Software blog: http://blog.ieeesoftware.org/2018/11/correctness-attraction-study-of.html
6
STAMP: a DevOps Toolset
www.stamp-project.euDev Ops
7
STAMP Outcomes and Benefits

Outcomes so far:
 3 PhD Thesis
 6 Workshops
 23 Scientific Articles
 24 Industry & OSS Events
 12 Software incl.:

DSpot

Descartes

CAMP

Botsing
8
STAMP Environment

STAMP Prerequisite
Knowledge and Practices
 Java 8+
 Git Repository
 Apache Maven
 A Test Practice to Amplify

STAMP Compatible Environments
 Standalone Shell Scripts
 Available as Maven/Gradle Plugins
 Integration within Eclipse/IntelliJ IDE
9
Descartes on Five Use Cases

A Recent Descartes Quality Evaluation Study
 2 Iterations on 5 Use Cases: TellU, OW2, Atos, XWiki, AEON
 10 criteria checked, with time & learnability improvements in 2nd iteration (in red)
 A process to define: run Descartes after each new test written for instance.
10
OW2 Use Cases for STAMP project

Enhancing OW2 testing toolset to improve OW2
project maturity

Providing to STAMP real use cases incl. SAT4J,
DocDoku, Bonita, SeedSack.
 DSpot to generate new tests, based on existing tests
 Descartes to provide extreme mutation

A Pitest plugin

Report on new mutants (not killed = undetected)

ActiveEon & XWiki
 OW2 members and software editors
 Both provide STAMP experimentations
11
Beta Testing Campaign
12
Three Steps to be part of STAMP Success
l.ow2.org/stpbeta
13
Your Role in STAMP

Visit the STAMP GitHub, read and try:
 DSpot: Yes, I can amplify my tests!
 Descartes: I mutate, therefore I am...

CAMP, Botsing: My next CI/CD testing tools

In case of failure or difficulty? Im posting issues!

Online questionnaire: My experience with STAMP is...
 Be recognized as a STAMP open source contributor
 A chance to win a STAMP Test Pilot gift, while staying honest!

All results are good results, well interpreted
 Join the beta testing campaign: https://l.ow2.org/stpbeta
14
Next Workshop in Sophia-Antipolis

STAMP Workshop:
the State-of-the-art in Java Automation Testing

Inria Sophia-Antipolis
 30 January 2019 from 13:30 to 18:00

Bring your own laptop, Java App & Test suite
 Detailed demos
 Tutorials
 Networking (coffee) breaks

Come share with us!

Free online registration:
https://l.ow2.org/stampsophia
15
Join the STAMP community now!

STAMP Website: https://www.stamp-project.eu

Beta testing campaign: https://l.ow2.org/stpbeta

Sophia-Antipolis Workshop
 30 January 2019 @ Inria
 13:30-18:00
 Free online registration: https://l.ow2.org/stampsophia

More Related Content

STAMP Project at Telecom Valley 6 Dec. 2018

  • 1. Amplify Your Testing Efforts Automatically With STAMP Open Source Tools Olivier Bouzereau ob@ow2.org 06/12/2018
  • 2. 2 PSA Java Framework OW2 in a nutshell Non-Profit Open Source Organization with EU roots An open source infrastructure code base 25 mature projects, 35 incubation, 40 archived (100 projects) A Community of 2400+ individual OSS developers to share expertise, experience and opportunities 25 Academic, Public & Private org., SMEs Members Orange, INRIA, Airbus, Fraunhofer Fokus, Oslo University ActiveEon, Bluemind, Bonitasoft, City of Paris, Teclib, XWiki... Five R&D Collaborative Projects in 2019 STAMP, CROSSMINER, DECODER, FASTEN, REACHOUT A Governance to Define the Strategy, Initiatives & Values Board of Directors + Technology Council Management Office BPM Lutece CMS Security SIEM ex-SpagoBI Managed File Transfer Solution
  • 4. 4 Software Testing Amplification STAMP Project Software Testing AMPlification An Horizon 2020 project EU support during three years 2017-2019 A consortium of 10 partners
  • 5. 5 STAMP or Sisyphus Made Happy Software testers may feel like Sisyphus, in perpetual testing efforts Research angle: Could software code automatic perturbations offer more stability & reliability? A Bug Absorbing Zone to improve the Correctness Attraction* We must imagine Sisyphus happy, Albert Camus (1913-1960) * Read IEEE Software blog: http://blog.ieeesoftware.org/2018/11/correctness-attraction-study-of.html
  • 6. 6 STAMP: a DevOps Toolset www.stamp-project.euDev Ops
  • 7. 7 STAMP Outcomes and Benefits Outcomes so far: 3 PhD Thesis 6 Workshops 23 Scientific Articles 24 Industry & OSS Events 12 Software incl.: DSpot Descartes CAMP Botsing
  • 8. 8 STAMP Environment STAMP Prerequisite Knowledge and Practices Java 8+ Git Repository Apache Maven A Test Practice to Amplify STAMP Compatible Environments Standalone Shell Scripts Available as Maven/Gradle Plugins Integration within Eclipse/IntelliJ IDE
  • 9. 9 Descartes on Five Use Cases A Recent Descartes Quality Evaluation Study 2 Iterations on 5 Use Cases: TellU, OW2, Atos, XWiki, AEON 10 criteria checked, with time & learnability improvements in 2nd iteration (in red) A process to define: run Descartes after each new test written for instance.
  • 10. 10 OW2 Use Cases for STAMP project Enhancing OW2 testing toolset to improve OW2 project maturity Providing to STAMP real use cases incl. SAT4J, DocDoku, Bonita, SeedSack. DSpot to generate new tests, based on existing tests Descartes to provide extreme mutation A Pitest plugin Report on new mutants (not killed = undetected) ActiveEon & XWiki OW2 members and software editors Both provide STAMP experimentations
  • 12. 12 Three Steps to be part of STAMP Success l.ow2.org/stpbeta
  • 13. 13 Your Role in STAMP Visit the STAMP GitHub, read and try: DSpot: Yes, I can amplify my tests! Descartes: I mutate, therefore I am... CAMP, Botsing: My next CI/CD testing tools In case of failure or difficulty? Im posting issues! Online questionnaire: My experience with STAMP is... Be recognized as a STAMP open source contributor A chance to win a STAMP Test Pilot gift, while staying honest! All results are good results, well interpreted Join the beta testing campaign: https://l.ow2.org/stpbeta
  • 14. 14 Next Workshop in Sophia-Antipolis STAMP Workshop: the State-of-the-art in Java Automation Testing Inria Sophia-Antipolis 30 January 2019 from 13:30 to 18:00 Bring your own laptop, Java App & Test suite Detailed demos Tutorials Networking (coffee) breaks Come share with us! Free online registration: https://l.ow2.org/stampsophia
  • 15. 15 Join the STAMP community now! STAMP Website: https://www.stamp-project.eu Beta testing campaign: https://l.ow2.org/stpbeta Sophia-Antipolis Workshop 30 January 2019 @ Inria 13:30-18:00 Free online registration: https://l.ow2.org/stampsophia