ݺߣ

ݺߣShare a Scribd company logo
SIKULI for Mobile Testing


                               Tom Yeh
                        Assistant Professor
          Department of Computer Science
            University of Colorado Boulder

              Mobile Testing Summit 2012
Sikuli for Mobile Testing
Sikuli for Mobile Testing
Visual Diff
Test 1   Test 2   Test 3   Test 4   Test 5

build
012
Test 1   Test 2   Test 3   Test 4   Test 5

build
012




build
013
Test 1    Test 2   Test 3   Test 4   Test 5

build
012




build
013

                 Are they different?
Test 1   Test 2   Test 3   Test 4   Test 5

build
012




build
013
Sikuli for Mobile Testing
Step 1: Click on
Sikuli for Mobile Testing
Think programming

Which row?
Which column?
What component ID?
What name?
What label?
Think Sikuli

Which does it look like?
Step 1: Click on
Step 1: Click on
Goal:
Uncheck Contacts
Whats wrong?
Sikuli for Mobile Testing
Sikuli for Mobile Testing
Sikuli for Mobile Testing
Harvard Medical School
Sikuli for Mobile Testing
Too Visual
400
manual test cases



              5
  hours of labour
Sikuli for Mobile Testing
2x
release rate
TELENAV
GPS App Maker
Too New
Tests are
automated via
    emulators
NASA
Too Old
Sikuli for Mobile Testing
NASAs part supplier
Tests are automated
   through a remote
 desktop connection
Too Visual Too New   Too Old
Whats coming?
Sikuli for Mobile Testing
http://www.cuberick.com/2010/06/testing-image-generation-with-cucumber.html
Sikuli for Mobile Testing
Sikuli for Mobile Testing
Sikuli for Mobile Testing
Sikuli for Mobile Testing
Sikuli for Mobile Testing
Mobile Testing
 goes Physical
Mobile Testing
 goes Physical
                 Visual
Baxter by Rethink Robotics
Baxter by Rethink Robotics
Sikuli for Mobile Testing

More Related Content

What's hot (20)

Software Testing Basic Concepts
Software Testing Basic ConceptsSoftware Testing Basic Concepts
Software Testing Basic Concepts
wesovi
?
Performance and load testing
Performance and load testingPerformance and load testing
Performance and load testing
sonukalpana
?
Android testing
Android testingAndroid testing
Android testing
JinaTm
?
TDC2015: Testes em APIs REST com Rest-AssuredTDC2015: Testes em APIs REST com Rest-Assured
TDC2015: Testes em APIs REST com Rest-Assured
Jlio de Lima
?
Appium: Automation for Mobile Apps
Appium: Automation for Mobile AppsAppium: Automation for Mobile Apps
Appium: Automation for Mobile Apps
Sauce Labs
?
Getting started with appium
Getting started with appiumGetting started with appium
Getting started with appium
Pratik Patel
?
Automated Testing vs Manual Testing
Automated Testing vs Manual TestingAutomated Testing vs Manual Testing
Automated Testing vs Manual Testing
Directi Group
?
Software Process Models
Software Process ModelsSoftware Process Models
Software Process Models
Ahmed Alageed
?
Introduction To Mobile-Automation
Introduction To Mobile-AutomationIntroduction To Mobile-Automation
Introduction To Mobile-Automation
Mindfire Solutions
?
Interview questions
Interview questionsInterview questions
Interview questions
sivareddyeda
?
Appium ppt
Appium pptAppium ppt
Appium ppt
natashasweety7
?
MIPI DevCon 2021: MIPI I3C Signal Integrity Challenges on DDR5-based Server P...
MIPI DevCon 2021: MIPI I3C Signal Integrity Challenges on DDR5-based Server P...MIPI DevCon 2021: MIPI I3C Signal Integrity Challenges on DDR5-based Server P...
MIPI DevCon 2021: MIPI I3C Signal Integrity Challenges on DDR5-based Server P...
MIPI Alliance
?
API Test Automation Tips and Tricks
API Test Automation Tips and TricksAPI Test Automation Tips and Tricks
API Test Automation Tips and Tricks
testhive
?
Types of testing
Types of testingTypes of testing
Types of testing
Sonam Agarwal
?
Android Web app
Android Web app Android Web app
Android Web app
Sumit Kumar
?
Valida??o e Testes de softwareValida??o e Testes de software
Valida??o e Testes de software
Rondinelli Mesquita
?
Shift left
Shift leftShift left
Shift left
penetration Tester
?
Mobile Application Testing Training Presentation
Mobile Application Testing Training PresentationMobile Application Testing Training Presentation
Mobile Application Testing Training Presentation
MobiGnosis
?
functional testing
functional testing functional testing
functional testing
bharathanche
?
Software Testing Basic Concepts
Software Testing Basic ConceptsSoftware Testing Basic Concepts
Software Testing Basic Concepts
wesovi
?
Performance and load testing
Performance and load testingPerformance and load testing
Performance and load testing
sonukalpana
?
Android testing
Android testingAndroid testing
Android testing
JinaTm
?
TDC2015: Testes em APIs REST com Rest-AssuredTDC2015: Testes em APIs REST com Rest-Assured
TDC2015: Testes em APIs REST com Rest-Assured
Jlio de Lima
?
Appium: Automation for Mobile Apps
Appium: Automation for Mobile AppsAppium: Automation for Mobile Apps
Appium: Automation for Mobile Apps
Sauce Labs
?
Getting started with appium
Getting started with appiumGetting started with appium
Getting started with appium
Pratik Patel
?
Automated Testing vs Manual Testing
Automated Testing vs Manual TestingAutomated Testing vs Manual Testing
Automated Testing vs Manual Testing
Directi Group
?
Software Process Models
Software Process ModelsSoftware Process Models
Software Process Models
Ahmed Alageed
?
Introduction To Mobile-Automation
Introduction To Mobile-AutomationIntroduction To Mobile-Automation
Introduction To Mobile-Automation
Mindfire Solutions
?
MIPI DevCon 2021: MIPI I3C Signal Integrity Challenges on DDR5-based Server P...
MIPI DevCon 2021: MIPI I3C Signal Integrity Challenges on DDR5-based Server P...MIPI DevCon 2021: MIPI I3C Signal Integrity Challenges on DDR5-based Server P...
MIPI DevCon 2021: MIPI I3C Signal Integrity Challenges on DDR5-based Server P...
MIPI Alliance
?
API Test Automation Tips and Tricks
API Test Automation Tips and TricksAPI Test Automation Tips and Tricks
API Test Automation Tips and Tricks
testhive
?
Valida??o e Testes de softwareValida??o e Testes de software
Valida??o e Testes de software
Rondinelli Mesquita
?
Mobile Application Testing Training Presentation
Mobile Application Testing Training PresentationMobile Application Testing Training Presentation
Mobile Application Testing Training Presentation
MobiGnosis
?

Viewers also liked (12)

Practical Sikuli: using screenshots for GUI automation and testing
Practical Sikuli: using screenshots for GUI automation and testingPractical Sikuli: using screenshots for GUI automation and testing
Practical Sikuli: using screenshots for GUI automation and testing
vgod
?
Sikuli
SikuliSikuli
Sikuli
SATISH GORRIPOTU
?
Monkey talk
Monkey talkMonkey talk
Monkey talk
ISsoft
?
Automating Firefox OS
Automating Firefox OSAutomating Firefox OS
Automating Firefox OS
mobiletestsummit
?
Trabalho sobre a ISO/IEC 15504Trabalho sobre a ISO/IEC 15504
Trabalho sobre a ISO/IEC 15504
Ricardo Zalla
?
Sikuli Test Automation - How to do it?
Sikuli Test Automation - How to do it?Sikuli Test Automation - How to do it?
Sikuli Test Automation - How to do it?
Mykhailo Poliarush
?
ISO 15504ISO 15504
ISO 15504
Marcelo Ramos
?
How to configure monkey talk android agent
How to configure monkey talk android agentHow to configure monkey talk android agent
How to configure monkey talk android agent
Dasun Eranthika
?
MonkeyTalk Documentation
MonkeyTalk DocumentationMonkeyTalk Documentation
MonkeyTalk Documentation
Vivek Pansara
?
iOS Automated Testing with Calabash: Tips and Tricks
iOS Automated Testing with Calabash: Tips and TricksiOS Automated Testing with Calabash: Tips and Tricks
iOS Automated Testing with Calabash: Tips and Tricks
mobiletestsummit
?
Monkey talk
Monkey talkMonkey talk
Monkey talk
Khizra Sammad
?
MonkeyTalk Automation Testing For Android Application
MonkeyTalk Automation Testing For Android ApplicationMonkeyTalk Automation Testing For Android Application
MonkeyTalk Automation Testing For Android Application
ContusQA
?
Practical Sikuli: using screenshots for GUI automation and testing
Practical Sikuli: using screenshots for GUI automation and testingPractical Sikuli: using screenshots for GUI automation and testing
Practical Sikuli: using screenshots for GUI automation and testing
vgod
?
Monkey talk
Monkey talkMonkey talk
Monkey talk
ISsoft
?
Trabalho sobre a ISO/IEC 15504Trabalho sobre a ISO/IEC 15504
Trabalho sobre a ISO/IEC 15504
Ricardo Zalla
?
Sikuli Test Automation - How to do it?
Sikuli Test Automation - How to do it?Sikuli Test Automation - How to do it?
Sikuli Test Automation - How to do it?
Mykhailo Poliarush
?
ISO 15504ISO 15504
ISO 15504
Marcelo Ramos
?
How to configure monkey talk android agent
How to configure monkey talk android agentHow to configure monkey talk android agent
How to configure monkey talk android agent
Dasun Eranthika
?
MonkeyTalk Documentation
MonkeyTalk DocumentationMonkeyTalk Documentation
MonkeyTalk Documentation
Vivek Pansara
?
iOS Automated Testing with Calabash: Tips and Tricks
iOS Automated Testing with Calabash: Tips and TricksiOS Automated Testing with Calabash: Tips and Tricks
iOS Automated Testing with Calabash: Tips and Tricks
mobiletestsummit
?
MonkeyTalk Automation Testing For Android Application
MonkeyTalk Automation Testing For Android ApplicationMonkeyTalk Automation Testing For Android Application
MonkeyTalk Automation Testing For Android Application
ContusQA
?

Similar to Sikuli for Mobile Testing (20)

Fundamentals of testing 1
Fundamentals of testing 1Fundamentals of testing 1
Fundamentals of testing 1
Hoang Nguyen
?
Gl istqb testing fundamentals
Gl istqb testing fundamentalsGl istqb testing fundamentals
Gl istqb testing fundamentals
Pragya Rastogi
?
Android testing
Android testingAndroid testing
Android testing
Igor Filippov
?
Automated UI Testing for Web and Native Apps on iOS and Android
Automated UI Testing for  Web and Native Apps on iOS and AndroidAutomated UI Testing for  Web and Native Apps on iOS and Android
Automated UI Testing for Web and Native Apps on iOS and Android
Operation Mobile
?
Unit Testing Guidelines
Unit Testing GuidelinesUnit Testing Guidelines
Unit Testing Guidelines
Joel Hooks
?
Improving developer tester collaboration with microsoft visual studio 2010
Improving developer tester collaboration with microsoft visual studio 2010Improving developer tester collaboration with microsoft visual studio 2010
Improving developer tester collaboration with microsoft visual studio 2010
Mohamed Samy
?
Quality Assurance - The Other Side of the Fence
Quality Assurance - The Other Side of the FenceQuality Assurance - The Other Side of the Fence
Quality Assurance - The Other Side of the Fence
Tom Oketch
?
Seven Steps to Remove Barriers and Accelerate Mobile Testing
Seven Steps to Remove Barriers and Accelerate Mobile TestingSeven Steps to Remove Barriers and Accelerate Mobile Testing
Seven Steps to Remove Barriers and Accelerate Mobile Testing
Keynote Mobile Testing
?
Mobile App Testing ScanAgile 2012
Mobile App Testing ScanAgile 2012Mobile App Testing ScanAgile 2012
Mobile App Testing ScanAgile 2012
Daniel Knott
?
"Software Quality in the Service of Innovation in the Insurance Industry"
"Software Quality in the Service of Innovation in the Insurance Industry""Software Quality in the Service of Innovation in the Insurance Industry"
"Software Quality in the Service of Innovation in the Insurance Industry"
Applitools
?
Understanding Unit Testing
Understanding Unit TestingUnderstanding Unit Testing
Understanding Unit Testing
ikhwanhayat
?
Continuous Integration
Continuous  IntegrationContinuous  Integration
Continuous Integration
Liyao Chen
?
Building 5 star apps with Xamarin Test Cloud at Techorama 2017
Building 5 star apps with Xamarin Test Cloud at Techorama 2017Building 5 star apps with Xamarin Test Cloud at Techorama 2017
Building 5 star apps with Xamarin Test Cloud at Techorama 2017
Gerald Versluis
?
Unit Testing
Unit TestingUnit Testing
Unit Testing
Gian Maria Ricci
?
Automated Testing with Logic Apps and Specflow
Automated Testing with Logic Apps and SpecflowAutomated Testing with Logic Apps and Specflow
Automated Testing with Logic Apps and Specflow
BizTalk360
?
Functional Testing in Java
Functional Testing in JavaFunctional Testing in Java
Functional Testing in Java
?
Unit Testing Guide. Helps to understand the basics of unit testing .
Unit Testing Guide. Helps to understand the basics of unit testing .Unit Testing Guide. Helps to understand the basics of unit testing .
Unit Testing Guide. Helps to understand the basics of unit testing .
shradha339475334115
?
Automated Application Testing
Automated Application TestingAutomated Application Testing
Automated Application Testing
Codal
?
Unit Test Lab - Why Write Unit Tests?
Unit Test Lab - Why Write Unit Tests?Unit Test Lab - Why Write Unit Tests?
Unit Test Lab - Why Write Unit Tests?
Danny van Kasteel
?
Agile principles and practices
Agile principles and practicesAgile principles and practices
Agile principles and practices
Vipin Jose
?
Fundamentals of testing 1
Fundamentals of testing 1Fundamentals of testing 1
Fundamentals of testing 1
Hoang Nguyen
?
Gl istqb testing fundamentals
Gl istqb testing fundamentalsGl istqb testing fundamentals
Gl istqb testing fundamentals
Pragya Rastogi
?
Automated UI Testing for Web and Native Apps on iOS and Android
Automated UI Testing for  Web and Native Apps on iOS and AndroidAutomated UI Testing for  Web and Native Apps on iOS and Android
Automated UI Testing for Web and Native Apps on iOS and Android
Operation Mobile
?
Unit Testing Guidelines
Unit Testing GuidelinesUnit Testing Guidelines
Unit Testing Guidelines
Joel Hooks
?
Improving developer tester collaboration with microsoft visual studio 2010
Improving developer tester collaboration with microsoft visual studio 2010Improving developer tester collaboration with microsoft visual studio 2010
Improving developer tester collaboration with microsoft visual studio 2010
Mohamed Samy
?
Quality Assurance - The Other Side of the Fence
Quality Assurance - The Other Side of the FenceQuality Assurance - The Other Side of the Fence
Quality Assurance - The Other Side of the Fence
Tom Oketch
?
Seven Steps to Remove Barriers and Accelerate Mobile Testing
Seven Steps to Remove Barriers and Accelerate Mobile TestingSeven Steps to Remove Barriers and Accelerate Mobile Testing
Seven Steps to Remove Barriers and Accelerate Mobile Testing
Keynote Mobile Testing
?
Mobile App Testing ScanAgile 2012
Mobile App Testing ScanAgile 2012Mobile App Testing ScanAgile 2012
Mobile App Testing ScanAgile 2012
Daniel Knott
?
"Software Quality in the Service of Innovation in the Insurance Industry"
"Software Quality in the Service of Innovation in the Insurance Industry""Software Quality in the Service of Innovation in the Insurance Industry"
"Software Quality in the Service of Innovation in the Insurance Industry"
Applitools
?
Understanding Unit Testing
Understanding Unit TestingUnderstanding Unit Testing
Understanding Unit Testing
ikhwanhayat
?
Continuous Integration
Continuous  IntegrationContinuous  Integration
Continuous Integration
Liyao Chen
?
Building 5 star apps with Xamarin Test Cloud at Techorama 2017
Building 5 star apps with Xamarin Test Cloud at Techorama 2017Building 5 star apps with Xamarin Test Cloud at Techorama 2017
Building 5 star apps with Xamarin Test Cloud at Techorama 2017
Gerald Versluis
?
Automated Testing with Logic Apps and Specflow
Automated Testing with Logic Apps and SpecflowAutomated Testing with Logic Apps and Specflow
Automated Testing with Logic Apps and Specflow
BizTalk360
?
Functional Testing in Java
Functional Testing in JavaFunctional Testing in Java
Functional Testing in Java
?
Unit Testing Guide. Helps to understand the basics of unit testing .
Unit Testing Guide. Helps to understand the basics of unit testing .Unit Testing Guide. Helps to understand the basics of unit testing .
Unit Testing Guide. Helps to understand the basics of unit testing .
shradha339475334115
?
Automated Application Testing
Automated Application TestingAutomated Application Testing
Automated Application Testing
Codal
?
Unit Test Lab - Why Write Unit Tests?
Unit Test Lab - Why Write Unit Tests?Unit Test Lab - Why Write Unit Tests?
Unit Test Lab - Why Write Unit Tests?
Danny van Kasteel
?
Agile principles and practices
Agile principles and practicesAgile principles and practices
Agile principles and practices
Vipin Jose
?

Sikuli for Mobile Testing

Editor's Notes

  • #46: GUI testing is hard to automate because it is about user experienceAbout interacivtyAbout what users doAbout what they see
  • #47: GUI testing is hard to automate because it is about user experienceAbout interacivtyAbout what users doAbout what they see