ºÝºÝߣshows by User: xiaoxinghu / http://www.slideshare.net/images/logo.gif ºÝºÝߣshows by User: xiaoxinghu / Tue, 15 Sep 2015 06:28:42 GMT ºÝºÝߣShare feed for ºÝºÝߣshows by User: xiaoxinghu Making Your Results Visible - A Test Result Dashboard and Comparison Tool /slideshow/making-your-results-visible-a-test-result-dashboard-and-comparison-tool/52786000 seleniumconferencelite-150915062842-lva1-app6891
If a test fails in the woods and nobody’s there to see it does anyone care, does anyone even notice? What happens when failing tests become the norm and you can’t see the wood from the trees? After watching last year’s Allure Report presentation I was inspired. Selenium tests (and automation tests in general) are often poorly understood by the team as a whole. Reports/emails go unread with tests failing becoming an expected outcome rather than a glaring red flag. We looked at what Allure brought to the table and from that base created a dashboard that was designed to: Display the results of test runs in a way that was useful to managers, testers and the rest of the development team. Including tools to filter out specific test runs and view the overall trend of the test run results. Make debugging tests easier by grouping errors, displaying history of test results, filtering tests and offering visual comparison of test runs. Help mitigate the problems flaky tests cause with test run result reporting (say that three times fast). Help with our mobile device certification process, by easily providing a view to compare test runs across devices. Since its creation the dashboard has been used and praised by managers and developers alike. With our full suite of tests from unit to integration to selenium and Appium being stored on the dashboard. We’ve managed to: Decrease the time taken to debug test cases. Increase the visibility of all our test suites, with managers having a better idea of how our selenium test suite is progressing and testers better understanding the coverage of unit tests. Focus the organization on quality. We are working with legal at present to have this project open sourced and available to all prior to Selenium Conf 2015.]]>
If a test fails in the woods and nobody’s there to see it does anyone care, does anyone even notice? What happens when failing tests become the norm and you can’t see the wood from the trees? After watching last year’s Allure Report presentation I was inspired. Selenium tests (and automation tests in general) are often poorly understood by the team as a whole. Reports/emails go unread with tests failing becoming an expected outcome rather than a glaring red flag. We looked at what Allure brought to the table and from that base created a dashboard that was designed to: Display the results of test runs in a way that was useful to managers, testers and the rest of the development team. Including tools to filter out specific test runs and view the overall trend of the test run results. Make debugging tests easier by grouping errors, displaying history of test results, filtering tests and offering visual comparison of test runs. Help mitigate the problems flaky tests cause with test run result reporting (say that three times fast). Help with our mobile device certification process, by easily providing a view to compare test runs across devices. Since its creation the dashboard has been used and praised by managers and developers alike. With our full suite of tests from unit to integration to selenium and Appium being stored on the dashboard. We’ve managed to: Decrease the time taken to debug test cases. Increase the visibility of all our test suites, with managers having a better idea of how our selenium test suite is progressing and testers better understanding the coverage of unit tests. Focus the organization on quality. We are working with legal at present to have this project open sourced and available to all prior to Selenium Conf 2015.]]> Tue, 15 Sep 2015 06:28:42 GMT /slideshow/making-your-results-visible-a-test-result-dashboard-and-comparison-tool/52786000 xiaoxinghu@slideshare.net(xiaoxinghu) Making Your Results Visible - A Test Result Dashboard and Comparison Tool xiaoxinghu If a test fails in the woods and nobody’s there to see it does anyone care, does anyone even notice? What happens when failing tests become the norm and you can’t see the wood from the trees? After watching last year’s Allure Report presentation I was inspired. Selenium tests (and automation tests in general) are often poorly understood by the team as a whole. Reports/emails go unread with tests failing becoming an expected outcome rather than a glaring red flag. We looked at what Allure brought to the table and from that base created a dashboard that was designed to: Display the results of test runs in a way that was useful to managers, testers and the rest of the development team. Including tools to filter out specific test runs and view the overall trend of the test run results. Make debugging tests easier by grouping errors, displaying history of test results, filtering tests and offering visual comparison of test runs. Help mitigate the problems flaky tests cause with test run result reporting (say that three times fast). Help with our mobile device certification process, by easily providing a view to compare test runs across devices. Since its creation the dashboard has been used and praised by managers and developers alike. With our full suite of tests from unit to integration to selenium and Appium being stored on the dashboard. We’ve managed to: Decrease the time taken to debug test cases. Increase the visibility of all our test suites, with managers having a better idea of how our selenium test suite is progressing and testers better understanding the coverage of unit tests. Focus the organization on quality. We are working with legal at present to have this project open sourced and available to all prior to Selenium Conf 2015. <img style="border:1px solid #C3E6D8;float:right;" alt="" src="https://cdn.slidesharecdn.com/ss_thumbnails/seleniumconferencelite-150915062842-lva1-app6891-thumbnail.jpg?width=120&amp;height=120&amp;fit=bounds" /><br> If a test fails in the woods and nobody’s there to see it does anyone care, does anyone even notice? What happens when failing tests become the norm and you can’t see the wood from the trees? After watching last year’s Allure Report presentation I was inspired. Selenium tests (and automation tests in general) are often poorly understood by the team as a whole. Reports/emails go unread with tests failing becoming an expected outcome rather than a glaring red flag. We looked at what Allure brought to the table and from that base created a dashboard that was designed to: Display the results of test runs in a way that was useful to managers, testers and the rest of the development team. Including tools to filter out specific test runs and view the overall trend of the test run results. Make debugging tests easier by grouping errors, displaying history of test results, filtering tests and offering visual comparison of test runs. Help mitigate the problems flaky tests cause with test run result reporting (say that three times fast). Help with our mobile device certification process, by easily providing a view to compare test runs across devices. Since its creation the dashboard has been used and praised by managers and developers alike. With our full suite of tests from unit to integration to selenium and Appium being stored on the dashboard. We’ve managed to: Decrease the time taken to debug test cases. Increase the visibility of all our test suites, with managers having a better idea of how our selenium test suite is progressing and testers better understanding the coverage of unit tests. Focus the organization on quality. We are working with legal at present to have this project open sourced and available to all prior to Selenium Conf 2015.
Making Your Results Visible - A Test Result Dashboard and Comparison Tool from Xiaoxing Hu
]]> 9307 16 https://cdn.slidesharecdn.com/ss_thumbnails/seleniumconferencelite-150915062842-lva1-app6891-thumbnail.jpg?width=120&height=120&fit=bounds presentation Black http://activitystrea.ms/schema/1.0/post http://activitystrea.ms/schema/1.0/posted 0 https://cdn.slidesharecdn.com/profile-photo-xiaoxinghu-48x48.jpg?cb=1523454057 Toolsmith, automation enthusiast, programmer, scripter, gamer. Fanboy of Linux, Mac, Open Source, Ruby, Java, C#, python, javascript ... OK, cool programming languages. A father. http://huxiaoxing.com/