2. Agenda
Abstract
Key Business Challenges
Business Case 1
• Business Case 2
• Conclusion
2
3. Abstract
3
Business todays demands a customized solutions to verify/certify the quality of the product within a
shorter time. Traditional approach of test automation and tool selection might not be applicable for all
business needs.
The need of the hour is to build a customized , integrated automation solutions align with business
requirement. The traditional test automation approach(UI Level Automation) is lagging in key aspects
of delivering product/software fast and reduce the testing time.
Understanding of the business needs of applications and a customized automation process would
help to reduce the testing cost , deliver on time and unearthed the business critical defects.
4. 4
Only 30%
Coverage is
achieved even
though ~400 TC
are automated
Frequent P1
Production
Defects even
tough automation
is done for UI
Our Automation
solutions is not
scalable to
improve the
coverage beyond
the UI
Key Business Challenges
5. Business Case 1
5
UI rich application contains the images , dynamic UI and application accessibility of application in multiple device ,
browsers is critical business needs.
Q’s to determine Automation Solutions
Q1) Is usability/accessibility testing of application UI is critical business needs -- YES
Q2) Is testing of the application in various devices and OS combination is critical -- YES
Q3) Is validation of UI covers the more than 70% business scenarios. -- YES
In above scenario traditional approach for UI automation using tools like Selenium , Appium , Protractor ,
UFT is sufficient and robust automation framework for UI layer automation works.
6. Business Case 2
6
Complex Application involves large EDW, ETL jobs and data verification. The presentation layer is a web based
application which provides the filtered information from various DW via a Web Services.
Q’s to determine Automation Solutions
Q1) Are the majority of defects are due to data gap/mismatch from Data mart to UI layer -- YES
Q2) Is validation of UI covers the more than 70% business scenarios -- NO
Q3) Is validation of xml files flowing to external system is critical for business need -- YES
In above scenario traditional approach for UI automation using tools like Selenium , Protractor , UFT is
NOT sufficient and we have to develop the integrated automation solutions by various tools covering the
ETL/DW Data and UI layer.
7. POV Integrated Automation Solutions for Business Case2
7
Prod JSON Data Test Data
Distributed/ParallelExecutionResultReporting
Config.JS
DevITUAT
Page Object Classes.js Page Object Locators.js
ProdData
Jobs/Interface to
Extract Reports/BI
Data into JSON
Validate
Data
ValidateUI
UI Automation Framework/Solutions
CustomizedAutomationSolutionstoimprovetheTest
Coverage
8. Conclusion
8
The traditional automation approach targeting mainly UI for the application involves multiple
layer , data , external interface , only covers 30% of business scenarios , to improve the
coverage and drive the automation solution/ framework a comprehensive study of application
business need is required.
9. Case Study : Customized/Integrated Automation Testing Solutions
Major Manufacturing Client of US.– Update with more concrete data points for
challenges
9
Client Challenges
To reduce regression Test execution time and improve a coverage for one
of the major release.
Reduce Turn around time between Development and testing.
Complete e2e testing of the application involving multiple layers ( Services
, DB, UI)
Reduce the UAT testing cycle.
Infosys Solution
• Integrated e2e automation solutions is developed by integrating the
multiple tools ( Selenium , SOPUI , DB SQL Queries)
• Automation is done for all layers of applications ( UI , Services , DB)
Value adds
Single click automation benefits
After integrated UI , DB and Services validation solution 3 production defects were identified if not found would have led to financial loss of ~
300K USD
Automated regression coverage increased to 75% for UI and 95% with minimal scripting using the integrated automation framework.
These automation scripts are used for build sanity testing for every build as well as regression testing for every release
Has saved more than 60% of manual effort for validating thousands of rules through UI and Services