Test automation architecture. Advanced level

•Als PPTX, PDF herunterladen•

1 gefällt mir•443 views

The idea is to show more complex test automation architecture which goes beyond the ordinary arrange->act->assert or set-up->run tests->tear-down workflow.

Technologie

Test automation architecture.
Advanced level
Anton Skomarovskyi
22 February, 2019

Anton Skomarovskyi
Engineer with more than 6 years in IT
• Senior QA Automation Engineer at CloudMade
• www.linkedin.com/in/anton-skomarovskyi
• Was working at:

Agenda
• Warming up. Good & Bad examples
• CloudMade product presentation and setting test requirements
• Introduction into MapReduce Jobs’ topic
• Test Automation Framework and its architecture
• Results and plans for future
• Q&A

Integration tests
How should NOT be done
Example #1

Example #2
Set up
Prerequisite works
to be done
Act
Source of testing
Tests
Running test cases
REST API

CloudMade
connects the dots on every human journey

Distributed Computing
• Hadoop MapReduce
• Apache Spark

val mySeq: Seq[Int] = 1 .. 99
val mySeq_1 =
1 .. 33
val mySeq_3 =
67 .. 99
val mySeq_2 = 34 .. 66
Example

val result: Int = 4950
561
1650
2739
val mySeq_1 =
1 .. 33
val mySeq_3 =
67 .. 99
val mySeq_2 = 34 .. 66
Example

Test requirements
• Test MR Jobs’ logic
• Test REST APIs
• Run MR jobs
• Import test dumps to DB

Simple solution
• All in one. Tests are responsible for:
1. Import test dumps to DB
2. Run MR jobs
3. Test MR Jobs’ logic

Not clear what time it is
Test run ? MR Job run ? Import dump to DB ?

Solution problems:
• No transparency in understanding what is
currently running
• Hard to understand what is failed
• No opportunity to see the trends of different
component runs in the past

Updated requirements
• Modularity (Jenkins Pipeline via Steps)
1. Test MR Jobs’ logic
2. Test REST APIs
3. Run MR jobs
4. Import test dumps to DB
• Configurable run via Steps

How to run the solution?
$ java -jar app.jar --help

Transparenc
y
Modular solution
Configurable
Via Steps
Flexible
To Change

Weitere ähnliche Inhalte

Was ist angesagt?

AWS Lambda Function with KotlinTroy Miles

The dev ops code has no serversEd Anderson

DevCon-Shikhar SlidesShikhar Kapoor

Building serverless-applicationsAndrii Soldatenko

2020-Feb: Testing: Cables and ChainsMark Windholtz

From Streams to Reactive StreamsOleg Tsal-Tsalko

Testing Testing everywhereAntonio Robres Turon

Automated Testing of Web Applicationsjonatankronqvist

Ocassionally connected devices spark finalChris Ballance

Postman: An Introduction for DevelopersPostman

Expanding Your .NET Testing Toolbox - GLUG NETMatt Eland

Generating unit tests based on user logsRick Wicker

State of the art loggingMilan Vukoje

Accelerate Quality with Postman - BasicsKnoldus Inc.

Andreas Grabner - Performance as Code, Let's Make It a StandardNeotys_Partner

Serverless testing-serverless-sydney-20181018Rowan Udell

Tatftjoren de groof

Advantages of Rails FrameworkSathish Mariappan

Advanced API DebuggingPostman

Fast end-to-end-testsRikke Veng Petersen

Was ist angesagt? (20)

AWS Lambda Function with Kotlin

The dev ops code has no servers

DevCon-Shikhar Slides

Building serverless-applications

2020-Feb: Testing: Cables and Chains

From Streams to Reactive Streams

Testing Testing everywhere

Automated Testing of Web Applications

Ocassionally connected devices spark final

Postman: An Introduction for Developers

Expanding Your .NET Testing Toolbox - GLUG NET

Generating unit tests based on user logs

State of the art logging

Accelerate Quality with Postman - Basics

Andreas Grabner - Performance as Code, Let's Make It a Standard

Serverless testing-serverless-sydney-20181018

Tatft

Advantages of Rails Framework

Advanced API Debugging

Fast end-to-end-tests

Ähnlich wie Test automation architecture. Advanced level

MEAN Stack WeNode Barcelona WorkshopValeri Karpov

Testing for Logic App Solutions | Integration MondayBizTalk360

Udvid din test portefølje med coded ui test og cloud load testPeter Lindberg

Test automation proposalMihai-Cristian Fratila

Effective .NET Core Unit Testing with SQLite and DapperMike Melusky

TallyJS #1 - Intro to AngularJSAndrew Hart

Effective .NET Core Unit Testing with SQLite and DapperMike Melusky

Get Testing with tSQLt - SQL In The City Workshop 2014Red Gate Software

Dot Net Notts Js Unit Testing at MicroliseJonathan Gregory

Js unit testingpresentationJonathan Gregory

[DPE Summit] How Improving the Testing Experience Goes Beyond Quality: A Deve...Roberto Pérez Alcolea

Improving Batch-Process Testing Techniques with a Domain-Specific LanguageDr. Spock

Lessons Learned Replatforming A Large Machine Learning Application To Apache ...Databricks

With Automated ML, is Everyone an ML Engineer?Dan Sullivan, Ph.D.

Functional Testing of RESTful ApplicationsNenad Bozic

Mobile TestingSriram Angajala

Shyam pcfshyam kumar

Migration from Oracle to PostgreSQL: NEED vs REALITYAshnikbiz

Mixing d ps building architecture on the cross cutting examplecorehard_by

20211202 NADOG Adapting to Covid with Serverless Craeg Strong Ariel PartnersCraeg Strong

Ähnlich wie Test automation architecture. Advanced level (20)

MEAN Stack WeNode Barcelona Workshop

Testing for Logic App Solutions | Integration Monday

Udvid din test portefølje med coded ui test og cloud load test

Test automation proposal

Effective .NET Core Unit Testing with SQLite and Dapper

TallyJS #1 - Intro to AngularJS

Effective .NET Core Unit Testing with SQLite and Dapper

Get Testing with tSQLt - SQL In The City Workshop 2014

Dot Net Notts Js Unit Testing at Microlise

Js unit testingpresentation

[DPE Summit] How Improving the Testing Experience Goes Beyond Quality: A Deve...

Improving Batch-Process Testing Techniques with a Domain-Specific Language

Lessons Learned Replatforming A Large Machine Learning Application To Apache ...

With Automated ML, is Everyone an ML Engineer?

Functional Testing of RESTful Applications

Mobile Testing

Shyam pcf

Migration from Oracle to PostgreSQL: NEED vs REALITY

Mixing d ps building architecture on the cross cutting example

20211202 NADOG Adapting to Covid with Serverless Craeg Strong Ariel Partners

Kürzlich hochgeladen

A Call to Action for Generative AI in 2024Results

Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun

Real Time Object Detection Using Open CVKhem

Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia

What Are The Drone Anti-jamming Systems Technology?Antenna Manufacturer Coco

A Year of the Servo Reboot: Where Are We Now?Igalia

04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG

Tata AIG General Insurance Company - Insurer Innovation Award 2024The Digital Insurer

Factors to Consider When Choosing Accounts Payable Services Providers.pptxKatpro Technologies

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...Neo4j

Driving Behavioral Change for Information Management through Data-Driven Gree...Enterprise Knowledge

Advantages of Hiring UIUX Design Service Providers for Your BusinessPixlogix Infotech

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays

The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad

Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUK Journal

Axa Assurance Maroc - Insurer Innovation Award 2024The Digital Insurer

Boost PC performance: How more available memory can improve productivityPrincipled Technologies

A Domino Admins Adventures (Engage 2024)Gabriella Davis

Slack Application Development 101 Slidespraypatel2

Histor y of HAM Radio presentation slidevu2urc

Kürzlich hochgeladen (20)

A Call to Action for Generative AI in 2024

Data Cloud, More than a CDP by Matt Robison

Real Time Object Detection Using Open CV

Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...

What Are The Drone Anti-jamming Systems Technology?

A Year of the Servo Reboot: Where Are We Now?

04-2024-HHUG-Sales-and-Marketing-Alignment.pptx

Tata AIG General Insurance Company - Insurer Innovation Award 2024

Factors to Consider When Choosing Accounts Payable Services Providers.pptx

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...

Driving Behavioral Change for Information Management through Data-Driven Gree...

Advantages of Hiring UIUX Design Service Providers for Your Business

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...

The Codex of Business Writing Software for Real-World Solutions 2.pptx

Understanding Discord NSFW Servers A Guide for Responsible Users.pdf

Axa Assurance Maroc - Insurer Innovation Award 2024

Boost PC performance: How more available memory can improve productivity

A Domino Admins Adventures (Engage 2024)

Slack Application Development 101 Slides

Histor y of HAM Radio presentation slide

Test automation architecture. Advanced level

1. Test automation architecture. Advanced level Anton Skomarovskyi 22 February, 2019

2. Anton Skomarovskyi Engineer with more than 6 years in IT • Senior QA Automation Engineer at CloudMade • www.linkedin.com/in/anton-skomarovskyi • Was working at:

3. Agenda • Warming up. Good & Bad examples • CloudMade product presentation and setting test requirements • Introduction into MapReduce Jobs’ topic • Test Automation Framework and its architecture • Results and plans for future • Q&A

4. Integration tests How should NOT be done Example #1

6. Let’s make it better

8. Example #2 Set up Prerequisite works to be done Act Source of testing Tests Running test cases REST API

10. CloudMade connects the dots on every human journey

11. Smart Onboarding Personalized Autonomy Predictive Navigation Personalized Search Predictive Call List Personalized Coaching Intelligent Cabin Intelligent Climate Refueling and Recharging One Driver Profile Many Use Cases Personalized Parking Options Predictive Drive Mode Predictive Media Predictive Occupant ID

12. Distributed Computing • Hadoop MapReduce • Apache Spark

13. val mySeq: Seq[Int] = 1 .. 99 val mySeq_1 = 1 .. 33 val mySeq_3 = 67 .. 99 val mySeq_2 = 34 .. 66 Example

14. val result: Int = 4950 561 1650 2739 val mySeq_1 = 1 .. 33 val mySeq_3 = 67 .. 99 val mySeq_2 = 34 .. 66 Example

15. Server-side architecture

16. Client SDK HBase Events 2. MR Job Extract Journey Journeys 3. MR Jobs Inderence Engine PosgreSQL Inferences Users Predictions 4. API Fetch new Profile 1. Upload Data Raw events

17. Test requirements • Test MR Jobs’ logic • Test REST APIs • Run MR jobs • Import test dumps to DB

18. The First attempt

19. Simple solution • All in one. Tests are responsible for: 1. Import test dumps to DB 2. Run MR jobs 3. Test MR Jobs’ logic

20. What’s Jenkins Pipeline?

21. Steps: Jenkins Pipeline 1 2 3 4 5

22. What’s the Problem ?

23. Tons of logs

24. Not clear what time it is Test run ? MR Job run ? Import dump to DB ?

25. Solution problems: • No transparency in understanding what is currently running • Hard to understand what is failed • No opportunity to see the trends of different component runs in the past

26. Wait… How about making Revisions?

27. Modularity

28. Updated requirements • Modularity (Jenkins Pipeline via Steps) 1. Test MR Jobs’ logic 2. Test REST APIs 3. Run MR jobs 4. Import test dumps to DB • Configurable run via Steps

29. Let’s make the Second attempt

30. Use case

31. Architecture solution

32.

33. Files hierarchy

34. Director [Entry point]

35. How to run the solution? $ java -jar app.jar --help

36. Jenkins’ pipeline [code]

37. Transparency Jenkins’ pipeline

38. Conclusion

39. Transparenc y Modular solution Configurable Via Steps Flexible To Change

40. Anton.Skomarovskyi@gmail.com Thank you!