Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
WHAT DOES IT MEANTO BE
ATEST ENGINEER?
Andrii Dzynia
http://bit.ly/1GYquoR
MY BACKGROUND
• 8 years in software engineering
• started as a test engineer in a team of 20 testers
• currently working o...
SATURDAY EVENING
https://twitter.com/mfloryan/status/655433887015948288
LET ME SHOWYOUTHE PROCESS
video: https://www.dropbox.com/s/un7m49kdgeuzsbz/test-session-
andrii.mov?dl=0
FOUND BUGS
MY COLLEAGUE,
FRONT-END DEVELOPER.
WHAT DID I LEARN?
• Software always has bugs. If
you have not found any, does
not disprove their existence
• Developers do...
WHAT I WANTEDYOUTO
LEARN?
Testing is not a set of artefacts.
TESTING IS A PROCESS.
@adzynia
TESTING PROCESS
GUESS WHAT BUG MARCIN
WAS REFERRINGTO?
MORE LESSONS LEARNED
• People are different. It is hard to predict every
single combination when user can get stuck
• Thin...
WHAT MAKESYOU ATEST
ENGINEER?
Critical thinking
Fault models
Patterns recognition
@adzynia
CRITICALTHINKING
https://www.criticalthinking.org/ctmodel/logic-model1.htm
FAULT MODELS
“From the model, the designer or user can predict
the consequences of a particular fault.” - Wikipedia
video:...
PATTERNS RECOGNITION
https://www.nasa.gov
BASED ON EXPERIENCE BRAIN RECOGNISES
SEQUENCES WHICH LEADSTO UNDESIRED
OUTCOME.
NOTE: BE CAREFUL WITH FAULTY ASSUMPTIONS.
...
LOOK FOR PATTERNS WITH
HIGH FAILURE RISK.
video: https://www.youtube.com/watch?v=qoQssWPRNR0
BRINGINGVIDEOTO SPOTIFY
USERS
http://techcrunch.com/2015/05/20/spotify-introduces-video-clips-
podcasts-and-activity-based...
TEAM SETUP
COMMUNICATION CAN BE A
PROBLEM
http://dilbert.com/strip/1989-05-31
SOLUTION WAS
Create a #slack channel
Start asking video integration questions
Rise bugs early and facilitate conversations
DID WE PREDICTED ALL DEFECTS BEFORETESTING?
SURELY, NOT.
Data collected by Stefan Rungardt
BUT HOW DIDTHAT HELP?
Integration ended up to be much easier
Testing started earlier
# of production issues was low
WASTHAT EASY?
Not really.You have
to ask questions
people do not want
to hear
http://media2.giphy.com/media/wrTHBbla7suPu/...
Tester: Shall video be playing when I lock a screen?
Programmer: I do not know.
Tester: who can know?
Programmer: Product ...
DEFECT PREVENTION
VS
DEFECT DETECTION
“Bugs are so 90s”
LEAN MANUFACTURING
https://en.wikipedia.org/wiki/Lean_manufacturing
KEEPYOU WORK ENVIRONMENT
IN A GOOD SHAPE
• engineering quality
• product quality
• strive for improvements
ENGINEERING QUALITY
• Start testing as early as possible
• Build safety nets
• Fix bugs as fast as they occur
• Conduct ro...
PRODUCT QUALITY
• Product success metrics
Time to first video frame
Number of users streaming video content
Average viewing...
SPOTIFYTEST CERTIFIED MODEL
Inspired by Google
https://mike-bland.com/2011/10/18/test-certified.html
TAKE AWAYS
• Testing is a process, not a set of artefacts
• Cost of defect can be lowered.Think about that
• Find ways to ...
THANKYOU!
@adzynia
andrii@adzynia.com
You’ve finished this document.
Download and read it offline.
Upcoming SlideShare
Exploring your unit tests
Next
Upcoming SlideShare
Exploring your unit tests
Next
Download to read offline and view in fullscreen.

Share

What does it mean to be a test engineer?

Download to read offline

Test engineering is hard, even harder than software development. Being test engineer puts you in a wider context, with no clear boundaries. You have to find those by yourself. This requires courage. Courage to take action, courage to make mistakes. As a test engineer, you do mistakes every day. You do them so often that sometimes you feel you can predict the future. Scientific explanation to this phenomena is patterns recognition. It is an ability of our brain to match the information from a stimulus with information retrieved from memory. Defect prevention is hard. Together with technical skills one have to develop high social awareness. Working on safety nets never was so important, different types of checks on different levels to make sure software is reliable and serves its purpose to the variety of everyday use-cases. We know that life is so complex and sometimes complicated which makes it impossible to predict all possible outcomes and scenarios. But striving for excellence never was so important as nowadays in such an open, transparent and competitive environment.

Goal of my talk will be to show you my everyday job as a test engineer. Not only how to look for defects, but how to prevent them from happening. Not only how to automate tests(noun), but how to build safety nets to minimize end-user impact. Not only how to inform testing status but how to influence quality on company level.

Related Books

Free with a 30 day trial from Scribd

See all

Related Audiobooks

Free with a 30 day trial from Scribd

See all

What does it mean to be a test engineer?

  1. 1. WHAT DOES IT MEANTO BE ATEST ENGINEER? Andrii Dzynia http://bit.ly/1GYquoR
  2. 2. MY BACKGROUND • 8 years in software engineering • started as a test engineer in a team of 20 testers • currently working on improving product quality and development productivity at Spotify https://www.linkedin.com/in/andriidzynia@adzynia
  3. 3. SATURDAY EVENING https://twitter.com/mfloryan/status/655433887015948288
  4. 4. LET ME SHOWYOUTHE PROCESS video: https://www.dropbox.com/s/un7m49kdgeuzsbz/test-session- andrii.mov?dl=0
  5. 5. FOUND BUGS
  6. 6. MY COLLEAGUE, FRONT-END DEVELOPER.
  7. 7. WHAT DID I LEARN? • Software always has bugs. If you have not found any, does not disprove their existence • Developers do not spend much time looking for edge cases, testers do
  8. 8. WHAT I WANTEDYOUTO LEARN? Testing is not a set of artefacts.
  9. 9. TESTING IS A PROCESS. @adzynia
  10. 10. TESTING PROCESS
  11. 11. GUESS WHAT BUG MARCIN WAS REFERRINGTO?
  12. 12. MORE LESSONS LEARNED • People are different. It is hard to predict every single combination when user can get stuck • Think slower, sometimes
  13. 13. WHAT MAKESYOU ATEST ENGINEER? Critical thinking Fault models Patterns recognition @adzynia
  14. 14. CRITICALTHINKING https://www.criticalthinking.org/ctmodel/logic-model1.htm
  15. 15. FAULT MODELS “From the model, the designer or user can predict the consequences of a particular fault.” - Wikipedia video: https://www.youtube.com/watch?v=rEumMkAhwzA
  16. 16. PATTERNS RECOGNITION https://www.nasa.gov
  17. 17. BASED ON EXPERIENCE BRAIN RECOGNISES SEQUENCES WHICH LEADSTO UNDESIRED OUTCOME. NOTE: BE CAREFUL WITH FAULTY ASSUMPTIONS. FACE ONTHE MOON SURFACE IS PAREIDOLIA. “Pareidolia is a psychological phenomenon when the mind perceives a familiar pattern of something where none actually exists.” - Wikipedia
  18. 18. LOOK FOR PATTERNS WITH HIGH FAILURE RISK. video: https://www.youtube.com/watch?v=qoQssWPRNR0
  19. 19. BRINGINGVIDEOTO SPOTIFY USERS http://techcrunch.com/2015/05/20/spotify-introduces-video-clips- podcasts-and-activity-based-playlists/
  20. 20. TEAM SETUP
  21. 21. COMMUNICATION CAN BE A PROBLEM http://dilbert.com/strip/1989-05-31
  22. 22. SOLUTION WAS Create a #slack channel Start asking video integration questions Rise bugs early and facilitate conversations
  23. 23. DID WE PREDICTED ALL DEFECTS BEFORETESTING? SURELY, NOT. Data collected by Stefan Rungardt
  24. 24. BUT HOW DIDTHAT HELP? Integration ended up to be much easier Testing started earlier # of production issues was low
  25. 25. WASTHAT EASY? Not really.You have to ask questions people do not want to hear http://media2.giphy.com/media/wrTHBbla7suPu/giphy.gif
  26. 26. Tester: Shall video be playing when I lock a screen? Programmer: I do not know. Tester: who can know? Programmer: Product manager? Product manager: I do not know. Tester: who can know? Product manager: let’s take a look howYoutube does it. After a while we figured why video has to be paused when you lock a screen. Licensing constraints.
  27. 27. DEFECT PREVENTION VS DEFECT DETECTION “Bugs are so 90s”
  28. 28. LEAN MANUFACTURING https://en.wikipedia.org/wiki/Lean_manufacturing
  29. 29. KEEPYOU WORK ENVIRONMENT IN A GOOD SHAPE • engineering quality • product quality • strive for improvements
  30. 30. ENGINEERING QUALITY • Start testing as early as possible • Build safety nets • Fix bugs as fast as they occur • Conduct root-cause analysis and take actions http://www.slideshare.net/AndrewDzynia/quality-built-in
  31. 31. PRODUCT QUALITY • Product success metrics Time to first video frame Number of users streaming video content Average viewing time, etc. • Number of production defects
  32. 32. SPOTIFYTEST CERTIFIED MODEL Inspired by Google https://mike-bland.com/2011/10/18/test-certified.html
  33. 33. TAKE AWAYS • Testing is a process, not a set of artefacts • Cost of defect can be lowered.Think about that • Find ways to influence quality on organization level. It is hard, but possible, even for a test engineer
  34. 34. THANKYOU! @adzynia andrii@adzynia.com
  • JeffersonMurdoch

    Aug. 31, 2021
  • HaliduAbdulkadiri

    Aug. 12, 2021
  • StanleyMuya

    Jun. 17, 2021
  • Vipuldev2

    May. 3, 2021
  • ManuAsta1

    Feb. 20, 2021
  • helloworldgr

    Jun. 24, 2020
  • davye

    Apr. 29, 2020
  • pejusdatta1

    Feb. 24, 2020
  • omaruriel

    Jan. 27, 2020
  • AmrutaJadhav24

    Aug. 18, 2019
  • LoganathanNamperumal

    Jul. 20, 2019
  • ikongG

    Apr. 13, 2019
  • NataliiaZaluska

    Mar. 20, 2019
  • Yusuf002

    Mar. 14, 2019
  • Ayiworohdaniel

    Jan. 7, 2019
  • Magarya1

    Aug. 1, 2018
  • StephaneDenis

    May. 14, 2018
  • RutwikWadkar

    Mar. 28, 2018
  • FabioAlmeida30

    Dec. 1, 2017
  • rodanthonypana

    Aug. 24, 2017

Test engineering is hard, even harder than software development. Being test engineer puts you in a wider context, with no clear boundaries. You have to find those by yourself. This requires courage. Courage to take action, courage to make mistakes. As a test engineer, you do mistakes every day. You do them so often that sometimes you feel you can predict the future. Scientific explanation to this phenomena is patterns recognition. It is an ability of our brain to match the information from a stimulus with information retrieved from memory. Defect prevention is hard. Together with technical skills one have to develop high social awareness. Working on safety nets never was so important, different types of checks on different levels to make sure software is reliable and serves its purpose to the variety of everyday use-cases. We know that life is so complex and sometimes complicated which makes it impossible to predict all possible outcomes and scenarios. But striving for excellence never was so important as nowadays in such an open, transparent and competitive environment. Goal of my talk will be to show you my everyday job as a test engineer. Not only how to look for defects, but how to prevent them from happening. Not only how to automate tests(noun), but how to build safety nets to minimize end-user impact. Not only how to inform testing status but how to influence quality on company level.

Views

Total views

23,892

On Slideshare

0

From embeds

0

Number of embeds

224

Actions

Downloads

305

Shares

0

Comments

0

Likes

60

×