In agile development test automation has significant role. Test automation includes testing techniques like automated acceptance and regression testing and unit testing.

Without automation testing team gets stuck in long and boring manual testing. But automation testing services needs to be done accurately, with poorly done automation you will get into these two situations where developers will shout at you for continuous rejection of builds and your project manager considers that you are providing broken code.

Commonly during the early stages of automation test scripting there are situations where some tests pass randomly this is caused by set of factors like different order of page loading one of the most common irritation is when tests works fine in local environment but fails on build agent this causes debugging very time consuming process. Due to this there is a great requirement of improving test automation quality and making the tests more robust.

This goal of this blog is to provide a set of methods to utilize in situations when you notice that your tests running but failing sometimes then run occasionally and failing for longer again.

test automation

  • Avoid usage of record and playback scripts for automation

Using record and playback tools like selenium IDE we get the unmaintainable and fragile scripts and for Agile development one cannot spend such a long time to fix these fragile scripts.

  • Automation needs a collaborative approach

it is responsibility of whole team, don’t allocate automation task to one person. Weave you goals of automation in scrum team.

  • Staying on the top of the failures

The causes of test failures are test instability, environmental problems and issues in code. Tests which never come into failures are always ignored and tests which mostly fail are always omitted.

  • Transparent Communication between team members

Build outcomes are communicated by information radiators between team mates. Conventions used must be easily understood by team mates like failure in “Red”, success in “Green” and make usage of trend graphs for more understanding.

  • Adding Tags with tests

Test’s run frequency is specified by tags so multiple tags must be attached to check run frequency of tests.

  • Tests in isolation

Small tests must be written for individual components before and end to end testing so as to isolate the failures. Writing large tests for fully integrated system causes whole test suit to fail.

  • Make your custom Exception

Exception names are enough to give understanding of failures so you must extend exception class in your own class to make your custom exceptions which will give more information to you and other persons while debugging your tests.

Always Make Sure To Conduct a Pre-Test Checkups

There are cases where flaky tests are the problem but unready environments are the bigger problem than that. You must create a robust set of tests which you can treat as a pre-flight check. Before you run any integration tests, you must run this suite to understand the compatibility of series of tests integration. These tests are comparatively very quick as they only check the HTTP statuses and integration tests.

The Debugging & Retries

Now, imagine if a test fails for three consecutive times. In that condition, you must automate the retry. It might increase the run times of the test; however, it will act as a quick fix until you take manual time to debug the cause of failure properly. You must perform this method until a degree of test stability is attained.



Suraj is an ISTQB certified Automation Test Engineer at BugRaptors. He is responsible for Automation testing on Web and Mobile application and API Automation. He is also aware about RPA Automation using UiPath Automation Tool. He has working knowledge in Selenium Web driver(Web application), Appium(Android and iOS), API automation (Rest-Assured).


Add a comment

BugRaptors is one of the best software testing companies headquartered in India and the US, which is committed to catering to the diverse QA needs of any business. We are one of the fastest-growing QA companies; striving to deliver technology-oriented QA services, worldwide. BugRaptors is a team of 200+ ISTQB-certified testers, along with ISO 9001:2018 and ISO 27001 certifications.

USA Flag

Corporate Office - USA

5858 Horton Street, Suite 101, Emeryville, CA 94608, United States

Phone Icon +1 (510) 371-9104
USA Flag

Test Labs - India

2nd Floor, C-136, Industrial Area, Phase - 8, Mohali -160071, Punjab, India

Phone Icon +91 77173-00289
USA Flag

Corporate Office - India

52, First Floor, Sec-71, Mohali, PB 160071,India

USA Flag

United Kingdom

97 Hackney Rd London E2 8ET

USA Flag


Suite 4004, 11 Hassal St Parramatta NSW 2150

USA Flag


Meydan Grandstand, 6th floor, Meydan Road, Nad Al Sheba, Dubai, U.A.E