Auxiliobits

Menu
Menu

Automation of QA Manual Test Cases for SharePoint based DMS – Case Study

Challenge

The client has thousands of test runs defined in the TestRail .that need to be executed everytime a new deployment has to be released to the client. The process of executing these test runs was stringent and needed to be run along with uploading screenshots in the TestRail individual test cases.

Solution

The manual test cases being run through the TestRail needed to be automated and the solution that came to the rescue was UiPath Robotic Process Automation. RPA could emulate manual test cases and could integrate well with TestRail to emulate the humans executing the tests. The test case execution could be monitored through TestRail and the DMS test cases could be run integrating with various applications and document types.

Outcomes

  • Redeployment of staff to more value added tasks like test case execution reconciliation
  • 100% accuracy in test cases execution. Test Case execution reports emailed daily.
  • 80% reduction in test case execution time. Speed and Accuracy improvements.

About The Case Study

Download this case study to discover how thousands of test runs defined in the TestRail are automated that need to be executed every time a new deployment has to be released to the client. The process of executing these test runs was stringent and needed to be run along with uploading screenshots in the TestRail individual test cases.
In this case study you will find valuable information including:
  • Client Profile
  • RPA Project Brief
  • Challenges the client faced
  • Auxiliobits’s RPA solution
  • Process before automation (Manual process)
  • Process after automation (Live in-production)
  • Outcomes achieved

    Fill the following details to get your copy!

    The Client And Engagement
    Information

    The client is a big Enterprise Software Provider Company that provides solutions to its large enterprise customers. One of the solutions provided is a SharePoint based Document Management System (DMS). This is a huge application that provides various user roles, document management and document operational capabilities.

    The Challange

    The client has thousands of test runs defined in the TestRail .that need to be executed everytime a new deployment has to be released to the client. The process of executing these test runs was stringent and needed to be run along with uploading screenshots in the TestRail individual test cases.

    The progress of the testing was measured using the TestRail. Each deployment took more than 90 working days to successfully run all the test runs by 3 to 4 FTEs. This was a huge effort considering the fact there were frequent deployment releases to the customer in an year.

    Key Information

    • Industry:
    • Enterprise Software Services Provider
    • Geographies Implemented:
    • USA
    • Automation Tool Used:
    • UiPath (Studio, Robot)
    • Department:
    • QA
    • Sub-Department:
    • NA
    • Engagement Model:
    • Automation as a service - research, consulting, execution and training in a Time and Material Contract
    • Domains, Departments, Segments Covered:
    • QA
    • Volumes:
    • Approx. 1500 test cases per deployment
    • Resources required to complete the manual process:
    • 4 FTEs per deployment
    • Type of Process:
    • QA Test Automation
    • Application:
    • SharePoint DMS, TestRail, MSWord, MSExcel, PDF.

    Solution: Our Approach

    The manual test cases being run through the TestRail needed to be automated and the solution that came to the rescue was UiPath Robotic Process Automation. RPA could emulate manual test cases and could integrate well with TestRail to emulate the humans executing the tests. The test case execution could be monitored through TestRail and the DMS test cases could be run integrating with various applications and document types.

    • RPA Maturity Assesment

      Getting our own Business Analyst (BA) on the job Auxiliobits assessed the test cases to ascertain the feasibility of Robotic Process Automation (RPA) to emulate manual test cases and integrate testing progress in TestRail. Each test case was analysed in detail to optimize the time it takes to run tests. The BA also created a business case using various metrics available from the test cases defined, average implementation time. Our BA analysed and proposed that this automation was a fit for RPA to get the Return on Investment.

    • Proof Of Concept

      To demonstrate the RPA capabilities to automate the test cases, a subset of the test cases was automated using UiPath that proved the feasibility for the process selected.Also the RPA automation would well integrate with TestRail to log progress of the test case execution.

    • RPA Implementation

      With our BA assessing the test cases to be automated along with the Proof of Concept implemented proved that the automating test cases was viable for automation using RPA and got us an effective business case. Auxiliobits automated the test cases as per its RPA development LifeCycle. The Auxiliobits team performed user acceptance testing (UAT) and deployed the automated test cases into their CI/CD pipeline. The tests were run and reported in TestRail. The TestRuns had the reporting through screenshots as it was done manually

    Manual Process (AS IS)

    The manual process followed was:

    • The QA FTEs executed the test cases manually for every deployment.
    • For every test case an FTE would create a TestRun in TestRail and start executing the test cases one by one.
    • There was complexity involved in running the test cases like interacting with various applications. The DMS would download the document, open it in its respective application and then edit and check-in into the DMS. Reading and Writing the documents could not be automated using conventional automation tools.
    • The Test Suites being run would then depend on the manual testers to be run over time.
    • For every test run the tester would include a screenshot of the result for the manager to verify whether the tests are run successfully or not.
    • The Manager would monitor the test cases execution using the TestRail reporting.
    • Various types of documents needed to be handled like PDF, MSWord, MSExcel.
    • Document check-in and check-out would be performed as part of the test case execution and was assigned to the users based on the roles.
    • The manual test cases execution for every deployment took more than 60 days by 3 to 4 FTEs.

    AUTOMATED PROCESS

    The BOT performs the following tasks as part of the automated process:

    • Hundreds of test cases automated using UiPath workflows.
    • Integration of UiPath robots performing automation of test cases in the CI/CD pipeline.
    • UiPath workflows for manual test cases integrating with various other Windows applications.
    • Test report generation with PASS/FAIL status for each test case including the reason of failure.
    • Exception logging during test case runs.
    • Cleaning up of the machine/server after test case runs
    • TestRail integration while UiPath robot running the test cases.
    • Screenshots of the test case execution added to the test run cases in the TestRail as part of the successful execution tracking
    • Multiple UiPath robot deployment to run independent test suites to decrease the turnaround time.

    Benefits / Values Delivered

    The automation of the process resulted in the following qualitative and quantitative benefits:

    • Near zero chances of skipping test cases to be run.
    • Increased prospects of finding functionality break.
    • Focuses on quality automation and value-added activities pertaining to test cases.
    • 100% trust on the UiPath robots running the full test suites.
    • Alleviates pressure by increasing process capacity.
    • Time saved and quick test reports for the stakeholders thus lowering the risk of skipping a break.
    • Reduction in processing time for running the test cases.
    • Automated and real-time feedback analytics on test cases being run.
    • Manual test case execution time reduced to 1.5 weeks instead of 90 days by 3-4 FTEs
    • 80% reduction in test cases execution time, along with additional checks that were not previously performed.
    • 100% accuracy in bug detection.
    • Capacity increased and test case automation implementation happened quickly to get ROI.

    Redeployment

    of staff to more value
    added tasks like test case execution recociliation

    100%

    accuracy in test cases execution

    80%

    reduction in
    test case execution time