Test Automation Results Reporting with Easy Test NG Listeners

8th of August 2016 | Blog,Enterprise Software Development,Software testing

Reporting Automation Testing Results

Test Automation engineers often use ReportNG to generate results reports for automations performed using the Selenium WebDriver framework. ReportNG can be quite complex in terms of configuring, and it also lacks a variety of features.

Listed below are some of the limitations in ReportNG.

  1. Inability to add visually appealing graphs and charts illustrating the comparison of test results with previous cycles, at a glance.
  2. Inability to capture screen shots/videos as test result evidence.
  3. Absence of a customizable index page with project description, logo etc.
  4. Inability to export results in PDF, Microsoft Excel and HTML formats.

ATU Reporter

ATU Reporter is an open source Test NG Listener designed for Selenium. Users can easily add this  reporting feature to the code. Users can add the ATU Reporter feature even after completing the automation code for their respective projects.

The following features are available in the ATU Reporter:

  1. Customizable graphical reports (Line Charts, Bar Charts, and Index Page)
  2. Consolidated reports with the ability to compare information with previous test cycles
  3. Screen shot capturing
  4. Video recording
  5. Ability to export results in Microsoft Excel, PDF, and HTML formats

Configuring ATU Reporter for an existing Selenium code

  1. Download ATU Reporter for Selenium TestNG from the following location https://automationtestingutilities.blogspot.com/p/reporting.html.
  2. The downloaded file contains two executable JAR files. Copy the JAR files to the respective project folders.
  3. Open the properties file and provide the location. The reports appear in atu.reports.dir file.
  4. Integrate ATU reports and the automation project by setting the ATU property information in the main method as follows:

//Set Property for ATU Reporter Configuration

{

System.setProperty(“atu.reporter.config”, “D:\\Hisan Backup\\HisanS\\D\\ATUReporter_Selenium_testNG_2.1 jar javadoc prop file demo proj atu recorder\\ATUReporter_Selenium_testNG_2.1 jar+javadoc+prop file+demo proj+atu recorder\\atu.properties”);

}

 

Adding the screen shot capturing feature to the Selenium code 

  1. In the Property file, change the value of reports.takescreenshot property to true.

atu.reports.takescreenshot=true

  1. Enter the following code after the respective test execution code in the test method, in order to capture the screen at the relevant instance.

The steps, input value, expected value and actual value can be described in the respective test cases, which will be shown in the report.

@Test

public void testME()

{

setAuthorInfoForReports();

driver.get(“https://www.google.com”);

ATUReports.add(“Step Desc”, “inputValue”, “expectedValue”,

“actualValue”, true);

}

  1. Click the screen shot thumbnail to enlarge the screen shot.

 

Customizing the index page

You can change the header text and add a client logo and a description for the respective project by configuring the following properties in the Property file.

#change header text

atu.proj.header.text=My Proj Reports

#add project/client logo, the image is copied to “HTML_Design_Files/IMG” directory

atu.proj.header.logo=D:/img/google.png

#specify your project description

atu.proj.description=MyProject Testing Reports

 

Enabling the video recording feature

You can enable the video recording feature by changing the Property file.

To enable the video recording feature, enter ‘suite’ as the value for the “atu.reports.recordExecution” property, and run the selenium test automation code. A video will be created in the respective cycle folder, which the user can watch while running the automated test. You can watch the video only using VLC Media Player.

The user could also click the ‘Click Me to Show/Hide the Execution’ Video link in the report to watch the recording.

#Record test execution

#testmethod: record execution for every single test method in its own movie file, not yet implemented

#suite: record execution of complete suite in a single movie file

#Available options: suite, none

atu.reports.recordExecution=suite

 

Click here to download our Software Testing brochure for more information

Click here to read more about Brandix i3’s Software Testing and QA Solution

 

Author: 

Hisan Saleeth

i3 Labs is the technology and innovations Lab at Brandix i3

Related Posts

From insights to thought-leadership

View More

Boost Infor CloudSuite’s order capturing efficiency with Fortude Customer Order Manager

From placing a customer order to delivering goods, having robust COM processes ensure a strong bottom line, positive impact to the cash flow, and increased customer satisfaction. Customer order placement—the head of the COM process—is a critical step. At this point, the customer service representatives should have the visibility to information such as inventory availability and the agility to complete order placements fast. Inability to ensure information accuracy at this level can cause issues when allocating, picking, and shipping goods. This blog post explains the means through which Fortude Customer Order Manager can streamline the customer order management in your Infor M3 or CloudSuite ERP solutions.

Crossing Boundaries: Journeying from Diversity to Inclusion

According to McKinsey’s May 2020 report, “Diversity Wins,” or in other words, “D&I is a powerful enabler of business performance. Companies whose leaders welcome diverse talent and include multiple perspectives are likely to emerge from the crisis stronger. In short: diversity wins, now more than ever.” Here at Fortude, we continue to make diversity part of our DNA. The mistake that is commonly made across several industries is that organizations leave it up to HR to foster inclusive environments. D&I is not an HR strategy; it’s a strategy that includes everyone – so, in order to be successful, we have to be successful together.

Extend Infor M3/CloudSuite’s EDI capabilities with Fortude EDI

Can your electronic document interchange (EDI) solution do more than just exchanging information? Fortude’s EDI Framework provides interfaces to hold, review, revise, and consolidate EDI transactions before posting them to Infor M3 and CloudSuite.

Infor GO — The Future of Infor Mobility

Mobility is fast becoming the future of ERP. There is a growing need for mobile apps that extends ERP functionality to its business users, allowing them to make informed business decisions on the go.

Bringing information closer to business users with Infor Ming.le

Infor Ming.le is an action-oriented social collaboration platform designed for business organizations. Simply put, Ming.le’s interface will remind you that of the popular social media platform Facebook, except Ming.le serves a unique purpose: bringing information from disparate systems closer to business users, helping them work smarter and faster.

Manage your business documents seamlessly with Infor Document Management (IDM)

Businesses often struggle to keep track and manage high volumes of physical and digital documents that are being created within an ERP system. Most businesses manage these documents manually, separately from the ERP process and business transaction. With this kind of a disjointed process, documents get saved in different systems and users have to switch between applications or spend time manually searching for documents.