Generated outputs

XTR has different plugins that can be activated or deactivated via the config.json file. Each one generates its own artifacts. Below is the list of plugins:

* "tetk.core_framework.mtf.connector"
* "xtr.plugins.xtr_junit_xml_report_plugin"
* "xtr.plugins.xtr_json_report_plugin"
* "xtr.plugins.xtr_robot_report_plugin"
* "xtr.plugins.xtr_watcher_plugin"
* "xtr.plugins.xtr_ethernet_marker_plugin"
* "xtr.plugins.xtr_allure_report_plugin"

After executing the test cases, the following directories are created:

  • Main directory: Created inside the Results folder, it is named using the date and time of the execution or named last_execution.
    • Global: A subdirectory within the main folder that contains global test result files including:

      • xtr_main.log: Contains all XTR execution logs

      • global log file: Contains the MTF log.

      • JunitReport.xml contains the general status report of the executed test cases in XML format.

      • JsonReport.json: Contains detailed execution information about the executed test cases in JSON format to be displayed by cariad html report.

      • log.html: Contains robot framework detailed status information of the executed test cases.

      • report.html: Contains robot framework general status information of the executed test cases

    • HTMLReport: A subdirectory inside the main folder that contains HTML cariad report files.

    • Tests: A subdirectory inside the main folder that contains test case-specific output files, also MTF output files.

xtr-main log file

Below is a snippet of the xtr-main log file content, which is the XTR log.

global log file

Below is a snippet of the global log file content, which is the MTF log.

JUnit report

As mentioned previously, the JUnit report documents test results and provides an overview of the entire test suite.
It includes the total number of executed test cases, as well as the PASS, FAIL or SKIPPED status for each.
Individual test case results include the test name, execution status, duration, class name and any encountered error messages.
The report is in XML format, which is machine-readable and can be convertible to human-readable formats like HTML.

Robot HTML report file

The html report file, shown in the image below, provides the same details as the JUnit report,
in an clear and human-readable format. This file offers a general overview of the execution and
contains a button that directs you to the log html file, which gives the same information but with more details.

Robot HTML log file

Contrary to the HTML report file, the log file provides detailed information about the test series execution
and lists all the test cases in a tree structure. It also includes a button that directs you back to the report file.

JsonReport report

XTR generates a detailed JSON-format report that is used to fill the HTML report

Ehernet marker plugin

Injects dlt message into traffic.