Reports

Overview of Allure reports, accessible from the Analyze section of Typhoon Test Hub.

Reports are generated upon completion of a test execution. You can see the most important information about available reports in the Reports table (Figure 1). Additional information on how to upload reports can be found in the Execution command section.

Figure 1. Reports table

The Report table shows following informations:

  1. ID unique report identifier
  2. Name of a Job from which the execution is created
  3. Time when Execution started
  4. Time when Execution finished
  5. Duration of Execution
  6. Number of total tests in execution
  7. Success rate in percentage.
Note: By clicking on the button, columns of the table can be customized - hidden or shown depending on the preference. Columns of the table can be reordered by using drag and drop in the table header. When positioning cursor in between two columns, cursor for column resizing will show and enable change of the column's width. All changes made to the table will be automatically preserved.
Using tth-api-client package, four types of report can be uploaded to the TTH:
  1. Allure ()
  2. Html ()
  3. Pdf ()
  4. Custom ().
Report for a given Job and Execution can be accessed by clicking on the speciffic icon. An example of such a report is shown in Figure 2.
Figure 2. Allure report

You can share a link to this report directly with your colleagues which they can open by logging into Typhoon Test Hub. If you want to check more information about the Execution which generated a specific report, simply click on the link under the “Executors” to return to the details in TTH. Tags for a specific report can be added prior to Execution or after Execution. You can see them in the Report details Overview section (Figure 6).

You can change the number of items in the table in the Navigator tab.

Reports can be filtered out by using the filtering section above the table. Filtering section is shown in Figure 3, which shows that executions can be filtered using Execution, Time and Report filters.

Figure 3. Report table with filter section shown

By clicking on the customize filter button, the filter can be customized. If an existing filter is already selected, its data will be prepopulated in the dialog. Conversely, if no filter is selected, the user can create a custom filter through the opened dialog. By clicking on the manage filters button, the user will be redirected to the filters page, where they can view and edit the filters if needed.

Actions available when multiple items checked in the table

Multiple items can be selected by checking the checkboxes in the table rows. After items are selected, action buttons will appear above the table, allowing user to take action on all selected items.
  • Delete - As shown in the figure below selected items can be deleted by clicking on the button. Once the button is clicked, the user will see a dialog prompting them to confirm the deletion of the selected items.
  • Aggregate reports - As shown in the figure below selected items can be aggregated by clicking on the button. Once the button is clicked, the user will see a dialog prompting them to provide additional information about the aggregated report. This will be explained further below.
Figure 4. Multiple reports checked
All items can be checked/unchecked by clicking on the checkbox placed in the header of the table.

Report aggregation

Once the items are checked and the report aggregation is initiated, a verification is made to ensure which of the selected reports are available for aggreagation. This means that the selected reports must be Allure reports, they must be collected using the collect allure-results option, and their allure-results are preserved by the Hub. For more information on report collection, please refer to relevant documentation.

Note: Please note that only Allure reports which were originally uploaded and collected by the Hub (collected as Allure results) can be aggregated. Reports created by merging other reports and incorporating them into a stage or pipeline report are not suitable for aggregation.
If the verification of the selected reports is valid, the user will be prompted with a dialog, as shown in the Figure below. In this dialog, the user can see which reports are available for aggregation and indicate whether the aggregated report should be assigned to a job execution, pipeline execution, stage execution, or none. If an option other than None is chosen, the user will be able to specify which execution the aggregated report will be assigned to.
Figure 5. Dialog prompted when reports for aggregation are selected

Report details

Figure 6. Reports details

In the Overview section, you can find basic information about the selected report, as well as add notes and update report tags.

In the Report Header you can click on the colored numbers to directly open filtered Allure report. By clicking on the Allure button (), an Allure report will be opened without any filtering of the test results. If the report selected is not Allure, but any other type, button will also enable opening of the chosen report. The option to delete a report is available by clicking on the button. A report can be downloaded as a zip archive by clicking on the button.