Friday, March 12, 2010

Testing Reports: How to test reports with a checklist of 30+ items?

A report is an output produced by the application under test. Reports come in numerous varieties. Some reports mainly have numbers and/ or charts and some reports mainly have text. Some reports are short and some run into pages. Whatever type of report you test, you should find the following list of things to test in a report handy. See the video, How to test software reports?, that explains everything with examples or read on...
Tests for data
1. Does the report validate any input data (e.g. date range or username) provided to it?
2. Is the input data entered by the user shown correctly in the report?
3. Is the report created based on the input data given by the user?
4. Does the report calculate values (e.g. subtotals by a unit such as a reporting period, totals, averages, minimum, maximum) correctly?
5. Is each data item on the report formatted correctly?
6. Does the report group data on the basis of a unit correctly?
7. Does the report show and use for calculation the correct statutory details (e.g. tax rates)?
8. Is the chart according to the data in the report?
9. If required, does the report show the correct reference number?
10. If required, does the report show the correct reference number(s) of the previous/ related report(s)?
11. Does the report show the correct text (e.g. executive summary, key drivers, approach used to create the report, current issues and action plan)?
12. If required, does the report show the correct supporting data?
13. Does the report include the correct date and time that it was created on?
14. Does the report show the correct names of the author, reviewer and approver?
Tests for presentation
15. Is the report layout as agreed?
16. Does the report show the correct heading (name, purpose and the target audience of the report)?
17. If applicable, does the report show the correct table of contents?
18. Does the report draw any tables correctly? Do the tables clearly show the data? Is the data aligned within the tables? Are the tables aligned with each other?
19. Is the data correctly broken up into sections or pages?
20. Does similar data and text appear in the same font (faces, sizes, colors etc.)? Are these fonts as agreed?
21. Is the header correct? Does the correct header appear on every page?
22. Is the footer correct? Does the correct footer appear on every page?
23. If it is a multi-page report, do the correct page numbers appear on every page?
24. Are the graphics used (e.g. logo and background) correct?
25. Are the links on the report correct?
26. If required, does the report include notes for interpreting the data, resources for further information or next steps?
27. Is the report similar in look and feel as the other reports produced by the application?
Tests for other factors
28. Is the time taken to generate the report reasonable?
29. Is it possible to distribute the report (e.g. by email, shared drive, feed etc.) as required? Does the distributed report open on all supported devices?
30. Is it possible to export the report to all supported formats?
31. Does the report print? Completely and with the same data and same presentation?
Please comment if you find this checklist useful in your project.