When recruiting testers from Maze, the quality of test results you receive is our biggest concern. Our goal is to ensure that you get results quickly and that you can trust the results to make informed decisions confidently, based on the data you've collected.
If you're not happy with the quality of a test, it's important that you let us know so that we can review and take additional action if needed. If a tester hasn't met the quality standards, you can report them from the results page. This helps us maintain the quality of our tester panel.
When should I report a tester?
As a general rule, try to give testers the benefit of the doubt. Testers who legitimately struggled because of confusion should not be reported. For instance, a high number of misclicks is not sufficient reason to report a tester.
Distinguishing between a low-quality tester and a genuine outlier is important: outliers can still provide insight into the usability of your design, while low-quality testers just add noise to your data. These low-quality testers produce data you can't use safely.
You should report a tester when it's clear that the tester didn't complete the test in good faith. Some examples:
- They rushed their responses, providing nonsensical answers
- They repeated or copied and pasted short generic phrases like "Good" to complex questions
- They didn't answer questions at all
- They gave up on every mission without seeming to try
- If you've enabled Clips, and they haven't allowed microphone and screen recording.
How do I report a tester?
To report a hired tester:
- Open your Maze results.
- Open the Testers tab to review individual responses.
- Click the specific hired tester that you would like to report.
Hired testers who completed the maze appear as a 'Panel session' in the list of testers. However, hired testers who started the maze but have not completed it will appear as an 'Anonymous session' instead, and can't therefore be reported. Why can't I report a particular tester?
- While viewing a hired tester's response, click Report tester.
- Select the reason you're reporting the tester. Add any relevant details.
- Click Report to submit your report.
What happens after I report a tester?
Your report will automatically alert our Support team, who will begin investigating your report by reviewing the responses provided by the tester. After submitting a report, please leave the tester's response intact and undeleted, to give us time to review their responses.
If we confirm the validity of your feedback, we'll review the tester's history to see if they've been reported before, and whether there's a pattern of low-quality testing. Depending on what we find, actions taken range from issuing you a credit for the reported tester to blocking the tester from future panels.
Once we've made a determination, we'll reach out to you with our findings.
Why can't I report a particular tester?
Hired testers only get compensated if they complete your test from beginning to end. If a hired tester abandons the test before completion, you are not charged for the test and we'll continue sourcing testers until we complete your order of tests.
For this reason, testers who haven't completed the test aren't classified as a "Panel session", and therefore it's not possible to report them.
Instead, you can simply delete these test sessions.