When recruiting testers from Maze, the quality of test results you receive is our biggest concern. Our goal is to ensure that you get results quickly and that you can trust the results to make informed decisions confidently, based on the data you've collected.
You can help us maintain the quality of our tester panel by reporting a hired tester from within your project's test results if they haven't met our standards.
If you're not happy with the quality of a test, it's important that you let us know so that we can review and take additional action if needed.
When should I report a tester?
Reporting a tester should be reserved for situations where it's clear that the tester did not complete the test in good faith. Some examples:
- They rushed their responses providing nonsensical answers
- They copied and pasted short phrases like "Good" to complex questions
- They did not answer questions at all
- They gave up on every mission without seeming to try
In general, you want to give testers the benefit of the doubt. Testers who legitimately struggled due to confusion should not be reported. A high number of misclicks alone is not sufficient reason to report a tester for example.
Distinguishing between a genuine outlier and a reportable tester is important as outliers can still provide insight into the usability of your design while low-quality testers just add noise to your data. These low-quality testers produce data that cannot be used safely.
How do I report a tester?
To report a hired tester:
- Open your Maze results.
- Open the Testers tab to review individual responses.
- Click the specific hired tester that you would like to report. Hired testers are marked with a "Panel session" label beneath their tester ID in the list of testers. Testers that you've sourced have an "Anonymous session" label.
- While viewing a hired tester's response, click the More menu (•••) in the upper right
- Click Report tester as shown below:
- Select the reason why you're reporting the tester, and add any relevant details.
- Click Report to submit your report.
What happens after I report a tester?
Your report will automatically alert our Support team, who will begin investigating your report by reviewing the responses provided by the tester. We ask that you please leave the tester's response intact and undeleted for at least a business day after submission, to give us time to review their responses.
If we confirm the validity of your feedback, we will then review the tester's history to see if they've been reported before and whether there's a pattern of low-quality testing. Depending on what we find, actions taken range from issuing you a credit for the reported tester to blocking the tester from future panels.
Once we've made a determination, we'll reach out to you with our findings.
Why can't I report a particular tester?
Hired testers only get compensated if they complete your test from beginning to end. If a hired tester abandons the test before completion, you are not charged for the test and we'll continue sourcing testers until we complete your order of tests.
For this reason, a tester who hasn't completed the test is not classified as a "Panel session", and therefore can't be reported.
Instead, you can simply delete these test sessions.