To get the maximum value out of your tests, we recommend following best practices:
- Please check your test in the Preview Mode, before you finalize and order paid responses. In preview mode, you cannot submit a test response but ensure that the test description and/or images are consistent with your goals.
- Optionally, you can complete creating a test without ordering a paid response (your first 5 tests can be created without ordering a paid response during the beta. This limit is subject to change in future)
- Order smaller set of paid respondents for your first test. You can always “extend” the test after you receive the ordered responses.
- Use test templates whenever possible. See more details on templates below and in create a new test section.
- Don’t include leading information in your test. As respondents work on keyword test, they look for any clues or hints provided while creating the test.
Leading information includes:
- Any keyword(s) mentioned in test description
- Text annotations, brand names and labels in images. Please refer to example images here.
Test Templates
To help you include best practices, we have included some description templates.
These templates can be classified in three categories:
- Product Discovery & New Product Ideas
If you are looking for ideas for new product launches, please use this template. This test is like a consumer survey except that after asking for product ideas, tests also include how testers will go about finding the products on a destination platform (e.g. Amazon, Google, etc). Images are not included with this test.
Templates: “Product Discovery”
- Scenario-based keyword searches
This is also a text only template. We ask the testers to imagine or pretend to be in a situation. This kind of test works better when the scenario you are asking to imagine is something a user is likely to have experienced in the past.
Examples scenarios that work:
1. Pretend that either you or someone you care about is suffering from chronic back pain and you are looking for a product that may help on Amazon. You DON’T want a cream or an ointment. How will you go about searching for this on Amazon/Google?
2. Imagine that either you or someone you care about is going to a gym. You are not impressed with bag being used to hold things such as change of clothes, shoes, towel, etc. You are looking for a new bag on Amazon. How will you go about searching for it?
Scenarios you should AVOID:
1. Pretend that you are a registered nurse and work in a doctor’s office.
2. Pretend that you are a firefighter/athlete/swimmer/democrat/singer etc.
Templates: “Product Search” or “Web Search”
- Product-specific keyword search
Product-specific keyword searches have a specific goal of understanding how users will discover your product and the keywords they may use. This test is performed by displaying the product images and asking users to search for. Please follow our guidelines on inclusion of product images.
Templates: “Reverse Image Search”