BB H Guidelines 100722
BB H Guidelines 100722
BB H Guidelines 100722
Goal: In this HitApp you will be shown a portion from the Bing search page. Review it for one of the issue
categories listed below and report the issue.
Important: Every issue you report requires a comment. Comments do not need to be long but must explain
the issue observed and its location within the result.
Workflow:
Instructions:
1. Check the query, location & language and check the result for issues
You will be presented with the Guidelines upon opening each Hit. Select Next to go to the next page of the
Guidelines or Skip to move directly to the Hit.
• You will make your judgment by answering the question ‘Do you observe any issues in this
component?’
2. Select the issue you observed
Check the result shown in the right pane for different issue categories:
• Broken/bad/duplicate/wrong images
This includes any image-related issues, including:
o Images which are missing, did not load, are shown distorted, are placeholders, are improperly
cropped, are duplicated within the same section, or are images of the wrong subject
Note that the following should not be reported as issues:
o Images that are too small to see details – Note: Do not report small images as blurry
o Images that appear duplicated, but are in different sections of the answer
o Images that are clipped/cut by the highlighted red box
o Duplicate images of products for sale, when each listing has a difference price or description or is
from a different seller or website
• Unexpected market/language
Only select this option if none of the above issues exist and the language or market of the webpage
is different from that of the query
o No matter the HIT App language, English should never be considered an out-of-market
language
o Titles/Names displayed in their original language (example: Anime Akira displayed in Japanese
kanji) should not be marked as wrong language
Examples of this issue
Not an issue
• Other issues
Anything which doesn’t fall into any of the above categories, but which is still an issue for the user
o This only includes issues that are not related to text or image
o Check the examples below to see issues like missing number of reviews, missing sections, etc.
• After checking the result for the issues listed above, select the issue you observed
4. Finalize your judgment
• Write a comment in the ‘Explain what is broken’ text box to add details about the issue
o Good comments do not need to be long but do need to describe the exact error and its
location in the result.
o Judge providing unhelpful comments or comments with garbled text will be permanently
disabled