| [Relevance] If the query is a street address with the building name, the user is most likelylooking for the building. If the result returned only the street address without the building name, it doesn’t satisfy the user intent and should be rated as Bad. If the query is a street address, building name and the unit number, the intent is for a specific unit of the building. If the result returned only the building name, it satisfies the secondary intent and should be rated as Good. | CSG 3.8.5 Special – Address and building name search relevance |
| [Relevance] If the query had a space, this query is considered as Category Query instead of POI Search. If the query does not contain a space, this query is considered as POI Search. However, if there is no POI/ Business found for this query (圓方酒店), consider it as a category search with location modifier. | CSG 3.8.3 Special – Search Category with locality / location modifier queries |
| [Relevance] If the query are two locations, returning either of the individual location should be Excellent. However, if the return result is a random business, it doesn’t satisfy the user intent and should be rated as Bad. | GL 10.8.1. Routing Queries |
| [Relevance] If the query is for an intersection and we return just one of the streets from the query. This does not satisfy user intent and should be rated as Bad. | GL 10.1. Specific Address [Stevens Creek and De Anza] example |
| [Relevance] – When the user is outside a fresh viewport, take the VIEWPORT as location intent. All results inside the viewport area are Excellent. – When the user is within a fresh viewport, take the USER LOCATION as location intent. Results inside the area cannot be rated Bad because of distance alone. – If viewport is STALE, rating must be based on USER LOCATION. | GL 2.3.2. Implicit Location GL 5.11. Rating for User Inside and Outside Viewport |
| [Relevance] When a query is clearly for a straightforward category, results must also belong to that category. | GL 10.7.3. Clear Categories |
| [Relevance] Please differentiate between the General Location Modifier and Specific Location Modifier. The results outside of the Specific Location Modifier are rated Bad. | GL 10.6.3.2 Specific Location Modifier |
| [Relevance] When a query is for a chain business with a location modifier, the user location and viewport can be ignored because the user has provided the location that they are expecting the result to be returned in. – If the query for a chain business includes a location modifier that points to a single unique branch of that business, that specific branch can be eligible for a Navigational rating. – When there are multiple results available for the location modifier, the highest possible rating for all Results will be Excellent. – However, if there are no results for the chain business inside the requested location, the closest branches outside the location can be eligible for Excellent. Remember: – User and viewport location should always be ignored when there is a location modifier – Ratings must always be based on possible real-world results | GL 10.6.3. Chain Business with Location Modifier |
| [Relevance] When a user types in the name of a business or a POI along with its address (利苑 酒家洗衣街121號 ) , they expect to see the business mentioned in the query as part of the result. If the result is the address alone and DOES NOT mention the business(洗衣街121號) , the user cannot be certain that the query and the result refer to the same thing. This is why the result’s relevance should be Bad. | GL 10.6.1 Non-Chain Business [Gary Danko] |
| [Relevance] If the query is a full address (白加士街59號) and the return result is only the street without street number (白加士街). The Relevance should be rated as Acceptable. | GL 10.1. Specific address, [12112 sugarloaf key, st tampa fl, 33626 example] |
| [Relevance] A result that has an address that does not exist CANNOT receive a Relevance rating of Navigational. The highest rating an address does not exist result can receive is Excellent. – Please always verify the STREET NUMBER for full address. For example, if the street number only goes up to 99 but the street number of result address is 120, then this address does not exist. – When you are rating the remaining Address, Name and Pin – Address: Incorrect – Check box- Address Does Not Exist – Name: N/A – Pin: Can’t Verify | GL 10.3 Query Address does not Exist |
| [Relevance] Please always remember to rate against the real world: If there is a better result available but it is not shown, demote the existing result(s) considering the missing one(s). Demotions due to distance depend on the query and its context. (Many/few possible results, rural/urban area, etc) Please don’t be too harsh/too lenient when evaluating on distance. | GL 1.3.3. Result Relevance Rating |
| [Relevance] If the query is for a mall and the result is the store inside the mall, this should be rated Bad. This store is inside the requested mall, but users will have no way of knowing this simply from looking at the result. | GL 5.1.8 Lack of Connection |
| [Relevance] If the query is a street/ locality and the result return a random POI or government offices on the street/locality, the result is irrelevant and should be rated as Bad. However, if the result is a transit station (MTR Station) within the locality, the result is still satisfying user’s secondary intent and should be rated as Good. | GL 5.14. Unexpected Results |
| [Name] If the result name has formatting or misspelling issue (does not match with official name), the name is rated as Partially Correct. Please always use official resources to verify the business name. | 6.3. Partially Correct |
| [Name] When the classification is wrong, the final Name Accuracy rating is always Incorrect. This is true whether the result name is Correct, Partially Correct, or Incorrect. If the classification is in unexpected language, for example (simplified Chinese), the name is rated Incorrect. | GL 6.3.2 Incorrect Classification |
| [Address] Unit number and Building Name are required if it exists in the POI official website. Please always refer to the official website when there is official website. Region (九龍, 新界) is a required component for the result located in KLN and NT. | CSG 2 Required Components |
| [Address] If the result address doesn’t match the script of the expected language (i.e Simplified Chinese [号] return if the language of the test locale, result region and query should be in Traditional Chinese), the address is rated as [Incorrect – Language/Script Issue]. | GL 7.3. Language/Script Issue in Address |
| [Address] If the result address is not in the expected order but it is correct and contains all the required component, it should be rated as Correct with Formatting Issue. | |
| [Address] Transit station is one of the POIs without an expected address. Only Subdistrict and Region are mandatory, the rest are optional. | GL 8.3.2. POIs Without an Expected Address |
| [Pin] Best Available Evidence Pin rating for most features found under rooftops is based on the best available evidence for that feature’s location. That is, the more evidence that can be found to verify a feature’s location, the more precise the pin’s location must be in order to be rated Perfect. Please use multiple resources and street imagery to verify the pin location. If the pin drops on the street but still within Half’n’Half rule from the house / building, the pin is rated as Approximate. If the pin drops on a building that has another street name, the pin is rated as Wrong. | GL 9. Pin Accuracy |
Categories: