Pattern | Query | Result | Rating and Explanation | |
Fail to check classification / category accuracy for business | [NUS] | National University of Singapore Hospital 21 Lower Kent Ridge Road Singapore 119077 | Name | Incorrect |
• This example name is correct; however, it is a university, not a hospital -> wrong classification. | ||||
Rate Name Accuracy correct for address result | [323 Yishun Central] | 323 Yishun Central Singapore 760323 | Name | n/a |
• The example result is an address type result, it has no name. | ||||
Demote for classification when it is displayed as ‘N/A’ for business results | [NUS] | National University of Singapore N/A 21 Lower Kent Ridge Road Singapore 119077 | Name | Correct |
• This business result is a university, but the classification is displayed as ‘N/A’. If the classification is missing or is displayed by ‘N/A’, do not demote. Not every result will include a classification. | ||||
Fail to check locality when it appears as an address component | [Paragon shopping centre] | Paragon Shopping Centre 290 Orchard Road Orchard, Singapore 238859 | Address | Incorrect-Locality |
• Locality is not present in the address format of Singapore, and it should be rated as Incorrect – Locality. | ||||
• This is exceptionally prevalent in AC results. | ||||
Rate “Business/POI is closed or does not exist” for an address result | [323 Yishun] | 323 Yishun Ring Road 323 Yishun Ring Road Singapore | Address | Incorrect – Address does not exist |
Pin | Can’t Verify | |||
•Do not check the box “Business/POI is closed or does not exist” when an address does not exist. •It should be addressed in address accuracy, and pin should be rated “Can’t Verify” when an address does not exist. | ||||
Rate incorrect street number, street name for postal code results | [760323] | 760323 Singapore 760323 | Address | Correct |
• We need not return full address for postal code results. | ||||
Fail to rate incorrect unit number when unit number is missing | [Bata] | Bata 449 Clementi Avenue 3 Singapore 120449 | Address | Incorrect – Unit Number |
• Many PO unit numb accounted this exam | s in Singapore have missing ers and they must be for in address accuracy. In le, it is missing #01-25 | |||
Fail to rate relevance as Good when query includes a unit number, but result does not | [323 Yishun Central #06-269] | 323 Yishun Central Singapore 760323 | Relevance | Good (User Intent) |
• Relevance should be Good when query includes a unit number and address result does not. | ||||
Pattern | Query | Result | Rating and Explanation | |
Rate Navigational to Acceptable for random business results when the query is a Locality | [Bugis] | Bugis Junction 200 Victoria Street Singapore 188021 | Relevance | Bad (User Intent) |
• If the query is a Locality, we assume the user intent is either for the MRT station or the locality itself (both should be rated Excellent), returning random business (although it is in the locality) must receive rating Bad – User Intent (except for very prominent POI). | ||||
Rate Navigational to Acceptable for random business results when the query is a Street | [Orchard Road] | Paragon Shopping Centre 290 Orchard Road Singapore 238859 | Relevance | Bad (User Intent) |
•If the query is a Street, returning random business (although it is on the street) must receive rating Bad – User Intent (except for very prominent POI, transit… in this street. •In this example, query is a Street, returning a random business on the street is irrelevant. | ||||
Assuming it is a category search with location modifier when it has an exact name match | [Orchard Shopping Centre] | Paragon Shopping Centre 290 Orchard Road Singapore 238859 | Relevance | Bad (User Intent) |
• When the query has an exact name match POI, we do not treat the locality as a valid location modifier. Only Orchard Shopping Centre would be considered as Navigational, and other shopping centres in Orchard would be rated as Bad. | ||||
Rating Navigational/ Bad for a street result when the query is a full residential address on that street | [323 Yishun Central] – 1 | Yishun Central Singapore | Relevance | Acceptable (User Intent) |
• The result returns only the street with a pin dropped within the boundaries of the street. This result technically satisfies the user intent, but this intent is unlikely, so relevance should be rated Acceptable. | ||||
Pattern | Query | Result | Rating and Explanation | |
Rate “Business/POI is closed or does not exist” when rating for query suggestion | [Vie] | Vietnamese | Name | Correct |
Address | n/a | |||
•Query suggestion is not an address result so rate normally. •In this example, the query is ambiguous and a query suggestion like Vietnamese could highly likely be the user intent. | ||||
Check Country and Postal Code for businesses in AC | [Para] | Paragon Shopping Centre 290 Orchard Road | Address | Correct |
•Country and postal code are optional components for businesses in AC. •Country is an optional component for POI results in AC even if there are foreign results. Do not indicate that it is missing. | ||||
Pattern | Query | Result | Rating and Explanation | |
Indicate for missing unit number in the returned address when the query is still valid even if without it | [323 Yishun Central #06-269 Singapore] | 323 Yishun Central Singapore 760323 | Query Address | Valid |
Address Accuracy | Correct | |||
• If a valid query address contains a unit number and the response address does not, rate Correct (as long as you have confirmed that the query address is valid without it). | ||||
Rating address accuracy based on result address instead of query address | [323 Yishun Central #06-269 Singapore] | 834 Yishun St 81 Singapore 760831 | Query Address | Valid |
Address Accuracy | Incorrect – Street Number & Street Name & Postal Code | |||
• The address accuracy in the result needs to be rated against the query address, not the result address. | ||||
Pattern | Result | Screenshot | Rating and Explanation |
Rate Perfect for Pin that falls on carpark for Streets | Yishun Central Singapore |  | • Pin should be rated Wrong when it falls on a service road or Carpark, it should instead fall on the main street. |
Pattern | Rating and Explanation |
No input in comments when rating is Incorrect | As long as any of your rating is not Correct/Perfect, please leave a comment, indicate the issues present together with the sources used. |
Do not provide correct lat/long when Pin is rated anything but Perfect | As long as your Pin rating is not Perfect, please provide the correct lat/long in the comment. |
Use long URL in comment | Please use short URL in the comment box, especially when copying URL for street imagery. E.g.: https://goo.gl/DbxycW |