Important Rating Tips/Guidelines sections

This document aims are highlighting a few trends that still remain to be a common issue across the analysts in your market. Please find the list of trends below. It would help you avoid making similar mistakes in the future.

Main Guidelines:

2.3. Location Intent
4.2. Business/POI is Closed or Does not Exist
6.2.2.1. Minor and Moderate Misspellings and Missing or Extra Words
6.7. Final Name and Category Accuracy Rating (Summary Table)
GL. 9.2 Single Rooftop section Best Available Evidence
10.10. Unclear Results

Country Specific Guidelines:

2.1 Examples of expected/minimum address requirement in Hong Kong
3.7.2 Pin accuracy – Also applies to Search and POI evaluation
3.8.2 Special – Script
3.8.3 Special – Search Category with locality / location modifier queries

Please note This document was updated in September 2024. Guideline sections in this document refer to Search Guideline

March 2024. Please follow the latest guideline if there is any conflict between this document and the latest guideline if you have

the later version of the guideline than March 2024.  

.

.

.

.

.Relevance

Category search vs POI search

In this example, as there is no train station that exactly matches the query, the query is considered to be a search category with the locality modifier (CSGL 3.8.3).

Result 1 and 2 are the possible matches that can be returned within the queried locality. They are eligible for Excellent. Stations outside the locality is demoted by distance.

Result 3 – This station is to be demoted for distance similar to GL transit query as it is considered to be a locality + category query. As this is the next closest station to the locality Taipo, it is eligible for Good.

On the other hand, if the query was 大埔墟地鐵站, it would be considered as a POI search. Result 2 receives Navigational and Result 1 and 3 receives Bad for relevance.

 

Relevance: Explicit Location

This query is similar to examples in GL.2.3.1.If the query contains words like “near me” or “nearest” the user’s location should be considered the explicit location intent. The viewport location should be ignored, even if FRESH.

From research, this result is the third closest branch to the user. As the distance from the user to the second and third closest results are roughly the same, both results are eligible for Good. Always rate against the real world: If there is a better result available from your research but it is not shown in the Tryrating map, demote the existing result(s) considering the missing one(s). If you are making your rating decision based solely on results displayed in the Tryrating map, you are more likely to rate incorrectly.

 

Business Closed/Does Not Exist

Per GL 4.2, if you rate the result as Business/POI is closed or does not exist, you must still give a relevance rating as if the place were open or did exist.

Example:

The query is looking for a Häagen-Dazs branch with a specific location modifier (GL.10.6.3.2). We can conclude that this branch is closed since it is not listed in the official website of Häagen-Dazs (https://www.haagendazs.com.hk/) or the official website of the mall (https://www.the-one.hk/en/shopdirectory/shoplist.asp)

In this case, Navigational rating is eligible (Per GL 5.19.1.1)

Query

Häagen-Dazs The One

User location

22.3379,114.1973

Viewport Age

FRESH

Centre Viewport

22.3406,114.1973

Result Name

Häagen-Dazs

Address

香港九龍尖沙咀彌敦道100

Classification

雪糕

Coordinates:

22.299799,114.172547

Please remember to tick the box ‘Business/POI is closed or does not exist’ then you will only be presented with the relevance rating and a comment box. Make sure you provide evidence to confirm the business closure. See the example comment on the right and understand the expectation.

Result name/title is in unexpected language or script

Business/POl is closed or does not exist

Relevance – Navigational

Comment and Link

From research, this branch cannot be found in the official website of Haagen-Dazs (http://tinyurl.com/5dd4m4zr) or the official website of the mall (http://tinyurf.com/2jdbfy2r). Navigational: This the only branch that satisfies the query with the location modifier ‘The One’.

Name Accuracy Summary Table

Your final rating will take into consideration both the accuracy of the Business/POI name and the category assigned to it. Inaccuracies in either or both of these elements will result in rating demotions.Please read the guideline section 6.3.2 Incorrect Category and 6.7 Final Name Accuracy Rating (Summary Table). The n/a rating should be used for all Address Type results, including residential addresses, streets, localities, and so on. Review GL.6.1. Name Not Applicable (n/a).

Name/Title Correctness

Category Accuracy

Final Name and Category Accuracy Rating

Correct

Correct or N/A

Correct

Correct

Incorrect

Incorrect

Partially CorreCt

Correct or N/A

Partially Correct

Partially Correct

Incorrect

Incorrect

Incorrect

Correct or N/A

Incorrect

Incorrect

Incorrect

Incorrect

 

Name Accuracy Example: Partially Correct

Query

郵局

User location

22.374732,114.111939

Viewport Age

FRESH

Centre Viewport

22.3711880318323,114.114268791488

Result

楊屋道郵局

Address

中國香港特別行政區新界荃灣楊屋道138號樂悠居115

Category

郵局

Coordinates:

22.366379,114.118198

The post office official website https://webapp.hongkongpost.hk/tc/about_us/network/post_offices/index.html#list indicates as 楊屋道郵政局. The returned result name 楊屋道郵局 is not exactly the same as the official website but still recognizable, therefore the overall Name Accuracy rating is demoted to Partially Correct. The category 郵局 is correct.

Name Accuracy Example: Partially Correct

Service-Level Mismatch:

Query

中原

User location

22.33795166015625,114.1534423828125

Viewport Age

FRESH

Centre Viewport

22.3397442251565,114.15452683148

Result

中原地

Address

香港九龍長沙灣青山道485號九龍廣場地下5號舖

Category

房地

Coordinates:

22.338651,114.149422

If the result does not reflect the correct service, it is considered a service-level mismatch and rated Partially Correct. The branch service should be (工商舖工商部 – industry or commerce specific. Hence per GL section 6.2.2.2.

Service-Level Mismatch, this is rated Partially Correct. The correct name is 中原(工商鋪) https://hk.centanet.com/info , https://maps.app.goo.gl/LLmLcjG57n4vxavt5

Address Accuracy: Tips

The key of Address Accuracy is to utilize official websites and reliable resources (when official websites are not available) such as: https://webapp.hongkongpost.hk/correct_addressing/index.jsp?lang=zh_TW https://www.map.gov.hk/gm/

Most mistakes were made due to lack of research or not paying attention to small details. Please note that you are required to conduct an in-depth research and refer to the guidelines section to perform an expected quality. You are expected to check every and each address components and make sure they are correct.

Please review CSGL_HK Section 2:Required Components

Region is essential if the POI is located in Kowloon or New Territories.
Sub-district is an essential component in most cases.
Building name is essential if it exists or is available in official postal data.

Please note that some of the street name also contain the sub-district name, such as 屯門事會路 and 荃灣街巿. In these cases, the sub-district has to be included separately.

Address Accuracy Example

The result is missing the subdistrict. As the street name is officially named 荃灣街市街, the subdistrict of 荃灣 is expected, but was not returned in this case. The expected address is 香港新界荃灣荃灣街市街10-16號地下與一樓.

Pin Accuracy Tips

When you rate Pin Accuracy, please check both Satellite and Vector maps on Tryrating.

When there is a difference between where the pin drops in satellite imagery and the vector map, always use the map layer in the TryRating tool that is more generous toward the pin. Note: After consulting these research resources, always verify pin placement using the layers provided in the TryRating tool. This means that even if you have gathered coordinates elsewhere, you must rate pin placement based on what you can actually see in the TryRating layers.

Also, always check available online resources to validate the Pin Accuracy. When the Pin lands on the rooftop where the POI is located but doesn’t land exact where it is, it should be Approximate. Please review the GL. 9.2 Single Rooftop.

Don’t forget to leave comments including coordinates and links to resources when the pin rating is not Perfect.

Pin Accuracy Example: Approximate

Query

7-Eleven

User location

22.33795166015625,114.1534423828125

Viewport Age

STALE

Result name7 – Eleven

Address

中國香港特別行政區新界深井青山公路深井段36–40

Coordinates:

22.367774,114.061547

Considering the online resources and the street imagery, the pin falls within the land parcel but not at the exact location of the 7-Eleven. It should be rated Approximate.

 

Pin Accuracy Example: Approximate

Query

mac

User location

22.318038940429698,114.169235229492

Viewport Age

Fresh

Centre Viewport

22.3142675,114.1672785

Result name

M•A•C

Address

香港九龍尖沙咀柯士甸道西1號圓方2110-11 號鋪

Coordinates:

22.305094,114.160825

.

Floor Map of the mall

The Pin lands on the mall where the POI is located but doesn’t land exactly where it is. Per example in GL 9.2 “Shopping mall with a single rooftop”, it should be rated Approximate.

 

Pin Accuracy Example: Next Door

Query

惠康

User location

22.312406,114.219668

Viewport Age

 

FRESH

Centre Viewport

22.312675,114.224985

Result name

惠康

Address

香港九龍觀塘成業街10號電訊一代廣場地下DH號舖

Coordinates:

22.31061,114.225881

By Comparing the Tryrating map, the map by Hong Kong gov https://www.map.gov.hk/gm/s/F/21094261 , and the street imagery https://goo.gl/maps/8FUi8yzaYhZKnTVC8, we can conclude that the pin lands on the building next to where the POI is located, thus rated Next Door.

 

Leave a Reply

Your email address will not be published. Required fields are marked *

Related Post