Important Rating Tips/Guidelines sections
This document aims to highlight a few trends that still remain a common issue among the analysts in your market. Please
find the list of trends below. It will help you to avoid making similar mistakes in the future.
Global Guideline
Country Specific Guidelines
Relevance
Important reminders for the Relevance rating
Relevance is always rated independently of any data (name/category, address, or pin) inaccuracies. If the status is blank, rate the relevance assuming that the result exists (even if research reveals the location is closed) and that the data presented is correct. Please review GL. 1.3.3. Result Relevance Rating and GL. 4.2. Business/POI is Closed or Does not Exist. If the status
shows PERMANENT_CLOSURE, please follow the steps illustrated in GL. 5.19. Rating Relevance When Result Status is PERMANENTCLOSURE.
Example query:
Access the following link to see the active map.
//www.HXV3WEQTS7SY60KCKT4326V1
This ATM is no longer listed on the official website(https://www.bnz.co.nz/locations). As there is no source to prove this business’s operation, select ‘Business/POI is closed or does not exist’ and rate the relevance only. Treat this ATM as still open and rate Excellent, because the ATM is inside the FRESH viewport. It is wrong to rate Bad simply because the POI is closed or does not exist. Always rate against the real world: If there is a better result available but it is not shown in Tryrating Map, demote the existing result(s) while considering the missing one(s).
Implicit Location
Guidelines section 2.3.2 describes how to determine the area of expected results when the query does not include a location modifier. This depends
on the age of the viewport as well as the user and viewport locations.
In this example the viewport is STALE so it should be ignored, the implicit location intent is the user location.
The result on John Goulter Drive is close to the viewport, but further away from the user. The official website for the business (https://www.countdown.co.nz/store-finder) shows that there are multiple locations closer to the user, so the relevance is Bad.
Please remember to check the age of the viewport when determining the implicit location intent.
Transit queries
This query is ambiguous. The user might want any stations in/near Henderson, or the user might specifically want Henderson Station.
Result 1 is Henderson Station. This is the only result that satisfies the possible intent for a specific station, so it is promoted to Navigational.
Any other station in Henderson satisfies the possible intent for stations in this sub-locality and should be rated Excellent. In this case Result 2 is the other station in Henderson.
Stations in nearby sub-localities could still be useful to the user as they provide a choice of stations in the area. The closest stations to Henderson are Ranui and Sunnyvale, these would be rated Good. Result 3 is one of the next closest stations after those two so it is rated Acceptable.
(https://at.govt.nz/bus-train-ferry/train-services/ has maps shows existing real world train stations in Auckland).
See guidelines section 5.16.1 Transit Queries
Name Accuracy
Partially Correct Name
The text on the official website
(https://www.cityfitness.co.nz) calls this business CityFitness, but the logo does not include capitalization (cityfitness).
Any name used by official sources can be considered Correct so capitalization is optional for this business name. However, the names of these results include a space which
does not appear in official versions.
A business name that includes a minor issue (like an unnecessary space) that would not prevent a user from identifying the business should be rated Partially Correct.
See guideline section 6.2.2 Partially Correct
Name
Name/Title Correctness Classification Accuracy Final Name Accuracy Rating
Incorrect Category
The name/title of this business is correct, but thecategory is misleading. The official website (https://halswellbakery.co.nz) mentions that the business has a small cafe
style area but this is a minor part of the business. It’s main business is selling baked goods so the category should be Bakery (or similar). A restaurant does not represent the true nature of the result.
lines section 6.3.2 says that if the category is
misleading, it should be considered Incorrect.
Section 6.7 shows that if the category is Incorrect the final name accuracy rating is also Incorrect.
Please remember to check the category
when rating the Name Accuracy.
When determining whether a business exists, you need to use all provided information (including
information that is not rated like the phone number and URL) to figure out exactly what the result is. The name is assumed to be correct when rating relevance but this may not be true.
For example, the name of this result is The Warehouse but ,
the category, phone number, URL, and pin location point to a Chemist Warehouse. In this case, the name is considered Incorrect because most of information refer to a different business.
You will ignore data inaccuracies when rating the result’s relevance (rate the relevance as if it were a pharmacy called The Warehouse at the result location), but rate the address and pin based on Chemist Warehouse St Lukes .
because that is what the result actually is.
See section 10.10 Unclear Results for more information and examples.
Address Accuracy
When rating address accuracy, make sure you pay attention to detail and conduct proper research using
official sources.
In the first example, NZ Post shows that the result address is correct but the components are in the wrong order. The address rating should be Correct with Formatting Issues according to CSGL 5.1.2.
In the second example, the address on the business’s official website includes the name of a shopping centre instead of a street name and number. In this situation you should verify the result address using the shopping centre’s official website. The shopping centre’s official address is an intersection that does not include the result street so the result street address can be assumed to be wrong.
The result address is also missing the unit (Shop S196) that appears in the address on the business’s official website.
The address rating should be Incorrect – Unit/Apt, Street Number, and Street Name
Street address components are not required for a POI without an expected address,
like this train station. However, locality-type components (sub-localities, cities, and towns) must still be returned if the POI is small enough to fit entirely within them.
Henderson Station is entirely within Henderson. NZ Post and LINZ Data Service show that two locality-type components are required in this case: Henderson is a sub-locality of Auckland, so the address should include both Henderson and Auckland. Since the result address is just the sub-locality and the city is missing, it should be rated Incorrect – Locality.
See guidelines section 8.3.2 POIs Without an Expected Address.
The pin for VTNZ falls on the business beside VTNZ. The street imagery shows that there is a fence separating the two properties so this is considered Next Door (if they were in a shared parking lot the pin rating is Approximate).
A feature cannot be Next Door to another feature within the same property boundaries. This means that two buildings in the same shared parking lot or the parcel can never be rated as Next Door to one another. Please review GL. 9.1.4. Next Door.
Pin accuracy
The pin for H&M falls on the correct shopping centre but the shopping centre’s floor
directory
(https://www.botanytowncentre.co.nz /centre-map )
shows that H&M is not located where the pin dropped. The pin rating is Approximate because when there is a strong evidence such as a floor directory confirms a business’s specific location under a shared rooftop, only that location will be considered Perfect. Please review GL. 9.2 Single Rooftop section Best Available Evidence for more information.