We wanted to take a moment to share some examples of correct rating for scenarios that are commonly rated incorrectly in Search 2.0 and hope that these examples give you greater confidence when working on this task.
Query: | 107 Collin St West Perth |
Viewport Age: | FRESH |
Viewport Centre: | -31.947796, 115.844114 |
User Location | -31.954692, 115.867175 (outside Viewport) |
Result Name: | 105 Colin Street |
Address: | 105 Colin Street, West Perth WA 6005, Australia |
Classification: | – |
Lat, Lng: | -31.946603, 115.842859 (within Viewport) |
Query address does not exist. Result relevance is Excellent due having a spell correction connection to query and being the closest verified address.
The user is outside the fresh viewport, so results are expected in or near the viewport. An online search for the queried address shows that it does not exist (verified with nationalmap.gov.au). While there is no Collin Street in West Perth, there is a Colin Street, so this street satisfies user intent by correcting the user’s spelling mistake (see GL 5.1.4. Spell Correction Connection). Researching the spell corrected address indicates that the address still does not exist. Using street imagery, we can see that the result address of 105 Colin Street does exist (https://bit.ly/3NGViXj) and that the next address on the street is 111 Colin Street (https://bit.ly/3pcxeBC). As we can confirm that the result address is the closest verified address to the queried address that does not exist, its relevance should be rated as Excellent (see GL 10.3. Query Address Does Not Exist).
Query: | Airport |
Viewport Age: | FRESH |
Viewport Centre: | -33.921429, 151.171781 |
User Location | -33.812929, 151.204449 (outside Viewport) |
Result Name: | T1 International |
Address: | Mascot NSW 2020, Australia |
Classification: | Airport Terminal |
Lat, Lng: | -33.936057, 151.166216 (within Viewport) |
The query is a category query for airports. The result is too specific to satisfy user’s intent and is rated Bad (User Intent)
The user is outside the fresh viewport, so results are expected in or near the viewport. The Guidelines tell us that when a query is clearly for a straightforward category, results must also belong to that category (see GL 10.7.8. Clear Categories). The result is a terminal that is part of Sydney International Airport but is not an airport in its own right. Since the query is a category and the result is a specific terminal and not the airport itself, the correct rating is Bad due to user intent. This example corresponds directly with the airports example in GL 10.7.8.
Query: | massage Adelaide |
Viewport Age: | STALE |
Viewport Centre: | -34.901095, 138.571171 |
User Location | -34.894381, 138.587542 |
Result Name: | Healing Massage Solutions |
Address: | 125 Walkerville Terrace, Walkerville SA 5081, Australia |
Classification: | Massage |
Lat, Lng: | -34.894602, 138.617896 |
Result is a mobile business with no physical location. It has no relevance for maps and is rated Bad (User Intent)
Query is a category query, massage, with explicit location modifier, adelaide (see GL 2.3.1. Explicit Location), so user and viewport locations can be ignored. While this is a massage service near the requested locale, the result’s website (https://bit.ly/42aOplx) clearly shows it is a mobile massage service only with no physical location. GL 10.6.4. Back Offices and Businesses with no Physical Location tells us that “Businesses with no physical location, like mobile locksmiths or mobile dog groomers, have no relevance for maps and are rated Bad”. Therefore, this result should be rated Bad (User Intent) for relevance.
Name Accuracy – Partially Correct
Query: fried chicken alice springs
Result Name: | kfc |
Address: | 90-92 Todd Street, Alice Springs NT 0870 |
Classification: | Fast Food |
Result name is Partially Correct due to unexpected use of lower case.
An online search for this result name and address confirms that the result POI exists at this location and that the classification of Fast Food is correct (https://bit.ly/4157NiE). The result name is written in all lower case rather than all caps as shown on the website, but it is still possible that name could be considered correct, as the Guidelines state that “Even if the official website does not use the name, if it is used on other official sources, the name is correct” (See GL 6.2.1. Correct Name). Further research shows that all sections of the official website (https://www.kfc.com.au/), as well as other official sources like claimed social media (https://bit.ly/42yOUG1) and signage shown in online imagery show that the business always uses all caps in its name. Therefore “kfc” cannot be considered a correct name. The use of lower case does not prevent the user from identifying the business, so should be rated as Partially Correct (See GL 6.2.2.1. Minor and Moderate Misspellings and Missing or Extra Words).
Example
Query:
Result Name: | Woolworths |
Address: | 18 Benjamin Way, Belconnen ACT 2617, Australia |
Classification: | Shopping Center |
Result name is Incorrect due to incorrect classification.
An online search for this result name and address confirms that they are correct (https://bit.ly/3phsbj8). However, it is well known that Woolworths is a prominent Australian supermarket chain. This Woolworths is located in Westfield Belconnen shopping centre, but as the result is clearly just for Woolworths and not the entire shopping centre, the classification should be considered incorrect. The Guidelines state that “when the classification is wrong, the final Name Accuracy rating is always Incorrect” (See GL 6.3.2. Incorrect Classification). Therefore, the result name should be rated as Incorrect.
Address Accuracy – Correct with formatting issue
Query: Target
Result Name: Target
Address: Gympie Road, Chermside Shopping Centre, Chermside QLD 4032, Australia Department Store
Classification: Departament Store
Result address is Correct with formatting issue due to components in unexpected order.
The website for this Target shows that the official address uses a shopping centre name instead of a street number to specify its location (https://bit.ly/3p9P9sx). The result address with the street name before the shopping centre name neither matches the official website nor aligns with expected Australian address conventions. GL 7.6. Correct with Formatting Issue tells us that “Formatting issues include the order of address components and other minor issues that are not necessarily considered wrong.” As all components of the result address are correct but are in an unexpected order, it should be rated as Correct with formatting issue.
Query: park
Result Name: Rosalind Park
Address: Rosalind Park, 30 Gaol Road, Bendigo VIC 3550, Australia Park
Classification: Park
Result address is Incorrect due to POI name reappearing in address details.
The webpage for this park on Bendigo’s official local government website shows that the result address matches the park’s official address (https://bit.ly/3NKdSOC). However, GL 7.5. Other Issue tells us that the Incorrect – Other Issue checkbox should be used for instances that include “Name of POI reappears in the address details”. As the result address includes the name of the park, it should be rated as Incorrect – Other Issue.
Query: airport
Result Name: Sydney Airport
Address: Robey Street, Mascot NSW 2020, Australia
Classification: International Airport
Result address is Incorrect as the POI does not have an official address and the returned street does not provide access.
Airports are part of the subset of POIs that do not require a full address – the locality is sufficient in this case (see GL 8.3.2 POIs Without an Expected Address). The result address contains a street, but research (including the airport’s official website https://bit.ly/44C1UMI) shows that the POI does not have an official address. GL 8.3.2.3. No Official Address tells us that “When there is no official address the returned street address cannot be confirmed and therefore cannot be considered correct.” It also states when the result address is just a street (where an official address does not provide it) it should be rated Can’t Verify if the street provides access to the intended POI. Robey Street is just a street near Sydney Airport, but does not provide direct access to it, so the result address should be rated as Incorrect – Street Name (see Charles de Gaulle Airport example in GL 8.3.2.3.).
Result Name: Gold Coast Airport
Address: Gold Coast QLD 4225, Australia
Classification: International Airport
Result address is Incorrect due to an incorrect locality.
The result address does not give a street address, but airports are not expected to show a street address (see GL 8.3.2. POIs Without an Expected Address), so this is not an issue. However, research (including the airport’s official website https://bit.ly/3o0xdfH) shows that the correct locality for Gold Coast Airport is Bilinga, not Gold Coast.
Therefore, the address should be rated Incorrect – Locality (see GL 7.1.5. Locality).
Address Accuracy – Can’t Verify
Quer: doggrooming kenmore
Result Name: | Rosie Pets |
Address: | 35 Katunga Street, Kenmore QLD 4069, Australia |
Classification: | Pet Grooming |
Result address is rated Can’t Verify due to POI being a mobile business.
Query is a category query, dog grooming, with explicit location modifier, kenmore (see GL 2.3.1. Explicit Location). While this is a dog grooming service in the requested locale, the result’s website (https://bit.ly/3LHSGG6) clearly shows it is a mobile service only with no physical location. GL 10.6.4. Back Offices and Businesses with no Physical Location tells us that “For these types of results, rate the address accuracy according to the official website or consensus of three sources, otherwise rate Can’t Verify.” The official website does not give an address and there is no consensus among other official or reliable sources – Facebook just gives a locality Graceville (https://bit.ly/3B34jmd), Instagram does not give an address (https://bit.ly/3HMmobY) and claimed Yelp page gives address of Oxley Rd, Brisbane (https://bit.ly/3NIPInm). Therefore, this address result should be rated as Can’t Verify.