1)How to rate Relevance when there are many possible results

According to GL 5.6. Many Possible Results, distance is more important than prominence. In other words: When there are many possible results, we are less lenient in terms of distance. The examples in GL 5.6. illustrate this for some scenarios. Similar considerations also apply to queries with location modifiers.

When looking at these examples, we need to be aware that possible results not only

include the highlighted results; the little purple dots are possible results, as well.

We need to take these into account when rating.

 

Query: McDonald’s

Viewport: Fresh, user outside

In this example, there are some possible results within the fresh VP; however, results outside the viewport are still relevant to the user. Some results fall in transition zone between Good and Acceptable.

2)How to rate Relevance when there are few possible results

When there are few possible results, we are more lenient in terms of distance, GL

2.7.Few Possible Results. Consequently, even results rather far away can still be

relevant to the user.

Query: Marriott

Viewport: Missing

While far away from the user, the results in Basel and Luzern are still relevant based on the number and distribution of results in this scenario.

General tip: When doing research, using various zoom levels can reveal possible results that only become visible when zooming in.

3)Name Accuracy: How to rate if the result name is misspelled or incorrect or if the classification is incorrect or missing.

Two factors determine the final name rating: Name of the POI/business and classification. When the classification is wrong, the final Name Accuracy rating is always Incorrect. However, if the classification is missing or listed as N/A, the final rating should not be demoted, GL 6.3. Result Classification.

 

Business/POI Name

Classification

Name Accuracy Rating

Correct

Correct or Missing or N/A

Correct

Correct

Incorrect

Incorrect

Partially Correct

Correct or Missing or N/A

Partially Correct

Partially Correct

Incorrect

Incorrect

Incorrect

Correct, Incorrect, Missing or N/A

Incorrect

Partially Correct Name

According to the section 6.2.2. of the guideline, a partially correct name differs from the official versions but can still be recognized by the user. The name can have minor/moderate misspelling, service level mismatches and missing or unnecessary name parts, including legal entity names (like GmbH, AG, KG, OHG, GmbH & Co. KG, etc.), as well as unexpected use of upper/lower case, missing or added hyphens, missing or added blanks, etc. The table below shows some examples for minor/moderate misspellings that are Partially Correct. Please note that in some cases, they might not be easy to catch, for example the difference between i and l, especially if you lose focus. Please be sure to take regular breaks when rating.

 

Result NameOfficial business nameClassificationReason

Lldl

Lidl

Discounter

Result name uses l instead of i

Aldi

ALDI

Missing

Business consistently uses all caps

ElectronicPartner

GmbH

ElectronicPartner

Elektronik

Corporate structure not used for stores

Cleverfit

clever fit or CLEVER FIT

N/A

Unexpected use of upper/lower case

Berg Apotheke

Berg-Apotheke

Apotheke

Missing hyphen

 

4)Address Accuracy

Natural features

Natural features typically do not have a street address, so they should be returned without any street address components. A locality may be acceptable if it is appropriate for the size of the feature, i.e., if the feature fits entirely within it, GL 8.3.1. Natural Features.

Result

Rating

Walensee

Weesen

Incorrect –Other Issue: The feature is too large to fit entirely within the borders of the locality

Staubbachfall

Lauterbrunnen

Correct: The feature fits entirely within the borders of the locality

 

5) Pin Accuracy: Tricky Cases

.

Result: Evangelische Kirchengemeinde, Kirchgasse 19, 3860 Meiringen

Researching the pin, we find that it lands on Pfrundmattenstrasse 5. Although it falls on the property next to the intended one, this property is located on a different street. In order to be rated Next Door, it would have to be on the same street as the intended property, though. Consequently, the final rating pin accuracy rating is Wrong, GL 9.1.4. Next Door.

Sometimes, a pin might appear to be Next Door, but is actually Wrong. This can happen in scenarios where one of the features is located on a street corner.

Incorrect address listed in the result

In some cases, the listed address might contain an incorrect street number.

According to GL 9. Pin Accuracy, the pin should be a reflection of the result: The location represented by the pin should reflect the result. Pin ratings should be rated individually and not influenced by address or other data. A pin can be correct when other rating components are wrong. In other words: The pin should always fall on the actual location of the POI.

.

Example: POI is listed as located on Hauptstraße 2. Research shows that the correct address is Hauptstraße 4. If the pin falls on Hauptstraße 2, it is rated Next Door. If

it falls on Hauptstraße 4 – the correct address – it is rated Perfect.

6) Lack of Evidence

Whenever we find no reliable sources to verify the accuracy of data, we can’t determine whether the data are correct. In such cases, please rate Can’t Verify and explain your decision in a comment.

.

.

 

.

.

Leave a Reply

Your email address will not be published. Required fields are marked *

Related Post