1. Introduction

This document explains the Maps Search Query Intent evaluation. In this evaluation, you will be shown queries from the Maps Search Evaluation and asked to indicate the type of result the user most likely expects to receive. This expected result type is also known as the Query Intent. You will also indicate if the query contains any information indicating where the expected result should be or any misspellings

2.Task Interface and Questions

This is the web-based rating tool used in the Query Intent evaluation.

As in the Maps Search Task, a user location and viewport will be displayed. In this task, the user location will be indicated by a red pin rather than the yellow bust + star icon.

In this task, you will answer several questions from the following list:

  • What type of result is the user expecting?
  • What type of POI is the user most likely expecting?
  • Which of the following categories best applies to the user query?
  • Select All Address Components Within the query.
  • Are there any additional elements indicating where the expected result should be located?
  • Select all elements within the query that are used to indicated the location of the expected result.
  • Query Contains Misspelling

The specific questions answered depends on your answers. If the query is expecting a POI, you will be required to indicate the type of POI expected. If the query is a POI or Natural feature, you will be required to indicate if the POI has any additional elements that indicate where the expected result should be located and, if it does, select all of those elements. For queries that are expecting an address result, you will check all address elements that are in the original query. For queries where the expected result type is “Other”, you will indicate which category best applies to the user query.

3.Query Intent and the Expected Result Type

To determine query intent and answer the question What Type of Result is the User Expecting?, use a combination of your own research and local knowledge plus information found in the rating interface, which includes:

  • User location
  • User viewport
  • Viewport freshness

In this task, queries will be classified as likely expecting one of four result types.

Result TypeExplanationExamples
POIPOI queries expect a business or other POI type to be returned as a result for the query. Queries that expect a business or POI may be searches for a specific business or POI, searches for a prominent chain business, or searches for a type or category of POI. Government operated buildings and locations are also considered POIs (city halls, parks, libraries, etc). These queries may sometimes have additional information (addresses or proximity modifiers) within the query to help indicate the location of the expected result.– McDonalds 824 3rd Avenue, 50th St, New York,
– NY 10022 Bi-rite Creamery Japanese
– Bus Station 94110
– Yosemite National Park
Result TypeExplanationExamples
AddressAddress queries expect an address to be returned as a result. Address queries will contain all or part of a complete address, including street number, street name, locality, state, country, and postal code. Address queries should only contain parts of an address. Queries that contain a POI or category in addition to an address should not be classified as an address query.– 100 Market St
– Mission St
– Greater London
– San Francisco Bay Area
– Berlin
– 94110
– V6J 2H9 33rd and Ortega
– 824 3rd Avenue, 50th St, New York, NY 10022
– 100-0 33rd St
Natural FeatureThe expected result is a naturally existing feature such as rivers, lakes, beaches, mountains and forests, bays, peaks, and islands that are non-addressable points. Do not include parks as a natural feature.– Mount Everest
– Mississippi River
– Lake Erie
– Bondi Beach
– San Francisco Bay
– Ellis Island
OtherThe user query is expecting a result that does not fit under the other query types or the user query does not have an intent that can be resolved by a Map application. Queries with an ambiguous intent or queries that are equally likely to expecting multiple result types are also classified as Other.– McDonalds to Freeman High School
– 37.39451,-122.04824
– 98
– amazon.com

Some queries may be for a non-existent entity or a closed business. Your Query Intent rating should assume that the entity exists. For example, if the user searches for “Steve’s Barbecue” and your research indicates that there was a business near their location named “Steve’s Barbecue” but it closed two years ago, the correct answer is still POI. Similarly, if the user searches for an address that does not exist, the correct answer is still Address

3.1. Query Intent Examples

QueryUser Location or Fresh Viewport CenterpointQuery IntentExplanation
3074 sw 29th topeka ksn/aAddressThis query only contains an address. The user is expecting to have this address returned as their result.
Bank of america39.068246, -94.613039POIThis query is for “Bank of America”, a major chain of banks. This is a type of business or POI.
Tonys auto shop dorchester ma42.37836,-71.05930POIThis query is expecting to have an auto repair shop returned as a result. This is a type of POI.
34.05253,-118.310 3634.05253,-118.3103 6OtherThis query is for a latitude and longitude. It does not fit under address or POI. The best answer for a query like this is Other.
QueryUser Location or Fresh Viewport CenterpointQuery IntentExplanation
James River37.605992, -77.5073Natural FeatureThe user’s location/fresh viewport centerpoint indicates a location in Richmond, VA. The James River is a prominent river that flows through Richmond, VA. Based on this query and the user location, it’s likely they are expecting a Natural Feature result.
My Location35.56880,-82.63801OtherQueries that are for any variant of a reference to the user’s position are classified as “Other”.

4.Result Sub-Types

4.1. POI Sub-Types

If a query is expecting a POI, you will be asked What type of POI result is the user most likely expecting?
Result Sub TypeExplanationExample Queries
Chain or Brand POIThe expected result is for a location of a business or similar entity that has more than one location. Chain or Brand should be selected as the query intent even if the query contains information pointing at a specific location of the chain or brand.
 Note: Brand refers to a brand of STORE. Brands sold in stores should only be considered a Chain or Brand POI if that brand also has dedicated stores. For example, Godiva is a chocolatier whose chocolates can be bought at super markets and their own branded stores. It is a Chain or Brand POI. Heinz is a popular brand of ketchup that is sold in grocery stores. Unlike Godiva, there are no dedicated Heinz stores. Because of this, it is not a good fit for a “Chain or Brand POI”.Pete’s Coffee McDonalds 824 3rd Avenue, 50th St, New York, NY 10022 Dollar General in Richmond, VA Godiva Chocolate
Single Location POIThe expected result is for a unique business or man-made attraction that has a single location. Queries for a specific location or branch of a business/entity that has multiple location should not be classified as Single Location POIs.San Francisco General Hospital White House Central Park Bi-rite Creamery Rainbow Grocery
CategoryThe query indicates a type of business or place expected as a result but does not specify a specific business or chain of businesses.Fast Food Bus Station 94110 Hiking Trails in Yosemite National Park Japanese Heinz ketchup

4.2.Other Sub-types

If  you answer the expected result type question with Other, you will be asked Which of the following categories best applies to the user query?
Result Sub TypeExplanationExample Queries
User LocationThe query contains only a request for the user’s location.Where am I My location Current address Near by Near me
CoordinatesThe query is latitude and longitude coordinates.•       37.39451,-122.04824
Routing RequestThe query is requesting directions from one location to another.• McDonalds to Freeman High School
Multiple Possible Intent TypesThe intent could be satisfied with multiple equally likely result types and it is unclear which one is the primary intentGolden Gate 98
Non-MapsA query that cannot be satisfied by results returned on a Map.
 All URLs should be classified as having a Non-Map Query Intent.amazon.com pokndag why does my dog keep barking gumbo recipe
Other – MapsOther-Maps The query indicates something that you would expect to be able to search for on a map but does not fit into any other option.• Missing peak trail Milpitas
Can’t TellThe query is too unclear to make a distinction on its intent and if the user expected a result from a Map application.as dosdd 10

4.3.Sub-Type Examples

QueryUser Location or Fresh Viewport CenterpointQuery IntentSub-typeExplanation
Bank of america39.068246, -94.613039POIChainBank of America is a major bank in the United States and operates many locations. You should select Chain for any business where the expected result is part of a chain.
Tonys auto shop dorchester ma42.37836,-71.05 930POISingle Location POIResearch indicates that there are several auto related businesses with similar sounding names in the Dorchester area. However, there is no evidence that these businesses are related. While there could be several good results, the user is expecting results that are not part of a chain or business. The best sub-type answer is then Single Location POI.
kholes34.05253,-118.3 1036POIChainWhile this query has a misspelling, it is clear that the user is looking for “Khol’s”. Khol’s is the largest department store chain in the US. Even if there is a single best result based on the user’s location or query, because the expected result is part of a chain, the best answer for sub-type is Chain.
QueryUser Location or Fresh Viewport CenterpointQuery IntentSub-typeExplanation
My Location35.56880,-82.6 3801OtherUser LocationBased on the query, the user is most likely trying to get their own location shown on the map. This is not clearly expecting a POI or an Address. It best fits under the sub-type option “User Location”.
37.605992, -77.5073n/aOtherCoordinatesThe user has entered latitude and longitude coordinates.

5. Parts of an Address

If a query is expecting an Address result, you will be asked to check all parts of an address that are present in the query

Address ElementExplanationExample Queries with Element Highlighted
Street NumberThe number typically included within a postal address to indicate a specific building on a street.1600 Pennsylvania Ave McDonalds 1560 Broadway, New York, NY 10036 116 Queen St 28516 100 – 0 33rd Ave
Address ElementExplanationExample Queries with Element Highlighted
Unit/Apt/ Room NumberA number indicating a specific unit, apartment, room or similar entity within a complex at a single street address. Similar style address elements may also be classified in the Unit label (staircase, floor level, etc).473 Via Ortega, Room 397 253 W 47th St #1, New York, NY 10036
Street NameThe name of a road or street.1600 Pennsylvania Ave McDonalds 1560 Broadway, New York, NY 10036 116 Queen St 28516 253 W 47th St #1, New York, NY 10036
BuildingThe name of a building that is included as part of an address. Building names are uncommon address components in many locales. Stand alone building names (not included as part of an address) are considered POIs.Kunal Icon Pimple Saudagar, Aundh Camp, Pune-411027
Sub- LocalitySub-localities are geographic areas smaller than the city/town level. Common sub-localities are neighborhoods and city districts.Etobicoke, Toronto Northern Quarter Manchester, Manchester Downtown San Francisco
Postal CodeThe code used by the postal service in mail delivery.McDonalds 1560 Broadway, New York, NY 10036 116 Queen St 28516 Maidstone ME17 1PL, UK
LocalityA town, city or municipality level of division, generally below county and state level.McDonalds 1560 Broadway, New York, NY 10036 4800 Forest Hill Ave, Richmond, VA 23225 Northern Quarter Manchester, Manchester
Address ElementExplanationExample Queries with Element Highlighted
Region/ State/ Province/ PrefectureAn administrative district beneath the country level that is larger than the locality level.McDonalds 1560 Broadway, New York, NY 10036 4800 Forest Hill Ave, Richmond, VA 23225 142 Nash Grove Lane, Wokingham, RG40 4HF
CountryAn independent nation as typically seen in addressing at the above state/region/ province level.McDonalds 1560 Broadway, New York, NY 10036, USA 4800 Forest Hill Ave, Richmond, VA 23225, USA 142 Nash Grove Lane, Wokingham, RG40 4HF, United Kingdom
Other AboveLocalityAny other administrative region that is larger than a locality (ex. districts)San Francisco Bay Area, California West Coast USA Asia
IntersectionAn intersection of two streetsMission St and Cesar Chavez, San Francisco
OtherAny other part of an address that does not fit into the provided categories. 

6.Additional Elements Indicating Location

POI and Natural Feature result queries may contain additional elements that indicate where the expected result should be located. For example, the query McDonalds 824 3rd Avenue, 50th St, New York, NY 10022 is expecting a McDonalds at or near to 824 3rd Avenue.

Whenever you indicate that a query is expecting a POI or an Natural Feature type result, you will also indicate if the query has any elements indicating where the expected result should be located.

If you indicate it has any of these elements, you will be shown a list of all result sub-types and address elements. Check ALL elements that apply that are used to indicate the expected location of the result.

7. Misspellings

You may come across some queries that have misspellings in them. If you find a query that has a misspelling, please indicate that it is misspelled by checking “Query Contains Misspelling”.

We do not consider the following misspellings:

  • Official Acronyms/Abbreviations
  • Missing capitalization

Common types of errors are missing characters, spacing errors, missing diacritics/accent marks, and generic typos.

8.Foreign Script/Language Queries

In some cases, you may run across a query in a foreign language/script. Please select the checkbox “Foreign Language/Script Query” to indicate the query contains a foreign language/script and use an online translation service and research to understand the query’s intent.

9.Examples

QueryUser Location or Fresh Viewport CenterpointQuery IntentSub TypeParts of an Address OR Location Indicating ElementsExplanation
West ave baptist church, burlington40.82630, -91.165POISingle Location POI ✓ LocalityBased on the user’s location and query, we can determine that the user is looking for West Ave Baptist Church, a single location POI. The user has provided “Burlington” as an element to help indicate a location of their expected result. Researching this query and the user’s location shows that, in this context, Burlington is being used as a locality.
QueryUser Location or Fresh Viewport CenterpointQuery IntentSub TypeParts of an Address OR Location Indicating ElementsExplanation
Petco Animal Supplies, 4600 Hardy St #23a, Hattiesbur g, MS 3940131.32271, -89.37298POIChain or BrandStreet Number Street Name Unit Number Locality ✓ Region/ State/ Province Postal CodeWhile this query is clearly looking for a specific location of a Chain, any query for a business that is part of a chain should be indicated as having a Chain or Brand Sub-Type. The address provided indicates where the Petco result should be near or at. Each part of the address included should have it’s corresponding component checked in the Location Indicated Elements checkboxes.
Food near me47.61528,-12 2.31135POICategory✓ User LocationThis query is looking for POIs that fulfill the broad category of “food”.
 Near Me is a location indicating element that results in the User Location option checkbox being selected.
QueryUser Location or Fresh Viewport CenterpointQuery IntentSub TypeParts of an Address OR Location Indicating ElementsExplanation
Atelier bakery on trade36.09006, -80.29448POISingle Location POI✓ Street NameResearch indicates that Atelier Bakery is or was a bakery located in North Carolina. It looks like the location may have moved several times but the business is not/ was never part of a chain/multilocation business. The best answer for this query then is to label it as a Single Location POI. This query has “on trade” providing context to where the expected result should be located. Here, research shows that Trade is part of a street name.
Mount pleasant high san jose37.36861,-12 1.91067POISingle Location POI✓ LocalityResearch indicates that there is a “Mt. Pleasant High School” located in San Jose, CA. The query is looking for this school with “San Jose” provided as additional elements to indicate an expected result location.
QueryUser Location or Fresh Viewport CenterpointQuery IntentSub TypeParts of an Address OR Location Indicating ElementsExplanation
Straits of tarran28.66217, 34.08916Natural Feature  The Straits of Tiran are a set of narrow sea passages near the Red Sea. The user is expecting to have a Natural Feature (sea passage) returned as a result.
 Note: Research shows the correct spelling for this query is Tiran rather than Tarran. This query should be marked as having a misspelling.
1151 N Azusa Ave, Covina, CA 9172234.17822, -118.37905Address Street Number Street Name Locality ✓ Region/ State/ Province Postal CodeThis query contains only information on an address. The user is expecting an address result back. You will need to select all parts of the address that are present in the query.

Leave a Reply

Your email address will not be published. Required fields are marked *

Related Post