Maps Search

IP
m s
Evaluation Guidelines
ro r
March 2024
0 2 4 f Deve
2 e l
1. Introduction ..............................................................................................................................................5
2, ha Tu
ril Mic es
1.1.The Rating Tool ....................................................................................................................................................................................................5
p 1
1.2.Rating Workflow y A
, 6b y 7 2.1 day,
...............................................................................................................................................................................................11
a .
esd .254 6.2 Ap
1.3.Rating Interface 54 ril 2
Tu .................................................................................................................................................................................................13
6
1 .6
2
1.3.1.Query-Level17Navigational by , 202
Result Question.................................................................................................................................................14
Mi
cha 4 fro
1.3.2.Result-Level Rating Checkboxes ...................................................................................................................................................................14
el D m I
1.3.3.Result Relevance Rating ..................................................................................................................................................................................15
eve P
1.3.4.Result Relevance Demotion Checkboxes ...................................................................................................................................................17
rs
1.3.5.Data Accuracy ...................................................................................................................................................................................................17
1.3.6.Comments ..........................................................................................................................................................................................................17
2. Understanding User Intent .......................................................................................................................18
2.1.Query Types .......................................................................................................................................................................................................18
2.1.1.Research Expectation .......................................................................................................................................................................................22
2.2.Result Types .......................................................................................................................................................................................................22
2.3.Location Intent ..................................................................................................................................................................................................23
2.3.1.Explicit Location ................................................................................................................................................................................................24
2.3.2.Implicit Location ..............................................................................................................................................................................................24
3. Rating the Query-Level Navigational Result Question ...............................................................................25
4. Rating Result-Level Issues ........................................................................................................................25
4.1.Result Name/Title in Unexpected Language or Script.....................................................................................................................25
4.1.1.Name of Business/POI Results ........................................................................................................................................................................27
4.1.2.Title of Address Results ....................................................................................................................................................................................30
4.2.Business/POI is Closed or Does not Exist .............................................................................................................................................30
4.2.1.Closed/Does Not Exist vs. Inaccurate Name and Address......................................................................................................................31
4.2.2.Rating Relevance of Closed/Non-Existing Business/POI .......................................................................................................................31
4.3.Business/POI Status is PERMANENT_CLOSURE ................................................................................................................................31
4.3.1.No Status Shown ..............................................................................................................................................................................................32
4.3.2.Status Shown as PERMANENT_CLOSURE .................................................................................................................................................32
5. Relevance ................................................................................................................................................32
5.1.Query-Result Connection..............................................................................................................................................................................33
5.1.1. General Connection .........................................................................................................................................................................................34
5.1.2. Abbreviation/Alternate Name Connection ..............................................................................................................................................34
5.1.3. Category Connection .....................................................................................................................................................................................34
5.1.4. Spell Correction Connection .........................................................................................................................................................................35
5.1.5. Transit Intent Connection ..............................................................................................................................................................................35
5.1.6. Special Character Connection ......................................................................................................................................................................35
5.1.7. Address-Result Connection ............................................................................................................................................................................36
5.1.8. Lack of Connection .........................................................................................................................................................................................36
5.2. Satisfying User Intent ....................................................................................................................................................................................38
5.3.Prominence.........................................................................................................................................................................................................39
5.4.Distance ................................................................................................................................................................................................................40
5.5.Distance vs. Prominence ...............................................................................................................................................................................42
5.6.Many
Tu Possible Results ....................................................................................................................................................................................42 IP
e r o m rs
5.7.Few
17 sPossible ve
Results.......................................................................................................................................................................................45
f
2.1 day, 0 24 l De
5.8.Few Possible
6.2 A Results and Greater Distance ..........................................................................................................................................46
2 e
2, ha
54 pr.........................................................................................................................................................................................................47
5.9.Rural Areas .6 il 2, 2 p ril Mic
5.10.Location –byUser Mi Intent02
4 d a y, A .6 by
Deviation ............................................................................................................................................................48
5.11.Rating for UsercInside ha froand 4
Outside Viewport ...................................................................................................................................49
e m T ues 6.25
5.12.Partial Address Does l DNot Exist
eve P ................................................................................................................................................................51
I 1
1 72.
5.13.City vs. Municipality .....................................................................................................................................................................................52
rs
5.14.Unexpected Results ......................................................................................................................................................................................52
5.15. Multiple Transit POIs with the Same Name ......................................................................................................................................54
5.16.POIs and Transit Intent ...............................................................................................................................................................................55
5.16.1.Transit Queries .................................................................................................................................................................................................56
IP
5.16.2.Stops vs. Stations ............................................................................................................................................................................................59
r o m rs
0 2 4 f Deve
5.17.Parking Intent .................................................................................................................................................................................................61
5.18.Relevance: Service-Level2Mismatch , 2 hael ......................................................................................................................................................61
Tu
i l c
5.19.Rating Relevance When p Result
r Mi Status is PERMANENT_CLOSURE ...........................................................................................64
1 es
a y A
, 6b
5.19.1.Expected PERMANENT_CLOSURE .
y
Status
7 2.1 day,
..................................................................................................................................................64
d s 4 25 pril 6 A .
e .25
5.19.1.1.Expected
Tu .16PERMANENT_CLOSURE Status: Navigational Query......................................................................................................66
4.6 2
5.19.1.2.Expected by , 20
72 PERMANENT_CLOSURE Status: All chains closed in area ............................................................................................68
1 2 Mi
ch 4 fr
5.19.2.Unexpected PERMANENT_CLOSURE Status ............................................................................................................................................69
ael om
5.19.2.1.Unexpected PERMANENT_CLOSURE Status: Open Options are Nearby ....................................................................................70
De IP
ver
6. Name and Category Accuracy ...................................................................................................................71
s
6.1.Name Not Applicable (n/a) .........................................................................................................................................................................71
6.2.Result Names .....................................................................................................................................................................................................72
6.2.1. Correct Name ....................................................................................................................................................................................................72
6.2.2. Partially Correct Name ..................................................................................................................................................................................76
6.2.2.1. Minor and Moderate Misspellings and Missing or Extra Words .....................................................................................................76
6.2.2.2. Service-Level Mismatch ....................................................................................................................................................................................79
6.2.2.3. Holding Name and Corporate Structure ....................................................................................................................................................79
6.2.3. Incorrect Name................................................................................................................................................................................................80
6.3 Result Category .................................................................................................................................................................................................82
6.3.1. Correct Category ..............................................................................................................................................................................................83
6.3.2. Incorrect Category..........................................................................................................................................................................................84
6.4. Can’t Verify .........................................................................................................................................................................................................86
6.5 Transit Names ...................................................................................................................................................................................................86
6.6. Parking Names .................................................................................................................................................................................................87
6.7. Final Name and Category Accuracy Rating (Summary Table) .....................................................................................................88
7. Address Accuracy: Components and Issues ..............................................................................................89
7.1.Address Components .....................................................................................................................................................................................89
7.1.1.Street Number .....................................................................................................................................................................................................89
7.1.2.Unit/Apt................................................................................................................................................................................................................91
7.1.3.Street Name ........................................................................................................................................................................................................92
7.1.4.Sub-Locality and Administrative Subdivisions ..........................................................................................................................................93
7.1.5.Locality .................................................................................................................................................................................................................94
7.1.5.Region or State...................................................................................................................................................................................................94
7.1.6.Postal Code .........................................................................................................................................................................................................95
7.1.7.Country .................................................................................................................................................................................................................95
7.2.Address Does Not Exist .................................................................................................................................................................................96
7.3.Language/Script Issue in Address ............................................................................................................................................................96
7.4.Country-Specific Issue ...................................................................................................................................................................................97
7.4.1.Country-Specific Issue vs. Correct with Formatting Issue .......................................................................................................................97
7.5.Other Issue ..........................................................................................................................................................................................................97
7.6.Correct with Formatting Issue ...................................................................................................................................................................98
7.7.Can’t Verify ..........................................................................................................................................................................................................98
7.7.1.Can’t Verify for Street Number ........................................................................................................................................................................99
7.7.2.Can’t Verify for Street Name ...........................................................................................................................................................................99
8. Address Accuracy: Result Expectations ...................................................................................................100
8.1.Business/POI
Tu Result ....................................................................................................................................................................................100 IP
e r o m rs
s
18.71.1.Business/POI f ve
2.1 day, Address Research and Resources .......................................................................................................................................100
0 24 l De
6.2 A
8.1.2.Alternative 2
Official Addresses ......................................................................................................................................................................101
, a e
54 pril 2
8.1.2.1.Department Addresses r il 2 Mich
....................................................................................................................................................................................101
.6 ,2 p
by Missing
8.1.2.2.Result
d a y, A .6 by
Mi 024 the Street Address ..............................................................................................................................................................103
cha frAddresses,
8.1.2.3.P.O. Box, Mailing es 54
and Management Offices ......................................................................................................................104
el D om I Tu .16.2
8.1.3.Businesses/POI with Moving eve P Locations ....................................................................................................................................................105
172
8.1.4.Events .................................................................................................................................................................................................................105
rs
8.2.Address Type Results ..................................................................................................................................................................................106

2
 8.2.1.Address Result..................................................................................................................................................................................................106
8.2.2.Address Formats ............................................................................................................................................................................................106
IP
8.2.3.Street Result ....................................................................................................................................................................................................107
r o m rs
0 2 4 f Deve
8.2.4.Locality Result.................................................................................................................................................................................................107
l
i l 2, 2 ichae
8.2.5.Postal Code Result .........................................................................................................................................................................................108
Tu
8.2.6.State/Region/Territory r
p Result es
M .....................................................................................................................................................................108
1
A
y, .6 b y 7 2.1 day,
8.2.7.Country Resultd.................................................................................................................................................................................................108
a
es .25Expected 4 6.2 Ap
8.3.Features Without
Tu .16an Address ..............................................................................................................................................108
54 ril 2
.6
8.3.1.Natural Features by , 202
172 .............................................................................................................................................................................................108
Mi
ch 4 fr
8.3.2.POIs Without an Expected Address ...........................................................................................................................................................110
ael m o
8.3.2.1.Minimum Address Component ....................................................................................................................................................................110
De IP
8.3.2.2.Official Address Present ..................................................................................................................................................................................111
ver
s
8.3.2.3.No Official Address ............................................................................................................................................................................................113
9. Pin Accuracy ..........................................................................................................................................115
9.1.General Considerations ..............................................................................................................................................................................116
9.1.1.Pin Resources .....................................................................................................................................................................................................116
9.1.2.Satellite Imagery vs. Vector Map .................................................................................................................................................................116
9.1.3.Boundaries of the Feature .............................................................................................................................................................................117
9.1.3.1.Half ’n Half and Tennis Rules.........................................................................................................................................................................118
9.1.3.2.Boundaries in Shared Spaces ........................................................................................................................................................................120
9.1.4.Next Door ..........................................................................................................................................................................................................122
9.1.5.Can’t Verify (Smallest Identified Area) .......................................................................................................................................................123
9.2.Single Rooftop .................................................................................................................................................................................................124
9.2.1.Leaning Buildings ...........................................................................................................................................................................................139
9.2.2.Residential Property with Multiple Buildings .........................................................................................................................................141
9.3.Multiple Rooftops ..........................................................................................................................................................................................142
9.3.1.Multiple-Rooftop Rating ...............................................................................................................................................................................143
9.3.2.Campus Rating...............................................................................................................................................................................................149
9.3.2.1.Single-Complex Campus ..................................................................................................................................................................................151
9.3.2.2.Dispersed Campus .............................................................................................................................................................................................154
9.4.Features Without a Rooftop ......................................................................................................................................................................157
9.4.1.Natural Features ..............................................................................................................................................................................................157
9.4.2.Administrative Divisions ..............................................................................................................................................................................160
9.4.3.Streets ................................................................................................................................................................................................................161
9.5.Parking Lots and Structures .....................................................................................................................................................................163
9.6.Transit POIs .....................................................................................................................................................................................................164
9.6.1.Bus, Tram, and Streetcar Stops ....................................................................................................................................................................166
9.6.2.Transit POI with Multiple Rooftops/Platforms .......................................................................................................................................167
9.6.3.Transit POIs with a Single Rooftop............................................................................................................................................................170
9.6.4.Underground Transit Stations ....................................................................................................................................................................170
9.6.4.1.How to Establish an Entrance Polygon .....................................................................................................................................................171
9.6.4.2.Examples ................................................................................................................................................................................................................172
10.How to Rate Results ..............................................................................................................................176
10.1.Specific Address ..........................................................................................................................................................................................176
10.2.Non-Specific Address ................................................................................................................................................................................191
10.3.Query Address Does Not Exist ..............................................................................................................................................................199
10.4.Point of Interest ...........................................................................................................................................................................................201
10.5.Understanding Multiple Query Interpretations Beyond Viewport and User Location ................................................204 IP
TBusiness
10.6. ues Queries m rs
........................................................................................................................................................................................208
o
17 da f r ve
10.6.
2.11. Non-Chain
y, A 24 l De
Businesses ................................................................................................................................................................................209
2 0
10.6.2.6.Chain
25 pBusinesses , a e
.........................................................................................................................................................................................212
4.6 ril 2, p r il 2 Mich
10.6.3. Chain bBusiness2 with Location Modifier .................................................................................................................................................216
,A y
y
2
Mi Location 0 y b
10.6.3.1. General sda 254.6
cha 4 fro Modifier ..........................................................................................................................................................................216
u e
10.6.3.2. Specific Location T 16.
el mModifier ..........................................................................................................................................................................224
I .
De P with No Physical Location ..................................................................................................................228
10.6.4. Back Offices and Businesses
ver 172
s
10.6.5. Business Does Not Exist.............................................................................................................................................................................230
10.7. Category Queries .......................................................................................................................................................................................231
3
 10.7.1. Demotion for Distance with User Inside Viewport ..............................................................................................................................232
10.7.2. Demotion for Distance with User Outside
IP Viewport .........................................................................................................................234
10.7.3. Demotion for Distance with Fewer mPossible s Results ..........................................................................................................................236
10.7.4. Category Queries and User Intent 4 fro..........................................................................................................................................................238
e ver
2 D
2 , 20 hael ........................................................................................................................................................239
10.7.5. Category Queries and Prominence Tu
l c
10.7.6. Category Query with priLocation Mi Modifier ...............................................................................................................................................239
1 es
A
10.7.7. NavigationaldResults
a
y 7 2.1 day,
y, .6forb Category Queries ...........................................................................................................................................241
es 54 6.2 Ap
10.7.8. Clear Categories 54 ril 2
Tu .16.2..........................................................................................................................................................................................245
.6
10.7.9. Soft Categories by , 202
172 .............................................................................................................................................................................................246
Mi
cha 4 fro
10.7.10 Category Query: Parking ...........................................................................................................................................................................251
10.8. Rating Results with PERMANENT_CLOSURE Status ..................................................................................................................255 el D m I
eve P
10.8.1. Expected. PERMANENT_CLOSURE Status..............................................................................................................................................255
rs
10.8.2. Unexpected PERMANENT_CLOSURE Status .......................................................................................................................................256
10.9. Other Query Types ....................................................................................................................................................................................258
10.9.1. Routing Queries ......................................................................................................................................................................................258
10.9.2. Coordinate and “My Location” Queries .................................................................................................................................................260
10.10. Unclear Results ........................................................................................................................................................................................262
11.Top Rating Tips ......................................................................................................................................269
11.1.What’s the relevance when query is business/POI name and address and the result is only the address? .......269
11.2.What’s the relevance when the query is a street name and the result is a single business on that street? ........269
11.3.How do I know what the location intent is when user is outside/inside a fresh viewport?......................................270
11.4.How do I know what the location intent is when user is outside/inside a stale viewport? ......................................271
11.5.This full address result does not exist. How do I rate it? ...........................................................................................................271
Appendix: Release Survey ..........................................................................................................................273

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

4
1. Introduction
IP
ro m rs
Welcome to Maps Search Evaluation. 4 f DevThese
e guidelines will teach you how to use the evaluation tool
0 2 l
and rate Maps Search results. 2, 2
ha
e
Tu
p ril Mic 1 es
y A
, 6b y 72.1 day,
For each task, you awill be presented with a search query and the results
. 6.2 that
A are provided to Maps
esd .254 54 pril 2
Tu of
users. The goals .1 6this task are: . 6b ,2
172 y M 024
ich fro
• Search Relevance and Search 2.0: To determine how well the results satisfy ael the
m user’s
De IP
query (result relevance) ver
• Search 2.0 only: To check the data accuracy (name, address, and pin location) of sthe results

1.1. The Rating Tool

This is the web-based rating tool used to rate Search 2.0 and Search Relevance queries.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

5
Anatomy of the Tool
IP
ro m rs
0 2 4 f Deve
Name ,2
Screenshot el Description
r i l 2 icha Tu
p
, A 6 by
M 17 esda
a y . The task bar shows: 2.16 y, A
esd 54 .25 pri
Tu .16.2 4.6 l 2,
2
172 • Task Type: The name of the by task.
Mi 024
• Task ID: A number that identifiesc fr
ha the
el D om I
specific task item. Use this number ev P
e
whenever you communicate about a rs
task or rating.
Task Bar • Request ID: A reference number for
internal use only. Do not use this
number to communicate about a
task or rating.
• Estimated Rating Time: Time to
rate all results

Rating The Rating Guidelines shortcut button

Guidelines opens the guidelines for this task.

Allows you to skip a survey in rare cases

Release where a technical or other issue prevents
Survey you from rating. See Appendix for
complete instructions.
Viewport shortcut buttons provide
convenient controls to pan or zoom to
common map viewport settings. Show
Show User
User moves the result viewport to the
user’s location without changing the zoom
level (map scale).

Show Viewport moves the result

Show viewport to the center of the user
Viewport viewport and zooms in on the viewport
area.

Use Show All to return from any zoom

Show
Tu All level to the initial display showing the IP
o m rs
e
17 sda user, the viewport, and all the results. f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

6
 Name Screenshot Description
IP
ro m rs The query header shows:
2 4 f Deve
,2 0 el Query: The term the user entered into the
r i l 2 icha search bar. Tu
p
, A 6 by
M 17 esda
a y . Viewport Age: How long 2.1 ago
6.2 , Apthe user
y
esd 54 moved the viewport. 54 ril 2
Tu .16.2 .6 ,2
172 • A fresh viewport is indicated by by
Mi the
02
4
word FRESH displayed in greenhae from
c
text. l D IP
Query eve
• A stale viewport is indicated by the rs
Header
word STALE displayed in red text.
Locale: The country and language
combination this query is for.
Country: Should match the country in the
Locale field. If it does not, defer to the
country found in the Locale field.
User Lat,Lng: The user’s location.

Top-Level A top-level question that must be

Question answered once for each query.

The result returned for a user query.

The color of the result heading

corresponds to the color of the pin on the
map that marks that result’s location. (See
Result Pin on page 9.)

The result address, category and status (if

included) will be shown beneath the result
Result
name/title.

You will evaluate the relevance of each

individual result. If you are rating Search
2.0, you will also rate the name/address/
pin accuracy for each result.

Note: A query can generate more than

one result. IP
Tu o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

7
 Name Screenshot Description
IP
ro m rs
0 2 4 f Deve
,2 el
r i l 2 icha A result may also display
Tu its status. If the
esd
p M 1
y , A 6 by status appears and is2set
7
.16 to
ay,
a . Ap
Status uesd .254 PERMANENT_CLOSURE,.2the 54 result
ril
T .16 . 6 2,
requires special treatment when by rating
2
172 Mi 024
relevance. cha fro
el D m I
eve P
rs
` You may occasionally see one or more
normal looking or grayed-out results with
Result with
no rating fields beneath them. No rating
no Rating
is required for these results. This is
Choices
expected and is not a technical issue or
a reason to release the survey.

User viewport: A transparent purple box

centered over a device icon shows the
user’s viewport at the time the query was
issued (if known). The user viewport
represents the map area the user was
looking at when making the query.

The shape of the viewport may vary

depending on the size and orientation of
User
the device being used.
Viewport
Note: In some cases, the user viewport
may be so small that it cannot be seen,
but (if the viewport information is
available) the device icon will always be
visible, regardless of the map scale.

Note: The viewports you see in the

examples in these guidelines may be grey.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

8
 Name Screenshot Description
IP
ro m rs This device icon shows the center of the
2 4 f Deve
,2 0 el user viewport at the time of the user
r i l 2 icha query. The purpose1ofTuthe esd device icon is
p M
a y , A 6 by 7
to make it easier to find.16the
2 ayuser
, viewport.
. .25 Apri
esd 54 It does not indicate the user's location.
Tu .16.2 4.6 l 2
172 by , 202
M 4
This icon should not be used forichae from
Device Icon l D IP
measuring distance. To measure eve
distance, start from the outer edge of the rs
user viewport.

This icon has no rating significance. Its

only purpose is to help you find the
viewport on the map.
A blue and white icon indicates the user
location at the time of the query (if
known).
User
Location
Note: Clicking on the icon reveals the
coordinates (latitude/longitude) of the
user’s location.
A pin indicates a result’s location. The
head of the pin is only an indicator. The
tip marks the actual location.

Each pin on the map has a unique

number and color, which matches the
Result Pin number and color of its corresponding
result heading.(See Result, above)

Note: The pins you see in the examples

in these guidelines may look different
from the pin shown in this chart and the
ones in the tool.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

9
 Name Screenshot Description
IP
ro m rs Clicking any individual result or pin causes
2 4 f Deve
,2 0 el a pop-up box to appear over the pin. The
l 2 icha text within the box mayTu
17 eshow
sda additional
p r i M
, A 6 by information and should.1only
6.2 , be
a y . 2 y A used for
esd 54 p
research purposes to help 5understand
4.6 ril 2, the
Tu .16.2
2
172 result: b y M 24 0
Pop-up ich fro
ae m
Information • Phone number (for research only, l De IP
ver
Box never call a business) s
• URL
• Coordinates (latitude/longitude)

Note: Do not rate the information in the

pop-up box. Rate only the information in
the result.

Map Layer Allows you to select which map layer is

Selector displayed.

Allows zooming in and out on the map.

Zoom
Change the zoom level by clicking the +
Controller
(zoom in) or – (zoom out) buttons.

Copy to
Click to copy information to a clipboard
Clipboard

Click the pin icon at the top right of the

map to place a pin anywhere on the map.

Drop
Location Pin

A purple pin and a pop-up window

showing the pin’s address and latitude/
longitude will appear.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

10
 Name Screenshot Description
IP
ro m rs
0 2 4 f Deve To measure the distance, click the ruler
,2 el icon at the top right ofTuthe map.
r i l 2 icha
Measure p
, A 6 by
M 17 esda
a y . 2.1 y,
Distance esd 254 6.2 Ap
54 ril 2
Tu .16. You can now drop a start pin .6(green)
172 by , 20and
2
Mi the
an end pin (red). The tool will display cha 4 fro
distance between them. el D m I
eve P
rs
Draw Tool Click to draw custom polygons.

Click Submit to save your ratings and

Submit
display the next available task.

1.2.Rating Workflow

Complete each step of the following workflow before you assign a rating.

Evaluate and rate each rating drop-down independently of the others. Rate result Relevance based
on whether the result fits the query intent, even if the result is closed or does not exist or has
incorrect Name, Address, or Pin data. If you are rating Search Relevance you will stop after you’ve
rated result relevance. If you are rating Search 2.0, you will continue by rating Name and Category
Accuracy, Address Accuracy, and Pin Accuracy individually.

Note: For any result in a Search 2.0 project, you may be asked to make all of the possible ratings, some of
them, just one, or none. This is expected and not a reason to escalate or release a task.

Rate each result on its own merits. Do not demote duplicate or very similar results.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

11
 IP
ro m rs
0 2 4 f Deve
,2 el
r i l 2 icha Tu
p
, A 6 by
M 17 esda
a y . 2.1 y,
esd 54 6.2 Ap
Tu .16.2 54 ril 2
.6
172 by , 202
Mi
cha 4 fro
el D m I
eve P
rs

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

12
1.3. Rating Interface
IP
Your ratings and comments will be o mcollected
s in the rating interface shown below. You will first answer
4 f ever
r
one top-level question about20the 2 query D itself, then rate each individual result using the other
2 , h ael Tu
checkboxes and drop-downs. l
pri y Mi
c es
1
a y A
, 6b
.
72.1 day,
esd 54 6.2 Ap
Tu .16.2 54 ril 2
.6
172 by , 202
Mi
cha 4 fro
el D m I
eve P
rs

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

13
1.3.1. Query-Level Navigational Result IP Question
ro m rs
f v e
You will answer a top-level question
2 0 24 l Defor each query to indicate whether there are any results in the
2, e
real world that would completely ha
ril Mic satisfy the user intent.
Tu
p 1 es
a y A
, 6b
.
y 72.1 day,
esd .254 6.2 Ap
Query-level
Tu .16question Explanation 54 ril 2 Notes
.6
172 by , 202
Mi 4 f to answer
Is there a navigational result Are there any results in the real You will only chneed
ael rom
for this query? world that can completely this question once De for
IPeach
ver
satisfy the user intent? query. s

Answer to Query-Level
Query Explanation
Question
[Eiffel Tower] Yes There is only one result in the
real world that can completely
satisfy the user intent.
[Starbucks] No There is not only one result in
the real world that can satisfy
the intent of this query.

Note: If you are presented with a query that has no results, you must still answer this question and
submit your answer.

1.3.2. Result-Level Rating Checkboxes

For each result, you will be presented with two high-level questions. These will allow you to highlight
any problems with the result.

High-level
Explanation Notes
question
Result is not in the language of the If you check this box, your rating for this
Result name/
query, the test locale, or the result result will be complete (all other questions
title is in
region (the expected languages) or is will be unavailable).
unexpected
in a mix of expected and unexpected
language or
languages (unless it is an official
script
company, chain, or brand name).

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

14
 High-level
Explanation
IP Notes
question m rs
ro
2 4 f Deve
,2 0 el If you check this box, only the relevance
r i l 2 icha needs1to Tube rated.
e
p M 72 sday
a y , A 6 by .16 , A
.
esd 54 Pay attention
.25 pri
to
4.6thel 2status of the POI. If
Tu .16.2 ,2
172 b
the result’s statusyisM 24 0
PERMANENT_CLOSURE, ich refer
f
ael rom to 5.19
Rating Relevance when Status De Iis
ver set to
P
PERMANENT_CLOSURE and 10.8 s
Permanently Closed Results for rating
Business/POI Research shows that the business is
instructions.
is closed or closed or that no such business exists
does not exist at the address listed in the result.
If the status is blank or displays any other
text, rate the relevance of the result as if it
did exist.

Use thorough research and your best

judgement to determine whether the
result is closed, has never existed, or the
result component(s) are incorrect.See
Unclear Results for further guidance.

1.3.3. Result Relevance Rating

The relevance rating will take into consideration user intent as well as distance/prominence.
Relevance is always rated independently of any data (name/category, address, or pin) inaccuracies.
This means that when rating relevance we always assume that the result exists (even if research
reveals the location is closed) and that the data presented is correct.

Always rate against the real world: If there is a better result available but it is not shown, demote the
existing result(s) while considering the missing one(s).

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

15
 Relevance
Explanation
IP Notes
Rating m rs
ro
0 2 4 f Deve
The most , 2 hael result implied by the user’s
i l 2 likely
c Tu
query,
A
r
p location,
y Mi and/or viewport that 17 esda
y , 6b 2.1 y,
esd completely satisfies the user’s distinct
a 4 . 6.2 Ap
.25
Tu .16intent. 54 ril 2
.6
172 A distinct user intent is defined by a by , 202
A rating of Navigational
Mi
cha 4 fro for one
combination of the following result does not prevent
el D m other
IP
Navigational
characteristics: results from satisfying evethe
rs query to
• Extreme prominence (e.g. Eiffel Tower) a lesser degree.
• Uniqueness (e.g. complete address)
• Proximity (e.g. incomplete address that
points to an unambiguous option that is
is extremely close)

Highest possible initial rating for

A high-quality result that clearly satisfies the
ambiguous queries as well as for
Excellent user’s intent. Multiple results can be
queries that are not eligible for a
considered high quality.
Navigational rating.
Only partially satisfies the user’s intent due
Good
to relevance, prominence, or distance.
Any relevance rating of Good or
Technically satisfies the user’s intent but below requires an indication of the
Acceptable
does so poorly due to relevance or distance. reason(s) for the demotion:
• User Intent Issue
Does not satisfy the user’s intent due to lack • Distance/Prominence Issue
Bad of relevance or great distance (when closer
satisfying results are available).

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

16
1.3.4. Result Relevance Demotion Checkboxes
IP
If you give a result a Relevance rating ro m ofrs Good or below, you will be presented with two checkboxes.
4 f for ve
eyour
Use them to select the reason(s) 0 2 D rating:
2 , 2 hael Tu
l c
pri y Mi 1 es
• User Intent aissue
y A
, 6b
.
72.1 day,
esd 54
• Distance/Prominence issue 6.2 Ap
Tu .16.2 54 ril 2
.6
172 by , 202
Mi
You must also leave a comment explaining your rating. cha 4 fro
el D m I
eve P
r
Checkbox Explanation Notes s
User Intent Select when the demotion is due to a result only
issue partially fulfilling the query intent.
Select when the demotion is due to a distance
issue based on the user or viewport location or If both issues were reasons for
Distance/ when you demoted for a result that is less your relevance rating, select both
Prominence prominent based on the initial query intent. You checkboxes.
issue can also select this option when the query asks
for something at a specific location and the
result is not at or near the requested location.

1.3.5. Data Accuracy

If you are rating Search 2.0, once you've rated relevance, you’ll evaluate three result components for
data accuracy: Name, Address, and Pin.

1.3.6. Comments

Comments are mandatory for any result relevance rating of Good or below and for any data issues
not rated Correct/Perfect and should explain the reasons for all rating demotions. Be sure to:

• Include user intent: Indicate what you think the user intent is.
• Refer to the guidelines: If the demotion is due to a guideline instruction, note the guideline
section you used to make your decision.
• Include sources: If you find incorrect information in a result, your comment should include
the correct information and its source. Be sure that any links you include lead directly to the
information you provide. If they don’t, include a link to the source you used and explain how to
get to the information from there.
• Use URL shorteners when inserting long links into your comments
IP
•TueBe concise: Don’t write elaborate comments. Be short and specific. r o m rs
s
17• Comment f eve
2.1 day, in English: Your comments will sometimes be reviewed or used by people 24 who are
6.2 A , 20
a el D
not54familiar
pr with your test locale or its language. Comments in English can be understood
l 2 c h by
.6 il 2, 2 pri y Mi
the widest
by possible
0 audience. y, A b
Mi 24
cha fro ue sda 254.6
el D m I T .16.
P
eve
rs 172

17
 Issue Expectations Example Rating and Comment
IP
The comment should o m explain
s the Relevance -> Good (Distance/
4 f ever
r
reasoning behind 2 D
, 2 haelyour rating. A demotion
0 Prominence)
Relevance may beprdue il 2 Mto ic distance from the user’s Tu
Comment:
A y 17 esdaDemoted -1 for a few closer
Demotions location ,
day 54.6compared to similar results/
b real world
2.1 locations
y
6.2 , Ap in the Middletown/
e s
Tu potential results, secondary intent, or Anchorage 5area
.2 4.6 r i l
2 .16 2
by , 202
1 other reasons.
7 Mi
c a 4 fro
Address Accuracy ->hIncorrect el D m I — Street
Number eve P
Include a comment when you rate a rs
Comment: Correct street number is: 332
Name, Address, or Pin something other
W El Camino Real, Sunnyvale, CA 94087
than Correct or Perfect or you give a
Data Issues as found on the official site: https://
rating of Closed/Does not Exist or
www.patelco.org/locations/sunnyvale
Unexpected Language.
Pin Accuracy -> Wrong
Comment: Wrong pin: correct location is:
52.368067, 4.895389

2. Understanding User Intent

Before evaluating any results, you’ll need to understand what the user wanted to find when they
typed in their query. To determine user intent, use a combination of your own research and local
knowledge plus the information found in the rating interface, which includes:

• User location
• User viewport
• Viewport age

User intent refers to the interaction between query, user location, user viewport, and viewport age.

2.1. Query Types

The queries you are evaluating are real queries submitted by users. Because they are real, they can:

• Be misspelled
• Contain mistakes
• Be inconsistent
• Be ambiguous
• Be badly formatted
• Be, or contain, emojis
• Have no maps intent IP
Tu o m rs
17 sdae f r ve
The 2first
.16 step
y, A in the rating process is to make sure you understand the query. 20 24 l De
2, e
.25 pri ha
4.6 l 2, pril Mic
by 202
If you see a foreign-language
Mi 4 query, do not release the survey. Research the d a y, A .6 bory use an online
query
cha fro s 254
ueusual.
translation
el D m I
P tool to find out what it means, then rate it as
T
2 . 16.
eve
rs 17

18
You will see several types of queries, including:
IP
Address queries ro m rs
0 2 4 f Deve
l
2, 2 ichae
lall Tustreet number, street name,
Address queries contain r
p yMi or part of a complete address, including
1 es
locality, state, country,
a y A
, and
. 6 b postal code. 72.1 day,
esd 54 6.2 Ap
Tu .16.2 54 ril 2
.6
1 72 by , 202
Query Explanation Mi
cha 4 fro
el D m I
[717 E El Camino e P
This is an address query in the form of a full address. It containsvea rs street
Real, Sunnyvale,
number, street name, locality, state and postal code.
CA 94087]
[Stevens Creek
This is an address query for a street. The user is looking for the location of
Blvd, Cupertino
this particular street.
CA]
This is an address query for a country. The user is looking for the location of
[Ireland]
the country of Ireland.

This ambiguous query could refer to New York city or New York state. You
[New York] will find more information on prominence, user location, and the viewport in
the following sections to help you determine the intent of this query.

Point of Interest (POI) queries

A point of interest (POI) is a location that people find interesting or useful. POIs can be locally or
internationally known. These guidelines use a very broad definition of POI in which businesses are
also considered POIs.

Query Explanation
[London Bridge] This is a query for a famous POI in London.
[Danube River] This is a query for a river in Europe.
[Charing Cross
This is a query for a transit station in London.
Station]
[Union Square, SF] This is a query for a location in San Francisco.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

19
Business queries
IP
Business queries contain the name ro mof arsspecific business.
0 2 4 f Deve
,2 el
r i l 2 icha Tu
es
Query A p yM
, 6b Explanation
1 72.1 day,
a y . 6.2 Ap
esd 54 ril Alto). The user is
Tu .16.2 This is a business query with a location modifier 54 (Palo
. 6 2,
72
[Zola Palo 1alto] looking for a specific restaurant (Zola) in Palo Alto, CA. 2
by Queries
Mi 024 can include
location modifiers, like city names, that make them more c fr
ha specific.
el D om I
eve P
This is a business query with a request for a specific store in Sunnyvale, rs CA.
[Bookasaurus] The viewport and user location can help pinpoint the desired location for
such a query.
[Starbucks, 7 This is a query for a chain business followed by a specific address. Chain
Boulevard businesses are businesses that have more than one location, and include
Poissonnière, everything from national chains, like Starbucks, down to small local chains,
75002 Paris, like Burrito Boyz. Target, Auchan, Albert Heijn, and Boots are all chain
France] businesses.
This is a business query with a request for the chain business Target and
[Target sunnyvale]
location modifier of Sunnyvale, CA.

Category queries

A category refers to a group of entities that share a set of characteristics.

Query Explanation
This query is for locations where fast food is served. Assume the user
[fast fod] wanted the correct version of the query when the query contains a simple
misspelling.
[bus stop] This query requests the locations of bus stops.
[coffee shops] This query requests the locations of businesses that sell coffee.
[gym] This query requests the locations of fitness centers.
[gas San This query requests the locations of gas stations with a location modifier
Francisco] of San Francisco.

Product
Tu and Service Queries IP
e r o m rs
17 sda f ve
2.1 y, 0 24 l De
A product
6.2 or
A service
pri query is a query about something that can be purchased at or is offered
, 2 a e by a
business5or 4.6POI. l2 p r il 2 Mich
by , 202 y, A .6 by
Mi 4 da
cha fro es 54
el D m I Tu .16.2
eve P 172
rs

20
 Query Explanation
IP
This query m rs
[vanilla latte] 4 fro requests
eve the locations of businesses that sell a specific type of
coffee 2 D
, 2 drink.
0 el
r i l 2 icha Tu
es
[deep-tissue y, Ap This b y Mquery requests the locations of businesses
1 72.1 daythat
, A offer a unique style of
d a . 6 6
massage e]s 5 massage.
4 .25 pri
Tu .16.2 4.6 l 2,
7 2 b 20
1 This query requests the locations of businesses thaty sell Mi pencil,
2 pens,
[school supplies] cha 4 fro
notebooks, and everything else students need for school. el m I
De P
ver
This query requests the locations of businesses that offer truck tire s repair
[truck tire repair]
services.
This query requests the locations of businesses where ATV tours are
[ATV tours]
available.
Not every hair salon offers perms, but this query requests the locations of
[perms]
ones that do.
[deep dish pizza This query requests the locations of places that sell a specific type of pizza
detroit] in a particular city.

Coordinate and “My location” queries

Some queries are simply a set of coordinates or the words ”my location” (or something similar).

Query Explanation
[36.082857,
The user has specified a location using lat/long coordinates.
-115.172916]
[my location] The user has typed these (or similar) words to find out where they are.

Emoji Queries

Some queries are not made using words. Emojis represent the category they picture. Use the most
literal meaning.

Query Explanation

Tu
e
17 sda
2.1 y,
! The fuel pump represents a search for places to get gas.
f r o
24 l De
IP
m rs
ve
6.2 A , 20 e
54 pril 2 a
il 2 Mich
" .6
by , 202 The pizza slice stands for the query “pizza.”
Mi 4 da
p r
y, A .6 by
54
cha fro es
el D m I Tu .16.2
# eve P
Thers coffee cup represents the query “coffee.” 172

21
 IP
Queries with no maps intent from ers
v
2 0 24 l De
e
2, ichaThey include, but are not limited to, queries
Some queries have no maps ril intent. esd that:
Tu
A p y M 1 7
ay,a physical
.6 b 2.1 ay,
• Do not refer
e s dto 5 4 location 6.2 Ap
T u 6.2 54 ril 2
• Do refer to2a.1physical location but have an information intent rather than .a6 location
by , 202intent
1 7
• Refer to a brand or company with a predominantly online intent, like Groupon M 4
oricLinkedIn
ha from
• Ask about the time or weather in a specific location el D I
eve P
rs
Rate all results for these queries Bad.

Query Explanation
[eureka
This is a weather query with no maps intent. Rate all results Bad.
temperature]

[time in new york

This is a “time in” query with no maps intent. Rate all results Bad.
city]
This is a query about a company that is mainly used online. It does not have maps
[facebook]
location intent. Rate all results Bad.
[is cucumber a fruit This is an information-seeking query that has nothing to do with finding a location.
or a vegetable] Rate all results Bad.

2.1.1. Research Expectation

Research will help you understand the user’s query and intent:

• Use a search engine to investigate and understand the query intent

• Use official resources like businesses’ official websites, national postal service websites, and
government websites whenever possible
• Use your own local knowledge
• Use the information provided in the rating interface

2.2. Result Types

A query can return one of three types of results.

Result Type Explanation Example

Tu IP
o m rs
17 esda Businesses and POI type results f r ve
2.1 y, 0 24 l De
6.2 A will show a name in the top field, 2, 2
ha
e
54 pril 2 ril Mic
by , 2followed by an address and a
.6 p
Business/POI 02
Mi category. y, A .6 by
cha 4 fro The same rating rules will da
es 54
apply
el D m toIboth Business and POI Tu .16.2
eve P
results. 172
rs

22
 Result Type Explanation Example
IP
These resultsfrcanom vbe
ersone of
4 e
202 ael Dtypes, including
multiple,address
2
l
residential ch Tu
A pri y Miaddress or locality. 17 esda
y, .6 b of a business or POI name,
daInstead
2.1 y,
6.2 Ap
e s 54
Tu .1this
6.2 kind of result will show the first 54 ril 2
.6
172 line of the address in the top field, by , 202
Mi
followed by the entire address cha 4 fro
el D m I
Address below. This type of result will not eve P
include a category. rs

Note: If a result does not include a

category, don’t assume the result
type is an address. You must still
do research to verify this, as not all
POIs will display a category.
The results for POIs or features
without an expected address, like
bus stops, bridges, or mountains,
may sometimes look like address
type results. Check to see if the
result includes a category. If it
does, the result refers to a feature
or POI, not an address.

Features At first glance, the result on the

without an right might look like it’s for an
expected intersection. However, since it
address includes a category, you can see
that it actually refers to a POI — in
this case, a bus stop.

This result for a landmark square

might be mistaken for a result
referring to a street with the same
name. Since it contains a category,
in this case “Park,” you can see
that it actually refers to a POI.

Tu IP
e o m rs
2.3.
17 Location
s Intent f r ve
2.1 day, 0 24 l De
6.2 A pr 2
2, icha e
A result is54considered
.6 il 2, 2 most relevant when it is located in the user’s area of expected prilresults.
M There
b 02
are two types yofMLocation Intent: a y, A 6 by
ich 4 fro d 4.
ael m T ues 6.25
De IisP made clearly and indicates a specific location 7or.1
• Explicit: The query ver 1 2 area where results are
expected. s

23
 • Implicit: The location expectation is not as clear, so you must use context clues, in the form
of user location and viewport,Ito P discover the area in which the user is expecting results.
ro m rs
2 4 f Deve
2.3.1. Explicit Location , 2 ael 0
l 2 ch Tu
pri y Mi 1 esd
When there is an explicit
y , 6 location
A b mentioned in the query, you can2ignore
7
. ay the user and viewport
a
esd has
locations. The uuser 4 .
told you exactly where they want to find
1
results.6.2 If, Athe
T .16.2
5 54 prilquery
2,
contains words
. 6
like “near me” 1or
72“nearest,” the user’s location, not the viewport location, should by 2be considered the
Mi 024
explicit location intent. cha fro
el D m I
eve P
rs
Query Expected results Notes
Places to buy this drink
[bubble tea tully road san User and viewport locations should be
on Tully Road in San
jose] ignored.
Jose.
Museums in the city of User and viewport locations should be
[Boston museums]
Boston ignored.
The queried chain
User and viewport locations should be
[kfc Philadelphia] business within the
ignored.
stated locality.
Relevant POIs near the Viewport location should be ignored,
[food near me]
user’s location even if fresh.
[nearby/nearest Relevant POIs near the Viewport location should be ignored,
starbucks] user’s location even if fresh.
Result placed on the Viewport location should be ignored,
[my location]
user’s location even if fresh.

2.3.2. Implicit Location

If the user’s location intent is not expressly stated in the query, for example [chinese] or [479
margarita ave], use the user location, viewport location, and viewport age to determine the area of
expected results.
Viewport User Location Location Intent
When the user is within a fresh viewport, take the user
location as location intent. Results are generally expected in
Inside Viewport
or near the viewport, and results inside the area cannot be
rated Bad because of distance alone.

Tu Results are expected in or near the viewport area. All relevant IP

o m rs
17 esda
Fresh Outside results inside the viewport are eligible for a rating of f r ve
2.1 y, 0 24 l De
54 ril 2 Viewport Excellent. If no results can be found in or near 2the , viewport,
6.2 Ap 2 a e
r il Mich
.6
by , 202 consider the user location a secondary location p intent.
Mi a y, A .6 by
cha 4 fro es d 54
el D m I Tu .16.2
eve P
Missing 172 is the location intent.
When the user is missing, the viewport
rs

24
 Viewport User Location Location Intent
IP
Inside Viewport m s
4 fro ever
2 D When the viewport is stale, consider only the user location as
Outside 2 , 20 hael
l c location intent. Tu
Stale pri y Mi
Viewport 1 es
a y A
, 6b
.
72.1 day,
esd 54 6.2 Ap
ril when the user
Tu .16.2 Use the stale viewport as location 54intent
. 6 2
Missing by , 202
172 location is missing. Mi
cha 4 fro
Viewport Age Present or el D m I
P
Consider the viewport fresh when the viewport eage ver is missing.
Missing Missing s
The user location sets the location intent when the viewport is
Present
not present.
Missing entirely When the user location and viewport are missing, the test
Missing locale becomes the location intent with a strong focus on
prominent results.

3.Rating the Query-Level Navigational Result Question

Once you have identified user intent, you will need to answer a query-level question. You must decide
whether the intent is unique and clear enough that there is only a single (navigational) result in the
real world that could fully satisfy it.

You will answer this question before you rate any results, since you don’t need to know what the
results are in order to learn if there’s a real-world result that could fully satisfy the user’s intent:

• If there is a real-world navigational result for the query, answer Yes

• If there are no possible real-world navigational results for the query, answer No

You will answer this question once for each query, whether or not any results are shown.

4. Rating Result-Level Issues

For each result, you must check to see whether:

• There is an issue with the language/script of the result name/title

• The business/POI is closed or does not exist

4.1.Result Name/Title in Unexpected Language or Script IP

Tu o m rs
17 sdae f r ve
A result
2.1 namey, A or title is in an expected language or script when it is: 20 24 l De
6.2 , a e
54 pril 2 r il 2 Mich
.6 , p
• In the blanguage/script
y M 2024 of the test locale a y, A .6 by
ich fro
• In the language/script d 4
ael m of the query T ues 6.25
• In a language/script De Iof .1
ver the result region
P
172
• Any combination of any s of the languages or scripts described above

25
 • An official company, chain, or brand name commonly used in the market, even if this is not
any of the languages or scriptsIPdescribed above
m s
4 fro ever
Below Left: Result name is Walmart 2 lD
2 , 20 Supercenter
h
(in yellow box), address details are below (in green box).
ae first line of the address appears in theTyellow box as the Address title. All the
Below Right: Result is an address,
ri l so
i c the u
Ap itbyinMthe green box.
address details appear ybelow
, 17 esda
2 .16 y, A
e s da 54.6 .25 pri
Tu .16.2 4.6 l 2,
1 7 2 by 202
Mi
cha 4 fro
el D m I
eve P
rs

When all or part of a result name or title is in an unexpected language or script, users will not
understand it. In these cases, select the Result name/title is in unexpected language or script
checkbox. No further rating will be required.

Note: When the address details, found below the name/title, are in an unexpected language or script,
the result can still be understood and rated for relevance and name accuracy. For more on what to do
when the address details (not the name or title) are in an unexpected language or script, see
Language/Script Issue in Address.

Minor Differences in Spelling

Don’t consider minor spelling issues, such as missing or added diacritics (e instead of é), as
Unexpected Language/Script. This also applies to unnecessary or less relevant parts of a name or
title. Use this checkbox only to report issues that interfere with understanding the name/title and
issues listed in your Country Specific guidelines.

Tu IP
e r o m rs
17 sda f ve
2.1 y,
20 24 l De
6.2 A , a e
54 pril 2 r il 2 Mich
.6 p
by , 202 y, A .6 by
Mi 4 da
cha fro es 54
el D m I Tu .16.2
eve P 172
rs

26
4.1.1. Name of Business/POI Results IP
ro m rs
e
4 f Devand
Pay special attention to the language0 2 script of brand and chain names. See your Country
Specific guidelines for more l 2 c h ael
, 2information. Tu
pri y Mi 1 es
a y A
, 6b
.
72.1 day,
esd 54 6.2 Ap
ril
Tu .16.2
Expected Language Explanation 54 Example
. 6 2
172 by , 202
Mi
Expected language/script: cha 4 fro
m
• Test locale: en_US el D IP
The query gives clues as to the eve
• Result in California, USA rs
language in which the user
• Query: [mystery]
expects results. Any result that
• Result name: Mystery Spot
matches the most specific part
of the query or corrects a
Result name is in English and satisfies
spelling issue in the query is
the query.
considered to be a result in an
Query expected language. This also
Unexpected language/script:
includes remote results in
• Test locale: en_US
foreign countries.
• Result in California, USA
• Query: [market]
But: Consider official result
name variations and default to • Result name: ေစျးကွက်
the test locale for very short
queries. The result name is “Market” in Burmese
script.
The language of the test locale Expected language/script:
is generally considered an • Test locale: es_ES
expected language and script. • Result in California, USA
• Query: [college]
If the query is so short that the • Result name: Colegio Skyline
language cannot be identified,
assume that the query language The result name is in Spanish, which
is that of the test locale. matches the language of the test locale,
so this result title is expected and
Test Locale
When the test locale and the acceptable.
and
query locale differ, consider the
Query Locale
query locale an expected Unexpected language/script:
language, as it provides more • Test locale: en_US
detailed information. • Result in California, USA
In the example below, the Query • Query: [college]
Locale is set to English in • Result name: Colegio Skyline IP
Tu m s
17 esda Indonesia. Therefore English is fro ever
2.1 y, 4
6.2 Ap an expected language: “Colegio” is in Spanish, but, the 202 testel D
r 2 h a
54
.6 il 2, 2 • Query Locale: en_ID locale is in English, so thepri result
l
Mi title is in
c
by A y
Mi 24 • Test Locale: id_ID
0 an unexpected language.y, b
cha fro u e sda 254.6
el D m I T .16.
P
eve
rs 172

27
Expected Language Explanation Example
IP
ro m rs Expected language/script:
0 2 4 f Deve • Test locale: en_US
,2 el
l 2 icha Tu
• Result
17 esin Rio de Janeiro, BR
p r i M
a y , A 6 by
. 2.1 d[beach]
• Query: ay,
esd 54 6.2 Ap
• Result name:
54 rPraia
Tu .16.2 .6 il 2, 2 de Copacabana
172 by category
Result satisfies the Mi 024 “beach” and
the result’s name is in froscript and the
chLatin
ael m
Portuguese language, which De isIPthe
ver
language of Brazil. s
The language/script of the
Result region result’s region is expected as
Unexpected language/script:
the result language. • Test locale: en_US
• Result in Rio, BR
• Query: [beach]
• Result name: Playa de Copacabana
Though the result name is in the same
script as the test locale and query
language, returning the name in Spanish
is unexpected language because the
language of Brazil is Portuguese.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

28
Expected Language Explanation Example
IP
ro m rs Expected language/script:
0 2 4 f Deve • Test locale: ar_SA
,2 el
l 2 icha Tu
• Result
17 esin Riyadh, SA
p r i M
a y , A 6 by
. 2.1 d[‫]ماكدونالدز‬
• Query: ay,
esd 54 6.2 Ap
Tu .16.2 54 rMcDonald's
• Result name: .6 il 2, 2
172 by
Mi 024
cha fro
The name of this restaurant el D mis in the
Any official brand, chain , or IP
language of the official brand eve name.
business name in the language rs
of the result’s region or the Expected language/script:
official brand name commonly • Test locale: ar_SA
used in the market, even if it is • Result in Riyadh, SA
not in the language of the • Query: [‫]ماكدونالدز‬
query, test locale, or result • Result name: [‫]ماكدونالدز‬
Brand, chain, and
region, is expected.
business names
The name of this restaurant is in the
In bilingual areas, official
language of the region
names in any of the languages
of the area are expected,
Unexpected language/script:
unless otherwise specified in
• Test locale: ar_SA
the Country Specific
• Result in Riyadh, SA
Guidelines.
• Query: [‫]ماكدونالدز‬
• Result name: [マクドナルド]

The name of this restaurant is in

Japanese, which is not the language of
the query, the locale, the result region,
or the official brand name.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

29
4.1.2. Title of Address Results
IP
Unlike business/POI results, address o m results
f ever
r s do not have an actual name. Instead, the first line of the
address appears as the title.20Rate 4
2 lResult name/title is in unexpected Language or Script when
, e D
li 2 icha is in an unexpected language or script.
the title (first line of the raddress) Tu
es
p yM 1
a y A
, 6b
.
72.1 day,
esd 54
Localized anduNon-Localized Components 6.2 Ap
T .16.2 54 ril 2
.6
172 by , 202
Mi 4 f the result
Address results often cannot be translated and are accepted in the original version cha of r
location. Some features, however, are translated into the test locale’s language, especially el D om I for
ev P
bilingual or English-speaking areas. Although the preferred language is the test locale’s elanguage, rs the
query language and language of the result’s location are also accepted.

Localized components may include:

• City
• State
• Country

Appropriate localization depends on the result itself and the language it is translated into. Research
and local knowledge will help you decide if the translation has been done appropriately.

Components that are not typically localized include:

• Feature type (square, bridge, roundabout, or intersection)

• Street names and street addresses including building names

Use the Address Accuracy Incorrect – Language/Script Issue checkbox if you find issues of this
nature in any of the address components in the address details (not the address title) of any result.

4.2. Business/POI is Closed or Does not Exist

Use this checkbox when, after careful research you determine that a result is:

• Closed/non-existent
• Randomly moving (like a food truck without a fixed schedule)
• A non-recurring past event with no further significance that does not carry any maps intent

Important: If you rate a result as Business/POI is closed or does not exist, you must still give a
relevance rating as if the place were open or did exist.

Remember, this rating can only be applied to business or POI results, not to address type results.
Tu IP
e r o m rs
17 sda f ve
2.1 y,
20 24 l De
6.2 A , a e
54 pril 2 r il 2 Mich
.6 p
by , 202 y, A .6 by
Mi 4 da
cha fro es 54
el D m I Tu .16.2
eve P 172
rs

30
 Use this checkbox to indicate a POI has closed only if there is evidence to prove the business
indicated in the result is no longermoperational. IP
o s
4 f ever
r
When you can’t make a decision 2 laboutD business closure due to lack of resources, assume the
business could exist and , 20 the
rate
2 h ae name, address, and pin accuracy Tuas Can’t Verify (unless there is
l c
pri y Mi 1 esd
an obvious data issue y , like
A b a missing mandatory address component 72.1 or aay pin in the ocean).
e s a
d 54 . 6 6.2 , Ap
Tu .16.2 54 ril 2
.6
172 by , 202
Note: Businesses and POIs can close for construction, remodeling, vacations,Mor 4 f reasons. Treat
ichother
ael rom
all temporarily closed businesses as if they were open when the closure is announced De IP on the
business/POI webpage or managed social media page. There is no limit to how long verthe closure
s
can be.

4.2.1. Closed/Does Not Exist vs. Inaccurate Name and Address

It is important to understand what the result really is before making your rating. If your research
reveals that the business has an incorrect name or address, use the drop-down rating options to
signal precisely what is wrong. Use the Business/POI is closed or does not exist checkbox only for
the specified purposes. See Unclear Results for more guidance and examples.

4.2.2. Rating Relevance of Closed/Non-Existing Business/POI

Special consideration is required when rating a closed/non-existing business/POI. Please review

section 4.3 carefully with regards to the status and permanently closed vs. open.

Never automatically demote to Bad simply because of closure. (You may find other reasons to
demote to Bad, but closure should not be the sole reason for the demotion.)

4.3. Business/POI Status is PERMANENT_CLOSURE

The following chapter offers a high-level introduction to rating closed/non-existing businesses/POIs

in relation to their status (displayed as part of the result information). It addresses Relevance and
Data rating. Please also review the more specific guidance in the associated relevance chapter.

Note: No matter what is displayed in the status section of the tool, you must always research the
business/POI to determine whether it is open or not.

This chart shows the possible combinations of status displayed in TryRating plus a result’s actual
state based on your research.

Real-World State Confirmed by

Tu TryRating Status Comments m IP
Research s
17 esda 4 fro ever
2.1 y, 02 D
Open/Exists
6.2 Ap
54 ril 2 None Rate as usual 2, 2 hael
l c
.6
b , 202 A pri y Mi
, b
Closed/DoesynotMi Exist
cha 4 fro None Rate as y .6
ausual
u esd .254
el D m I T .16
eve P 172
rs

31
 Real-World State Confirmed by
Research IP TryRating Status Comments
ro m r s
2 4 f Deve
0 l Rate relevance based on
2, 2 ae
Closed/Does not Existpril Mich PERMANENT_CLOSURE1 Tues whether result is expected/
y, A .6 by 72 dunexpected.
d a 4 .16 ay, A See 5.19.
ue s 2 5 .25 pri
T .16 . 4.6 l 2,
Rate brelevance
y M 2024 based on
172
Open/Exists PERMANENT_CLOSURE whether result
ich fis expected/
a l rom
unexpected.eSee De 5.19.
IP
ver
s
4.3.1. No Status Shown

When no result status shown or the status is blank, you must research to determine whether the
business/POI is open or closed/does not exist in the real world. Use the Business/POI is closed or
does not exist checkbox when needed.

Rate the result relevance as if the business/POI were open or did exist. Use your best judgement to
determine how well the result satisfies user intent within the area of expected results.

4.3.2.Status Shown as PERMANENT_CLOSURE

When the result status is PERMANENT_CLOSURE, follow the research steps to determine if the
business in fact is open in real world or not, and use the Business/POI is closed or does not exist
checkbox when needed.

The relevance rating for a result with PERMANENT_CLOSURE status depends on whether this result
is expected or unexpected based on the specific relevance guidance in 5.19. Rating Relevance when
Status is set to PERMANENT_CLOSURE and 10.8. Permanently Closed Results

5. Relevance
Relevance for each result is found by assessing the relationship between:

• Satisfying user intent

• Prominence
• Distance

Complete each step of this workflow before assigning your relevance rating.

General Rating Rules IP

Tu o m rs
e
17 sda f r ve
•2.16Ratey, Aeach result individually and demote based on relevance and distance. 20 24 l De
.25 pri , a e
• Always 4.6 rate
l 2 against the real world: If there is a better result available but it isprnotil 2 M ich
shown,
b , 202 y, A .6 by
demotey theMi existing
4 result(s) considering the missing one(s). d a 4
ha frof s
• Ignore the corder el D omthe results and evaluate each one individually. Tue 16.25
I .
• Ignore duplicate resultseve P and rate them individually. Do not demote for 1 72repetition.
rs
• If there are results that are extremely inappropriate or illegal, rate Bad. Identify such content
by determining if the result is likely to be embarrassing if seen by users.
32
 IP
ro m rs
Rate the relevance of each 0result 2 eve
4 f Dwithout considering the accuracy of the name/category, address,
2 e l
,
2 ich a or pin. Tu
ril esd
Ap by Mdistance/prominence, ignore closed1or
Wheny,judging 72 non-existent
ay, results.
d a 4 . 6 . 1 6 A
es 5 .25 pri
Tu .16.2 4.6 l 2,
1 7 2 by 202
Mi
cha 4 fro
el D m I
eve P
rs

Adult Content

Businesses and POIs with legal adult content are rated:

• Navigational to Bad if the query clearly requests this type of content

• Bad if the query does not imply such an intent

Tu IP
o m rs
5.1.
17 Query-Result
e s Connection f r ve
2.1 day, 0 24 l De
6.2 A 2 e
2, icha them.
For a result54 toprsatisfy
.6 il 2, 2 a query to any degree, there must be some kind of relationship prilbetween
M
Your first taskbyisMto 0understand
24 what this connection is. a y, A 6 by
ich fro d 4.
ael m T ues 6.25
De isIPonly the first step in the rating process and covers.1
Satisfying the user intent ver 172 the minimum
requirements for a result tosbe considered relevant.

33
5.1.1. General Connection
IP
A result can satisfy user intent for romultiple
m rs reasons, but most often the result satisfies the most
specific part of the query’s intent.2 Deve kind of relationship between query and result is called a
4 f This
2 0 el
General Connection. ril 2, icha Tu
es
p yM 1
a y A
, 6b
.
72.1 day,
d 4 6.2 Ap
T ues 6.25 Type of 54 ril 2
.6
User Query 72.1 Result Description
by , 202
1 Connection Mi
cha 4 fro
Satisfies Intent: Users are likely el Dtomstart
eve P their
I
San Francisco search with the name of the brand “Marriott”.
rs
[marriot] Marriott Union General Result satisfies user intent by providing a
Square Marriott close to a user/viewport located in the
San Francisco area.
Satisfies Intent: The user is looking for an
[Houston George Bush
General airport in the city of Houston. This is an airport
airport] Intercontinental
in Houston, which satisfies user intent.
Satisfies Intent: The query contains two
[london, different cities, so it’s likely a routing query.
London General
brighton] Returning either of the individual results is
expected and should be rated Excellent.

5.1.2. Abbreviation/Alternate Name Connection

The query is an abbreviation or alternate name and the result provides the full and currently accurate
name.

Type of
User Query Result Description
Connection
Newark Liberty
Satisfies Intent: The international airport code
[ewr] International Abbreviation
for Newark Liberty International Airport is EWR.
Airport
Alternate Satisfies Intent: The result is the correct name
[sears tower] Willis Tower
Name of what was formerly known as the Sears Tower.

5.1.3. Category Connection

The query is a category and the result satisfies that specific category, which may or may not be
displayed within the information provided in the result.
Tu IP
e r o m rs
17 sda f ve
2.1 y, Type of 20 24 l De
A
User6.2Query Result Description il 2, icha e
54 pril 2 Connection
.6
by , 202 pr M
Mi a y, A 6 by
cha 4 fro Satisfies Intent: A categoryd 4.
ues 6.25search for "food"
e m T
[food] lLa
De Ciccia
IP Category in a viewport over San Francisco
.1 returns an
ver 172
s Italian restaurant there.

34
5.1.4. Spell Correction Connection
IP
The query is misspelled and the fresult rom vecorrects
rs that issue. This kind of connection only applies to
obvious issues when no result 4 e
2for the
D actual query exists at the user’s location or when the user intent
is clearly satisfied by the 2 , 20 hael
spell-corrected results. Tu
l c
pri y Mi 1 es
a y A
, 6b
.
72.1 day,
esd 54also happens when a query address does not 6exist
This kind of correction .25 Abut
4.6 ril the result address
p
Tu .16.2 2,
does, correcting172the issue and creating a match. by 202
Mi
cha 4 fro
el D m I
Type of eve P
User Query Result Description rs
Connection
Spell Satisfies Intent: The result corrects the user's
[aple store] apple store
Correction spelling mistake.
Satisfies Intent: This query suggestion for the
Spell
Lodz Łódź Polish market adds the diacritics the user may
Correction
have missed when typing the query.
Satisfies Intent: When there is no "Clair St"
[23 Clair 23 Clair Spell within or around the viewport/user, consider a
street] Boulevard Correction “Clair Boulevard" that is close to the viewport/
user as the most likely intent.

5.1.5. Transit Intent Connection

The result satisfies the transit intent of the query. If the query indicates a specific transit system, the
result must match that system. There is also a transit intent connection when a station provides
access to more than one transit service and the queried one is included.

Type of
User Query Result Description
Connection
Satisfies Intent: Result satisfies user intent by
Richmond BART Transit providing a close station that runs the requested
[bart]
Station Intent transit service for a user/viewport located in the
Richmond area.

5.1.6. Special Character Connection

Always consider the specific language conventions. In general, user intent is satisfied when:
IP
•TueThe query contains a special character and the result is a valid variation (if applicable).rom ers
17 sda f ev
•2.1 They, query does not include a special character but the result with special characters 24 adds
6.2 A , 20
a el D
value
54 p
tor the user and is therefore considered spell corrected. l 2 c h
.6 il 2, 2 pri yperceived
Mi
• The countryby 0or language does not have the special character and it is generally
, A b as
Mi 24
a form of expression
cha fro or style (like “café” in English). e s day 54.6
el D m I Tu .16.2
P
eve
rs 172

35
 Type of
User Query Result P
IConnection Description
ro m r s
2 4 f Deve
,2 0 el Satisfies Intent: "oe" is a valid variation for the
l 2 icha Special Tu "ö" in the country/language of
[möllersdorf] Moellersdorf
r i
p yM special character es
A
, 6b Characters 1 72.1 day,
a y . the result (Germany/German).
6.2 Ap
esd 54 54 ril 2
Tu .16.2 .6
1 72 by , 202
5.1.7. Address-Result Connection Mi
cha 4 fro
el D m I
When a query address and a result address are not exactly the same, the kind of connection eve P they
rs
have depends on their relationship:
• Street number is the same in both query and result but the unit number is different or missing:
• If neither address is a street extension, rate result relevance Good when:
▪ The query contains a unit number and the result does not.
▪ The result contains a unit number and the query does not.
▪ The query contains one unit number and the result contains another.
• The query is full address including street number and name and the result is the street name
only:
• Since this result is an unlikely secondary intent, rate relevance as Acceptable.
• Query is for a street [Main Street, Pleasanton, CA] result is just the locality (Pleasanton, CA).
• Rate the result relevance Bad as it does not satisfy the user intent.

Type of
User Query Result Description
Connection

357 Western Satisfies Intent: The result does not include

[357 western
Ave Address the unit number requested in the query so its
ave suite 1]
St. Johnsbury, VT relevance is rated Good.

Satisfies Intent: The result has the same

357 Western
[357 western street number but a different unit number from
Ave Suite 2 Address
ave suite 1] the address in the query, so its relevance is
St. Johnsbury, VT
rated Good.
Satisfies Intent: Instead of returning the full
address requested, the result provides only the
[357 western Western Ave
Address street name. This is an unlikely secondary
ave suite 1] St. Johnsbury, VT
intent, so relevance is demoted to an initial
rating of Acceptable.
Does not satisfy user intent: Instead of
[357 western
St. Johnsbury, returning the full address requested, the result
Tuave st. VT
Address
provides only the locality. This does not satisfy o
IP
m rs
1johnsbury]
e
72 sday f r ve
.16 , A the user intent, so relevance is rated 0Bad.
2 24 l De
2, e
.25 pri ha
4.6 l 2, p ril Mic
b 2
Mi 024
5.1.8. Lack ofy Connection da y, A .6 by
cha fro es 54
el D m I Tu .16.2
If the result does not satisfyeve Pthe user intent either because there is no relationship
172 between the query
r
intent and the result or because the connection between the query intent and result will not be
s
immediately obvious to the user, rate the result relevance Bad.
36
 IP
ro m rs Type of
User Query Result
0 2 4 f Deve Connecti Description
,2 el on
r i l 2 icha Tu
p M 17 esda
d a y, A .6Santa
by Cruz 2.1 user
Does not satisfy 6.2 , Ap intent: Research
y
4
es .25 Boardwalk ril
[airport]
u
T .16 None shows that there is54no
.6 connection
2, between the
7 2 Santa Cruz b
query and the result. Rate 2
y MBad. 0
1 2
ich 4 fro
a m
Does not satisfy user intent:el ResultDe IP is for
[Raging Waters
2333 South the correct address, but does not vinclude
ers the
2333 South
White Rd None business named in the query, so users will
White Rd
San Jose have no way of knowing if this is truly
San Jose]
connected to the business or not. Rate Bad.
Does not satisfy user intent: Query is the
name of a business and result is for the
2333 South correct address, but does not include the
[Raging Waters] White Rd None business name. Users will have no way of
San Jose knowing whether or not this address is
connected to the business they asked for.
Rate Bad.
Does not satisfy user intent: Result is for a
Macy’s
store, not a mall. This store is inside the
2801 Stevens
[valley fair mall] None requested mall, but does not satisfy the intent
Creek Blvd,
of the query, which is the whole mall.
Santa Clara
Rate Bad.
Westfield Does not satisfy user intent: Result is for a
Valley Fair mall, not a store. This mall contains the
[macy’s] 2855 Stevens None requested store, but this result is the whole
Creek Blvd, mall, not the single store the user asked for.
Santa Clara Rate Bad.
Does not satisfy user intent: Result is for a
Costco
Costco gas station, not a Costco store. The
Gasoline
store and the station are at the same address
[costco] 1601 Coleman None
and share a brand name, but the result is not
Ave, Santa
what the user asked for and does not satisfy
Clara
the query intent. Rate Bad.
Does not satisfy user intent: Result is for a
Costco Costco store, not a Costco gas station. The
Tu 1601 store and the station are at the same address IP
m rs
17[costco
es gas]
Coleman Ave,
None
and share a brand name, but the result
r o
f not eve
2.1 day,
20 24 isl D
6.2 Ap Santa Clara what the user asked for and does e
il 2 not satisfy
, a
54 ril 2
.6 r ich
by , 202 the query intent. Rate Bad., A by
p M
Mi ay .6
cha 4 fro uesd .254
el D m I T .16
eve P 172
rs

37
5.2. Satisfying User Intent
IP
The user’s intent can be determined ro m byrsconsidering the query, the user’s location/viewport, and your
f ve
local knowledge. Sometimes20queries 24 l De are ambiguous or can have multiple interpretations.
, e
r i l 2 icha Tu
esd
A p yM 1 7
In order to determine y , a query’sb primary and secondary intent, look 2at . theay relationship between the
s a
d 54 . 6 1 6.2 , Ap
query and theTresult.
u 6.2Ask yourself:
e 54 ril 2
.6
.1 by , 202
172 Mi
• Is there a logical relationship between the query and the result? cha 4 fro
el D m I
• How likely is the user to be looking for this result given the query and the location eveintent?
P
rs
Intent Type Definition Highest Initial Rating
Primary Intent Result satisfies the most obvious and likely user Navigational or
intent Excellent
Secondary Intent A result which is less likely to be the user’s intent. Good (User Intent)
Results matching secondary intent are often not as
prominent as the originally queried entity but still
satisfy the intent of the query.
Unlikely Intent A result which matches the query but is very Acceptable (User Intent)
unlikely to be the user’s intent.
Non-Relevant There are issues that make the result useless for the Bad (User Intent)
Intent user.

For any Relevance Rating of Good or below, you must select the appropriate check box(es) to
indicate the reason(s)for demotion: User Intent and/or Distance/Prominence. If both reasons apply,
use both checkboxes.

When determining intent, keep in mind:

• It is rare that a navigational query will have multiple primary intents.

• Rating one result Navigational and one Excellent within the same set of results is also rare,
but possible (see examples in Navigational Results for Category Queries).
• A navigational query will most often produce one result that satisfies the distinct intent and
multiple other results that satisfy a secondary intent or do not satisfy the intent at all. This
means there will be one result rated Navigational and all other results will be rated Good or
Acceptable for secondary intent or Bad for not satisfying user intent.
• Most non-navigational queries will produce results that are rated from Excellent to Bad.
• Since the queries were made by actual users, there will be cases where a query is gibberish IP or
Tu m rs
17 sdaehas no maps intent. Do your best to understand it and see how well the results fit the fuser’s
r o ve
2.1 intent,
y, A but don't be shy about assigning a Bad rating if a result doesn’t fit. 20 24 l De
6.2 , a e
54 pril 2 r il 2 Mich
.6 p
by , 202 , A 6 by
ythe
Satisfying the M user intent
4
ich fro is only the first step in the rating process and covers
es .254 minimum
d a .
a
requirements for a result m u
e l D to IPbe considered relevant. The rating determined by T 1 deciding how well
6
intent is met is called the eve Initial Rating. Distance and prominence will be 1 72.
considered next in order
rs
to establish the final rating.

38
5.3. Prominence IP
ro m rs
f eve
Once you’ve made an initial 2rating 0 24 l by D establishing that there is a relationship between the query and
2 , h ae Tu
the result and determining pri ythe
l
Mi intent type, consider the result’s prominence.
c es
1
a y A
, 6b
.
72.1 day,
esd a.2feature
54 6.2 Ap
The prominenceTu of 6 refers to its popularity, including the number 54 of rpeople
.6 il 2, 2 visiting and media
.1
sources referencing
1 7 2 it. Prominence can vary based on the test locale and even
by local
Mi 024knowledge.
Consider the following list to get a general idea how to establish prominence, ordered cha frfrom the most
el D om I
prominent to the least prominent: eve P
rs
• The feature is known internationally
• The feature is known in the country
• The feature is known in the region
• The feature is known locally
• The feature may not even be known locally

A result that may not directly appear to be user intent can be promoted for being internationally
prominent.

Query Result Rating and Explanation

Relevance Navigational
Sydney, Australia The city of Sydney is clearly the user's primary
intent.
Relevance Good (User Intent)
Sydney Opera House The Opera House does not satisfy primary intent.
Sydney, NSW, Australia However, it is promoted to secondary intent due
[Sydney]
to its international prominence.
Relevance Bad (User Intent)
Sydney Town Hall
483 George St, The Sydney Town Hall does not satisfy primary
Sydney, NSW, 2000 intent. While the civic center is historically
Australia important, it is not internationally prominent and
will not be promoted to secondary intent.
Relevance Bad (User Intent)
Sydney Buses Depot The depot matches the query string but is
Randwick unlikely to be the user’s intent and has very low
34-36 King St, Randwick prominence given how many other internationally
NSW 2031, Australia prominent POIs Sydney has to offer. IP
Tu o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap , a e
54 ril 2 r il 2 Mich
.6
by , 202 Relevance Navigational p
Mi 4f d a y, A .6 by
4
chaAgrar
el D om I T ues 6.25
UttarevePradesh,
P India Query is for a small locality
.1 in India and the result
172
rs satisfies the user intent.

39
 Query Result Rating and Explanation
IP
ro m rs Relevance Good (User Intent)
0 2 4 f Deve
[Agra] ,2 el
r i l 2 icha Tu
p
, A 6 by
M 17 esda
a y . Result is for a prominent
2.1 y, site in the queried
6.2 Ap
esd Taj 54 Mahal locality. The Taj Mahal
54 does
.6 il 2,not satisfy the user’s
r
Tu .16.2
Agra, Uttar Pradesh, India 2
172 b
primary intent. However,yitMis promoted
024 to
secondary intent due to theicinternational
ha from
e D I
prominence of the feature in thel queried
eve P locality.
rs

Relevance Navigational
Japan The country of Japan is clearly the user’s
primary intent.
[japan]
Relevance Bad (User Intent)
(User is in
Seattle) Sarku Japan
401 NE Northgate Way A chain restaurant with “Japan” in its name does
Seattle, WA 98125 not satisfy the query’s primary intent (the
country of Japan) or any secondary intent
(entities with international prominence).

5.4.Distance

Generally, the farther away the result is from the area of expected results, the less desirable it
becomes. This is especially true for queries highly driven by distance to the user/viewport, such as
chain businesses, hospitals, pharmacies, or grocery stores.

Because the user can be offered many possible results that are all very similar, the closest entities
providing the expected service can be considered the best options. Results which are farther away
are less relevant and should be demoted according to their additional distance. Defining what is close
and what is far depends on the context of each individual query. Factors affecting distance include:

• Number of possible results in the real world

• Distribution of all possible results
• Population density (rural, urban, or suburban)

Distance
Tu refers to the direct distance from one point to another and is measured via a straight line. IP
o m rs
There
17 ise s no need to account for the actual distance required to travel from one point to the4other, f r vsuch
e
2.1 day, 0 2 l De
as driving
6.2 distance.
A , 2 a e
54 pril 2 r il 2 Mich
.6 p
by , 202 y, A .6 by
Mi 4 da
cha fro es 54
el D m I Tu .16.2
eve P 172
rs

40
 Viewport Location Intent (see section 2.3.2)
IP
m s
4 fro ever
2 D
2 , 20 hael Tu
l c
pri y Mi 1 es
a y A
, 6b
.
72.1 day,
esd 54 6.2 Ap
ril
Tu .16.2 When the user is within a fresh viewport, the 54 user’s
. 6 2 location should be
172 by , 202
used as the location intent. All ratings made should Mi be4 based on the
cha fro
user’s location. Results inside the fresh viewport may ebe
l D demoted
m
IP
based on distance to the user but they cannot be demoted eve by 3 (to
rs
Bad) for distance alone.

Note: Consider the viewport fresh when the viewport age is missing.

Fresh Viewport, User Inside

When the user is outside the fresh viewport, the fresh viewport should
be used as the location intent. All ratings should be based on the
fresh viewport’s location and any results within the fresh viewport
receive No demotion for distance.

Note: If no results can be found in or near the viewport, use the user
location as a secondary location intent.

Fresh Viewport, User outside

When the viewport is stale, the user’s position is considered the

location intent whether the user is inside or outside of the viewport.
Tu IP
Note: If the user is missing, use the stale viewport as location fintent. o m s
e
17 sda 4
r
e ver
2.1 y,
6.2 Ap 2 , 202 ael D
54 r h
.6 il 2, 2 pril Mic
by , A y
Mi 024 day 54.6
b
cha fro e s
el D m I Tu .16.2
P
Stale Viewport
eve
rs 172

41
 Do not demote a result for distance when:
• This is the closest possiblemresult, IP even if it is far away from the area of expected results.
• Other, closer results are f ro e rs
founde to be closed or non-existent.
v
, 2 024 el D
l 2 ch a Tu
pri y Miwhen:
Demote a result for ,distance 1 es
y A
6 b 72.1 day,
• Other results
esd 5that
4 satisfy the query and provide the same or similar 6.2 Apservice are closer.
a .
Tu .16.2 54 ril 2
.6
172 by , 202
Mi
cha 4 fro
el D m I
5.5. Distance vs. Prominence eve P
rs
Once you’ve decided how relevant the result is based on user intent, consider the result in the
context of all possible results in the real world. Use the distance to the user or viewport and the
prominence of the result to decide if a demotion should be applied.

A result’s fit to user intent, prominence, and distance should all be relative to the query and the
context around the query. Before deciding whether to demote because of prominence or distance, it’s
important to look at:

• The type of area around the result – rural, urban, or suburban

• The number of businesses that satisfy the query
• The distance to the user or viewport

The following examples of multiple query/result pairs will demonstrate how to interpret the
relationship between distance, prominence, and satisfying the user’s intent. The examples address
common rating situations and explain how to evaluate the relevance of the results.

5.6. Many Possible Results

Some queries, like [starbucks], have many results that could satisfy the user. In cases like this,
distance is more important than prominence, so results that are closer to the user’s location/viewport
should be rated higher than results that are farther away. To illustrate the high density of Starbucks,
possible results are shown as purple dots.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

42
User Inside Fresh Viewport
IP
When the user is inside the viewport, o m consider
s all possible results, including real-world results not
4 f ever
r
returned for rating (purple dots), 2 D
,2 0 eand
l demote by distance from the user.
r i l 2 icha Tu
es
p yM 1
a y A
, 6b 72.1 day,
Query andeScreenshot
sd 54 . Result Rating 6.2andApExplanation
Tu .16.2 54 ril 2
.6
172 Relevance Excellent by , 202
① Starbucks Mi
cha 4 fro
865 Market Rate Excellent for Starbucks locations el D m I that are in
Street eve P
close proximity to the user. rs

Relevance Good (Distance/Prominence)

[starbucks] ② Starbucks
170 O’Farrell St Rate Good for locations that are a bit farther
User and fresh viewport in San away from the closest relevant locations to the
Francisco, CA user.
Acceptable (Distance/
Relevance
Prominence)
③ Starbucks
264 Kearny St Rate Acceptable for relevant locations that are
even farther away from the user but still inside
the viewport.

Relevance Bad (Distance/Prominence)

④ Starbucks
580 California
St When there are many locations close to the user,
rate Bad for locations that are significantly farther
away and outside the viewport.

Relevance Excellent
⑤ Starbucks
140 Mason
Rate Excellent for Starbucks locations that are in
Street
close proximity to the user, even if they are
outside the viewport.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

43
User Outside Fresh Viewport
IP
When a user is outside the viewport, o m results
s are expected in or near the viewport. In cases where
4 f ever
r
there are a large number of, possible 0 2 D
l results inside the viewport, even if they are not returned for
2 2 ichae
lBad Tu
rating (purple dots), rate r i
p yM for those outside it. 1 es
a y A
, 6b
.
72.1 day,
esd 54 6.2 Ap
Tu .16.2 54 ril 2
.6
1 72 by , 202
Query and Screenshot Result Rating and Explanation
Mi
cha 4 fro
el D m I
Relevance Excellent eve P
① Starbucks rs
865 Market Rate any Starbucks within the fresh viewport
Street Excellent when the user is outside the viewport.

[starbucks]
Relevance Excellent
User in Alameda with fresh ② Starbucks
viewport in San Francisco, CA 170 O’Farrell St Rate any Starbucks within the fresh viewport
Excellent when the user is outside the viewport.

Relevance Excellent
③ Starbucks
264 Kearny St Rate any Starbucks within the fresh viewport
Excellent when the user is outside the viewport.

Relevance Bad (Distance/Prominence)

④ Starbucks
580 California
St When there are many possible results within the
viewport, including those not returned for rating
(purple dots), rate Bad for results outside it.

Relevance Bad (Distance/Prominence)

⑤ Starbucks
140 Mason
Street When there are many possible results within the
Tu viewport, including those not returned for rating IP
o m rs
17 esda (purple dots), rate Bad for results outside r
f eve
2.1 y, 24 it.
6.2 Ap 2 , 20
a el D
54 ril 2 l c h
.6
by , 202 A pri y Mi
Mi ,
ay .6 b
cha 4 fro uesd .254
el D m I T .16
eve P 172
rs

44
 IP
ro m rs
0 2 4 f Deve
,2 el
5.7. Few Possible Results r i l 2 icha Tu
es
p yM 1
a y A
, 6b
.
72.1 day,
esd .2only 6.2 Ap
54 a few results in the real world, be more lenient
When the query
Tu has 6 5when
4.6 ril considering
2 distance.
.1 by , 2[zara]
Because there1are
72 only a few Zara clothing stores in Miami, results for the query Mi 24 0 are demoted
more leniently for distance than the many Starbucks locations in the example above. c ha romf
el D I
eve P
rs
Query and Screenshot Result Rating and Explanation

① Zara Relevance Excellent

19501 Biscayne
Blvd, Aventura Rate Excellent for the closest Zara location, even
when outside the fresh viewport.

Relevance Good (Distance/Prominence)

② Zara
420 Lincoln
[zara] When there aren’t any possible results in the
Rd, Miami
Beach fresh viewport, rate Good for locations that are a
User and fresh viewport in North bit farther away from the user/viewport.
Miami Beach, FL
Relevance Good (Distance/Prominence)
③ Zara
590 Collins
Ave, Miami When there aren’t any possible results in the
Beach fresh viewport, rate Good for locations that are a
bit farther away from the user/viewport.

Relevance Good (Distance/Prominence)

④ Zara
701 S Miami
When there aren’t any possible results in the
Ave, Miami
fresh viewport, rate Good for locations that are a
bit farther away from the user/viewport.

Acceptable (Distance/
Relevance
Prominence)
⑤ Zara
Tu 7535 N Kendall IP
o m rs
17 esda Dr, Miami The Zara store is located significantly0further f r ve
2.1 y,
2 24 l De
6.2 Ap away than the second closest stores e
il 2 Mand
, a is
54 ril 2
.6 r ich
by , 202 therefore rated Acceptable., A by
p
Mi ay .6
cha 4 fro uesd .254
el D m I T .16
eve P 172
rs

45
 IP
5.8. Few Possible Results andfrGreater om vers Distance
e
, 2 024 el D
a
il 2 Mich
Leniency on distance ispracceptable Tu results for the query in the
when there are only a few possible es
1
A
requested area. Forayexample,
, 6b
.
y 72.1 day,
a user close to Berlin queries for [Wartestraße], which is a street
s d 54 6.2 Ap
name. There areTu only
e .2 four streets in Germany called “Wartestraße” that5can 4.6 satisfy
r il 2 the user’s intent
and all four streets
7 2 .16are returned as results. Because of the limited number of
b , 2 each result’s
results,
0
1 y M 24
relevance remains fairly high even over longer distances. ich fro
ael m
De IP
ver
s
Query and Screenshot Result Rating and Explanation
[Wartestraße] Relevance Excellent

User and
① Wartestraße, Wartestraße in Gransee is the closest to the
fresh viewport close to Berlin, Gransee user and viewport and is therefore the most
Germany relevant.
Relevance Good (Distance/Prominence)
② Wartestraße, Wartestraße in Siegen is far away from the
Siegen user, but is the second closest possible result.

③ Wartestraße, Wartestraße in Wiesbaden is at a similar

Wiesbaden distance from the user as the one in Siegen
and receives the same rating.

④ Wartestraße, Acceptable (Distance/

Relevance
Geislingen Prominence)
Wartestraße in Geislingen is the fourth closest
[Wartestraße] result but significantly farther away. Given all
other results and their distances, this result is
User and rated Acceptable.
fresh viewport
close to Berlin,
Germany

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

46
5.9. Rural Areas IP
ro m rs
eve
4 frural
Results are often farther away 0 2in D areas, but can still be considered relevant if there are no
2 , 2 hael Tu generosity can be applied to
reasonable results close pritoy or
l
Mi within the fresh viewport. In a rural1area,
c esd
ratings with respect y A
,to distance.
b 7
The criteria for rating are similar to2.the a[zara]
y example in the Few
s a
d 54 . 6 1 6.2 , Ap
possible results
Tu section,
e .2 but with an emphasis on distance. Here is an example 54
.6 il 2for
r the query
[american legion]7 2 .16in North Dakota. b ,2
0
1 y M 24
ich fro
ael m
De IP
Query Result Rating and Explanation ver
s
Relevance Excellent
① American
Legion This result is closest to the user
based in Bismarck, ND.
[american legion]
Relevance Good
② American The second-closest result is
Legion significantly further north than the
closest result.

Relevance Acceptable

③ American While quite remote from the user, this

Legion result is still a good option for the
user given that there are only two
closer results.

Relevance Acceptable

④ American Like result 3, this location quite far

Legion away but is still an acceptable result
given that there are only two
significantly closer results available
to the user.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

47
5.10. Location – User Intent Deviation
IP
When the location intent and user ro m rs do not allow for a clear result (because either the user or
intent
eve
4 f Dlike
viewport are in an atypical location, 0 2 the middle of the ocean), rate with a focus on high
2 , 2 hael Tu
prominence. For example, pri ythe
l
Mi query [Hong Kong] in a test locale17setesto
c en_US with the viewport and
user location around , A
Naples,
b Italy. There is no real change in rating 2if da user is inside or outside of
the
y y
.16 , A
da 54.6
the viewport, Torueifs the
6 . 2 viewport is fresh or stale. .25 pri
4.6 l 2,
2 .1 by 202
1 7 Mi
cha 4 fro
Query and Screenshot Relevance Rating Explanation
el D m I
eve P
[Hong Kong] The most prominent result rs is the
Navigational
territory of Hong Kong in Asia.
User and
Fresh Viewport close to Naples, Italy Businesses/locations with the same
name that are within the viewport or
Excellent
close proximity to the user and
prominent. (This will be rare.)

Locations that are too far away and

less prominent to be considered
relevant should be rated Bad. A
Bad (Distance/
restaurant in Rome named “Hong
Prominence)
Kong” should be rated Bad
because it is very far away from the
user location, which is in Naples.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

48
5.11. Rating for User Inside and Outside Viewport
IP
The following two examples show o m differences
the s in rating when a user is inside and outside a fresh
4 f ever
r
viewport. The query is for a 2chain 0 2 lbusiness
D called Great Wolf Lodge found across the United States.
2 , h ae Tuviewport.
The examples show allppossible ri Mi results within and around the large
l c es
1
a y A
, 6b
.
y 72.1 day,
esd .2user 54 is outside the fresh viewport, no result within 6.2 Ap
In general, when
Tu the 6 5the
4.6 viewport
ril
2, is demoted for
.1
distance. The only
1 7 2 exception to this is when the viewport is large enough to binclude
y M 24 unusually
2 0 an
large area, like an entire continent, and the results within it would not realistically ichbe useful
ael rom or
f
interesting to a user with this query. De IP
ver
s
(Note that even though the viewport in the example below is large, because of the limited number of
Great Wolf Lodges with it, the results still might be useful or interesting to a user with this query.)

Query and Screenshot Result Rating and Explanation

Relevance Excellent
① Great Wolf Lodge
Atlanta The result is within the fresh viewport
and fulfills the primary user intent.
[great wolf lodge] Relevance Excellent
② Great Wolf Lodge
User in Savannah outside large, Charlotte The result is within the fresh viewport
fresh viewport and fulfills the primary user intent.
Relevance Excellent
③ Great Wolf Lodge
Williamsburg The result is within the fresh viewport
and fulfills the primary user intent.
Relevance Good/Acceptable
(Distance/Prominence)

④ Great Wolf Lodge The result is outside the fresh viewport.

Pocono Mountains Because there are a limited number of
possible results within the viewport and
this one is relatively close, demote to
Good or Acceptable.
Relevance Excellent
⑤ Great Wolf Lodge
Niagara Falls The result is within the fresh viewport
and fulfills the primary user intent.
Relevance Good/AcceptableIP
Tu (Distance/Prominence) m s
17 esda 4 fro ever
2.1 y, 2 lD
6.2 Ap
54 ril 2 ⑥ Great Wolf Lodge The result is outside the fresh 2 , 20 viewport.
ha
e
.6 r i l i c
by , 202 Traverse City Because there are a ,limited
Ap by M number of
Mi a y 6
cha 4 fro possible results ewithin
d the
4 . viewport and
el D m I u s 6.25
this one is relatively
T .1 close, demote to
eve P 172
rs Good or Acceptable.

49
When the user is inside the fresh viewport, the user's location is used as location intent and results
are demoted for distance. IP
ro m rs
0 2 4 f Deve
Query and Screenshot ,2 el Result
i l 2 icha TRating
ues and Explanation
p r M 17
y, A .6 by ① 2.1 day,
Great Wolf Lodge Relevance
d a
es .25 4 6.2 Ap Excellent
u
T .16 Atlanta 54 ril 2
.6
This result is amongst
172 by , 20the closest
M 24
possible to the user iand
cha isfroinside the
fresh viewport. el D m I
eve P
rs
② Great Wolf Lodge Relevance Excellent
[great wolf lodge] Charlotte
This result is amongst the closest
User in Savannah inside large, possible to the user and is inside the
fresh viewport fresh viewport.
③ Great Wolf Lodge Relevance Good (Distance/
Williamsburg Prominence)
Though still inside the fresh viewport,
this result is significantly farther away
from the user location with closer
options available.
④ Great Wolf Lodge Relevance Bad (Distance/
Pocono Mountains Prominence)
This result not only is very far away from
the user, it is also outside the fresh
viewport.
⑤ Great Wolf Lodge Relevance Acceptable
Niagara Falls (Distance/Prominence)
While very far away from the user, this
suggestion is still within the fresh
viewport and therefore rated
Acceptable.
⑥ Great Wolf Lodge Relevance Bad (Distance/
Traverse City Prominence)
This result is not only very far away from
the user, it is also outside the fresh
viewport.
Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

50
5.12. Partial Address Does Not Exist
IP
Relevance is always rated independently ro m rs of any data (name, address, or pin accuracy) issues the
f eve
4results
result may have. This includes 0 2 D for addresses that do not exist in real life.
2 , 2 hael Tu
l c
pri y Mi 1 es
When judging distance
a y A
, for
. 6
72.1 day, non-existent addresses.
b existing addresses do not factor in any returned
6 Ap
Evaluate distanceesd .254 for existent and non-existent addresses..2Do
Tu .1separately 54 not
6 rildemote existing
. 6 2
address results17when
2 closer, non-existent addresses are returned. by , 202
Mi
cha 4 fro
el D m I
For example, a user in Half Moon Bay, CA is looking for [2373 chestnut] and is presented eve Pwith three
residential addresses. The address in San Francisco is the only one that actually exists. The rs results in
Oakland and Redwood City are not supported by the postal authorities and no evidence can be found
that the addresses in either city exist.

Note: For cases where the query is a unique full address that does not exist and the result matches
the query, see Query Address does not Exist.

Query and Screenshot Result Rating and Explanation

Relevance Excellent
This is the closest existing result. The address
2373 Chestnut St, in Redwood City is disregarded and its
[2373 chestnut] San Francisco relevance is not promoted nor demoted for
User and Fresh Viewport Distance/Prominence because it does not
around Half Moon Bay, CA exist.

Relevance Excellent

This is closer to the user than the existing

2373 Chestnut St, result in San Francisco. Because data issues
Redwood City are not part of the relevance rating, the result
is rated Excellent due to proximity and user
intent. Address accuracy is rated Incorrect –
Address does not exist.

Relevance Good/Acceptable
(Distance/Prominence)

2373 Chestnut St, This is significantly farther away than the

Oakland existing result in San Francisco and the non-
existent result in Redwood City, and is
Tu demoted in relevance. Address accuracy m is rs
IP
17 esda rated Incorrect – Address does not4exist. f r o ve
2.1 y,
20 2 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

51
5.13. City vs. Municipality
IP
In many cases, a city and a state/county/municipality
ro m rs (or other similar market-specific components)
eve
4 f isDtypically
have the same name, but the 0city
2 more prominent. In this case, the chances that a user is
2 , 2 hael
looking for the state/county/municipality
l
pri y Mi
c and not the city, are very Tsmall,
u but still a possibility.
A 17 esda
Therefore, states, counties,y , b and municipalities will be treated as a secondary
2 .16 , A intent and given an
y
s da 54.6 .25 municipality
p
initial rating ofTuGood.
e
6.2 Consider the relationship between the city and the 4.6 ril 2, in terms of their
.1
locale and adjust 1 7 2 if necessary. On the other hand, if the query specifically requests
b y M 24 state/county/
2 0 the
municipality, that result’s relevance should be rated as Navigational and the city ichshould
ael rom be rated
f
Bad. De IP
ver
s
See your Country Specific guidelines for more information.

Query Result Rating and Explanation

Relevance Navigational
New York City
New York, USA The result is for the city, which is considered more
prominent than the state.
[new york]
Relevance Good (Distance/Prominence)
New York State
New York State, USA Result is for the state, which is less prominent than the
city.
Relevance Navigational
Santa Clara
Santa Clara, CA Query is for the city, which is considered more
prominent than the county.
[santa clara]
Relevance Good (Distance/Prominence)
Santa Clara County
Santa Clara County, CA Query is for the city, which is considered more
prominent than the county.
[santa clara Relevance Navigational
county] Santa Clara County
Santa Clara County, CA Query is specifically requesting the county, so the
result for the county will be rated Navigational.
Relevance Bad (User Intent)
Santa Clara
Santa Clara, CA Query is for the county and a result for the city is
considered irrelevant for the query.
5.14.Unexpected Results

Straightforward
Tu queries can have unexpected results which at first glance might not fit the queryIP
m s
intent.
17 sFor
e d these kinds of results, consider: 4 fro ever
2. a y, A 2 D
• 16Is.25there pria logical relationship between the query and the result? 2 , 20 hael
4
• How.6likely
l2 ril Mic location
by ,is 20it that the user is going to be looking for this result given they, query
Ap by and
intent? Mich 24 fr e sda 254.6
ael mo u
T .16.
De IP
A result can partially satisfy ver a secondary intent due to: 172
s

52
 • Prominence of the feature
• Transit intent IP
ro m rs
2 4 f Deve
Promoting for prominence should ,2 0 elonly occur for internationally prominent POIs.
r i l 2 icha Tu
es
p yM 1
In the examples below,
A
, two b ratings are provided for some results: Good 72.1 dayand
a y
esd .the
. 6
54 two ratings rests in how well the result satisfies 6.2 , Ap Acceptable. The
difference between
u
T .16 2 4.6 rintent.
5user il 2 Choose Good if
2 b ,2
there is a strong
1 likelihood that it will satisfy user intent and Acceptable if it yisMless24likely to satisfy.
7 0
ich fro
ael m
De IP
Query Result Rating and Explanation ver
s
Relevance Navigational
Mission St & 14 St th

San Francisco, CA Query is for an intersection and the result

[mission & 14th satisfies the user intent.
street]
Relevance Good/Acceptable (User Intent)
User and fresh
viewport in San Mission St & 14th St Bus Result is for the bus stop at the queried
Francisco, CA Stop intersection. The bus stop carries the name of
San Francisco, CA the intersection and users tend to look for
intersections when seeking transit POIs.

Relevance Navigational
[soho]
Soho
User and viewport in London, UK Query is for a neighborhood in London and the
London, UK result satisfies the user intent.

Relevance Bad (User Intent)

Mildreds Restaurant
45 Lexington St, Carnaby, Result is for a specific restaurant in Soho. It is
London W1F 9AN, UK very unlikely to satisfy the user intent.

Relevance Bad (User Intent)

Happy Lamb Hot Pot The query is for a street and the result is a
[stevens creek
19062 Stevens Creek Blvd, specific business on that street. This specific
blvd cupertino]
Tu Cupertino, CA, 95014 result is unlikely to satisfy the broad intent m ofIPthe
s
17 esda r o
f ever
User
2.1 and query. 4
y fresh 2 D
6.2 , Ap
viewport
54 rin 2 , 20 hael
.6 iCA
l2 Relevance Bad (User pri Intent)
l
Mi
c
Cupertino,by , 202 19062 Stevens Creek , A b y
Mi ay 4.6
cha 4 Blvd
fr The result includes a street
esd .number
5 when the
el D om I T .16 2this result too
u
query is for a street, making
Cupertino,
eve P CA, 95014
rs 172
specific for the more general query.

53
 Query Result Rating and Explanation
IP
[The Slanted ro m rs Relevance Bad (User Intent)
2 4 f Deve
Door 0 l
, 2 haeBuilding
One l 2 Ferry #3 Tu
One Ferry r i i c
Result is for the
17 address
es and not the business
AOne Ferry Building #3 San
p M
2.1 day,
Building #3 day, .6 by requested in the query,
6.2 Apso it does not satisfy the
es
San Francisco, 54Francisco, CA 94111 54 ril 2
Tu .16.2 user intent. .6
172
California 94111] by , 202
Mi
cha 4 fro
Relevance el D m I
Navigational
[One Ferry eve P
The Slanted Door
Building #3 San The query is for an address and the result
rs
is the
One Ferry Building #3
Francisco, business at this address. Including the business
San Francisco, CA 94111
California 94111] name provides additional correct information.
Relevance Navigational
San Francisco
[san francisco] San Francisco, CA Query is for the city of San Francisco and the
result satisfies the user intent.
User and fresh
viewport in San Relevance Good (User Intent)
Francisco, CA San Francisco
International Airport The result represents the airport within the
San Francisco, CA queried locality, which satisfies the secondary
transit intent.

The Pruneyard Relevance Navigational

1875 South Bascom Ave The query is for a mall and the result is the mall
Campbell, CA the user asked for.

The Pruneyard Relevance Bad (User Intent)

Pruneyard Cinemas The query is for an entire mall and the result is
1875 South Bascom Ave for a cinema inside the mall. Even though the
Campbell, CA cinema shares the mall’s name and address, it
does not match the query intent.

5.15. Multiple Transit POIs with the Same Name

Tu IP
Many m s
17 large
e sda transit POIs include multiple means of transportation at the same location. For 4example, o
f ever
r
large2.1airports
y
6.2 , Ap can have metro or train service within the same location, or train stations , 202 abe
can el Da hub
5 r l 2 c h
for trains, metros,
4.6 i l 2 and buses. Other transit POIs at the queried transit POI shouldAbe pr treated
i M as
i
by , 202 , 6 by if the result is
secondary intent Miwith4 an initial rating of Good, but can also be considered Acceptable
a y
4.
c
less likely to satisfyhathe
fro esd .25on
el Duser’s
m
I
intent. Additional demotions can be appliedTubased1 6 the prominence
of the returned feature. eve P 1 72.
rs

54
 Query Result IP Rating and Explanation
ro m rs
2 4 f Deve
Hamburg ,2 0 el Relevance Navigational
r i l 2 icha Airport Tu
, A22335
p y M Hamburg, Germany 17 isesfor
Result
y b 2.1 day,the queried airport.
e s d 54.6
a 6.2 Ap
r
Tu .16.2 Relevance 54 Good
.6 il 2, 2 (User Intent)
172 by
Mi 024
[hamburg airport] Hamburg Airport Station cha fro
m
el D at
22335 Hamburg, Germany Result refers to the train station eve Hamburg
IP
User and fresh Airport. rs
viewport in Germany
Relevance Bad (User Intent)

Lufthansa Basis The result is for a small bus stop that seems to
22335 Hamburg, Germany service the Lufthansa training center. The result
does not share the same name as the queried
transit. Therefore, the result is not relevant.
Relevance Navigational
The query is for a unique transit station. The
Embarcadero Station result (a unique BART station) fully satisfies the
[Embarcadero
San Francisco, CA user’s intent.
Station]
Acceptable (User Intent &
User and fresh Relevance
Distance/Prominence)
viewport in San Jose,
CA Ferry Building & The result (a historic streetcar) name includes
Embarcadero Station the queried station name, but has low
San Francisco, CA prominence, given that there is a unique
Embarcadero Station. Therefore, the result
should be demoted based on user intent.

5.16. POIs and Transit Intent

A non-transit POI can be associated with a transit POI with the same name. You can establish the
relationship between the two entities by using local knowledge, researching prominence, and
understanding how well the result satisfies user intent. This way you will learn whether the query has
a distinct navigational intent or if the prominence of the two POIs that share a similar name is so
strong that both can be the intent.

Tu Query Result Rating and Explanation IP

o m rs
17 esda f r ve
2.1 y, 0 24 l De
[mall
6.2 ofAAmerica] Relevance Navigational
2, 2
ha
e
54 pril 2 Mall of America ril Mic
.6 p
by , 202 60 E Broadway, y, A .6 by
User and freshMviewport
ich 4 fro d a
in ael mBloomington, MN es .254
IP Tu in.1the
Result is POI requested 6 query.
De 55425
Minnesota ver United States 172
s

55
 Query Result Rating and Explanation
IP
ro m rs Good/Acceptable
Mall 2 4of
f America
eve
0 el D Relevance (User Intent &
Station
,2
i l 2 icha Tu Distance/Prominence)
p 8240
r M 24th Ave S 17 esda
y , A 6 by 2.1 y,
a . Minneapolis, MN .25 Aprhas
Even though the 6station the same name as
esd 54
Tu .16.2 55425 4.6 il 2,
the POI, it is not prominent
172 by 202 therefore
and
United States demoted. Mi
cha 4 fro
el D m I
Relevance eve P
Excellent
rs
Result is for famous square in London. The
square and the train station are both equally
Piccadilly Circus prominent and local users would be looking for
[Piccadilly circus] London, UK the station while tourists would be looking for
User and viewport in the square. As both features are equally
London, UK prominent, it is hard to establish a distinct user
intent.

Piccadilly Circus Relevance Excellent

Station Result is the famous station that is just as
London, UK prominent as the square.
Dam Square Relevance Navigational
Dam Square,
Amsterdam, The result is the famous square in Amsterdam.
[dam square] Netherlands
User and viewport in Dam Square Line 2 Good/Acceptable
Relevance
Amsterdam Dam Square, (Distance/Prominence)
Amsterdam,
Netherlands Result is for the tram stop for line 2. The stop is
on a street adjacent to Dam Square. However, it
is not prominent and should be demoted.

5.16.1. Transit Queries

The criteria described above should be applied to understand the transit queries. Additionally, if it is
determined that a query has a clear navigational intent, all other results will be Bad (see [12th st
oakland bart] example below). If a result is promoted to Navigational, other results that could
potentially satisfy the user intent should be demoted further for distance and prominence (see
[BART daly city] and [stockport station] examples below). In general, the fewer the results that IP
Tu the user intent, the farther away the results can be and still be considered relevant. The
satisfy o mmores
e
17 sda 4 f ever
r
available
2.1 results
6.2 , Ap that can satisfy the user intent, the closer they need to be.
y 202 ael D
54 r 2 , h
.6 il 2, 2 pril Mic
by , A y
Mi 024 day 54.6
b
cha fro e s
el D m I Tu .16.2
P
eve
rs 172

56
 Query Result Rating and Explanation
IP
ro m rs Relevance Navigational
0 2 4 f Deve
,2 el
r i l 2 icha Tu
The query is for a1 specific
e BART station with a
p yM 72 sday
, A12th St. Oakland unique name that is.not16 the , same as the name of
s a y
d 5Station
4 .6 b .25 Apri
e the locality where the station
4.6 isl 2found. (Compare
Tu .16.2
Oakland, CA ,2
172 b
this to the examples below). yThis Mi result
02
4 f matches the
[12th st oakland query exactly and fully satisfies the c ha user’s
el D om I intent for
r
bart] this specific station. eve P
rs
User and viewport in Relevance Bad (User Intent Issue)
California
The query intent is for a specific BART station with a
19th St. Oakland unique name that is not the same as the name of the
Station place where the station is located. The result
Oakland, CA returned is for a different BART station and does not
satisfy the user intent. This result should receive a
rating of Bad.
Relevance Navigational

Daly City Station The query intent is for a BART station in Daly City.
Daly City, CA Research shows that there is only one BART station
in Daly City and its name is Daly City Station, so this
result fully satisfies the user’s intent.
Relevance Good (Distance/Prominence)

The query intent is for a BART station within Daly

City. This result fits intent as it is a BART station.
Colma Station This station is in a neighboring locality just outside
Colma, CA of the requested locality. Even though the station is
[BART daly city]
outside of the requested locality, it provides a
User and viewport in choice of BART stations in the area for the user.
California This result is demoted due to distance.

Relevance Acceptable (Distance/Prominence)

San Francisco
International Airport
Tu Station The query intent is for a BART station in Daly City. IP
o m rs
17 esda San Francisco This result fits intent as it is a BART station.4 This f r ve
2.1 y, station is in a neighboring locality, but is 2 l De
farther
0
6.2 Ap International Airport, , 2 a e
54 ril 2 away than the Colma station and isprdemoted il 2 Mich due to
by , 202 CA
.6
Mi distance. a y, A .6 by
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

57
 Query Result Rating and Explanation
IP
ro m rs Relevance Navigational
0 2 4 f Deve
,2 el
r i l 2 icha Tu
esd
p yM The query intent 1is72for
a y , AStockport
.6 b
Station .16 aastation
y, A in Stockport.
e s d 5Stockport,
4 England Research shows that there .25 are p several stations in
Tu .16.2 4.6 ril 2,
Stockport, but only one named by Stockport
20 Station,
172 M 24
so this result fully satisfies the user’s
ich fintent.
ael rom
De IP
ve
Davenport Station Relevance Excellent rs
Stockport, England
[stockport The query intent is for a station in Stockport. There is
station] one station with a name that matches the query
Heaton Chapel exactly, which receives the Navigational rating. All
User and viewport in Station other stations within the queried locality should
Stockport, England Stockport, England receive Excellent.

Relevance Good (Distance/Prominence)

This station is just outside of the requested locality,

in a neighboring locality. Even though the station is
Burnage Station outside of the requested locality, it provides a choice
Manchester, England of stations in the area for the user. The fewer choices
there are available, the farther away the results can
be and still be relevant. This result is demoted due to
distance.

Relevance Excellent
San Jose Diridon
Station
[san jose station] San Jose, CA The query intent is for a station in San Jose. There
are several stations in San Jose, but no stations with
User and viewport in a name that matches the query exactly, so we should
California rate every station within the queried locality equally.
Tamien Station There are two stations that match the user’s intent,
San Jose, CA so both results should be rated Excellent.

Relevance Good (Distance/Prominence)

Tu This station is just outside of the requested locality, IP

o m rs
17 esda Lawrence Caltrain in a neighboring locality. Even though the02station
r
4 f Devise
2.1 y, l
6.2 A Station outside of the requested locality, it provides
2
2, ichaae choice
54 pril 2 i l
.6
by , 202 Sunnyvale, CA of stations in the area for the user. pr y fewer
M
Mi a y , A The
6 b choices
cha 4 fro there are available, the farther
u e s d away
.2 54 . the results can
el D m I be and still be relevant. T 72.16
eve P 1
rs

58
 Query Result Rating and Explanation
IP
ro m rs Relevance Acceptable (Distance/Prominence)
0 2 4 f Deve
,2 el
i l 2 icha This station is just Toutside
u of the requested locality,
Sunnyvale
p r M Caltrain 17 esda Even though the station is
in a neighboring locality.
y , A 6 by 2.1 y,
a Station
. outside of the requested A
6.2 locality,
esd 54
Tu .16.2 Sunnyvale, CA 54 pril 2 it provides a choice
.
of stations in the area for the 6 b user.
y M 20The fewer choices
,
172 24
there are available, the farther away ich thef results can
be and still be relevant. ael rom
De IP
ver
Relevance Bad (Distance/Prominence) s
Palo Alto Train Result is far from the queried station. The farther
Station away the result is from the queried station, the less
Palo Alto, CA likely it is that it will be considered relevant, so the
relevance rating should be lowered.

5.16.2. Stops vs. Stations

A transit stop is a location typically designated by a bench or covered waiting area, a posted sign, or
street markings. Transit stations, on the other hand, are typically larger areas associated with major
structures including, but not limited to, platforms, ticketing offices, enclosed waiting/seating areas, or
terminal buildings/structures encompassing the transit area. The term “station” is primarily used to
refer to transit locations that are larger and typically a terminal housing multiple routes. All stations
are stops, but not all stops are stations.

Since all stations are stops, but not all stops are stations, returning a station for a stop query is ok, but
returning a stop when the query is station should result in a rating of Bad with the User Intent
checkbox selected. Try to identify these corresponding terms in the test locale and understand the
relationship between them.

For the category [bus stops], relevance should be based mainly on distance from the user location
or fresh viewport and the physical size of the bus stop. If the result is a small bus stop in a rural area
and the bus stop is among the closest ones to the user’s location intent, it should be rated Excellent.
On the other hand, if the result is a large bus hub that is a bit farther away from the user, it should still
receive an Excellent because of its size, regardless of the fact that there are closer, smaller bus
stops. Results close to the user should not be demoted because there is a larger bus stop farther
away, instead, the large bus stop should be promoted because of its importance.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

59
 Query Result Rating and Explanation
IP
o m rs
r
eve
4 f DLines Relevance Excellent
Greyhound 0 2
, 2 hael
200
i l 2 Folsom
c St Tu
p y Mi
r This is a major
17 buses station in San Francisco
y , A San b Francisco, CA 94105 2.1 day,
s da 54.6 where a user can6take.25 AGreyhound
p buses.
e 4.6 ril 2,
Tu .16.2
172 by 202
Main St & Folsom St Mi
cha 4 fro
San Francisco, CA 94105 Relevance el D m I
Bad (User Intent)
[bus station in san eve P
francisco] rs

User and viewport in

San Francisco, CA These results are small local bus stops and do
5th St & Howard St not satisfy the user intent for a bus station.
San Francisco, CA 94103

Relevance Bad (Distance/Prominence)

Sacramento Bus This result is another Greyhound station, but it is
Station in Sacramento, quite far from San Francisco.
420 Richards Blvd There are closer real world results we could
Sacramento, CA 95811 return. This result is too far and should be
demoted due to distance.

Relevance Excellent
Chicago Bus Station
630 W Harrison St The query intent is for a bus stop. This result is
Chicago, IL 60607 a Greyhound station, which fully satisfies the
user's intent. This result is close to the user.

Relevance Excellent
[bus stop] W Harrison St & S The query intent is for a bus stop. This result is
Jefferson St a Greyhound station, which fully satisfies the
User and viewport in Chicago, IL 60607
Chicago, IL user's intent. This result is close to the user.

Relevance Bad (Distance/Prominence)

The query intent is for a bus stop. This result is a
Harlem Ave & W 115th bus stop and matches the user's intent, but
St there are many bus stops closer to the user in
Tu Worth, IL 60482 the real world we should be returning instead. IP
m rs
17 esda r o
f eveto
2.1 y, Therefore, this result should be demoted 24 due
6.2 Ap distance. 2 , 20
a el D
54 ril 2 l c h
.6
by , 202 A pri y Mi
Mi ,
ay .6 b
cha 4 fro uesd .254
el D m I T .16
eve P 172
rs

60
5.17. Parking Intent IP
ro m rs
0 2 4 f Deve
, 2 hael
When evaluating [parking] i l 2 queries,
c note that: Tu
p y Mi
r 1 es
a y A
, 6b
.
72.1 day,
esd .2parking
54 6.2 Ap
• Free andTu paid 6 are equally relevant. 54 ril 2
.6
.1 , 2 changed by the
• Parking 1time
72 limits do not affect relevance rating. Your rating should bnot y Mbe 02
i 4
fact that a parking lot is long term, short term, or limited-time (like a two-hourc ha flimit)
r parking.
el D om I
• Parking for small cars, large cars, RVs, or motorcycles is equally relevant. ev P
• If you can find evidence that a result is for private parking that cannot be used byethe rs general
public, give it a rating of Bad.

Public parking vs Private Parking

Public parking is:

• Parking that is a mix of residential/staff/permit and visitor parking and is not in a gated
community
• Parking that can be used only when visiting a certain business (limited-use parking)

Private parking is:

• Parking that is residents only, staff only, or by permit only

• Parking in a gated community

If you cannot confirm whether parking is public or private, give the result the benefit of the doubt
and consider it public parking.

5.18. Relevance: Service-Level Mismatch

Sometimes a query specifically requests a certain level of service, which may or may not be reflected
in the result. Common requests include:

• Specific stores (e.g. Walmart Supercenter)

• Outlet stores (e.g. J. Crew Factory)

When the query requests a specific level of service which is not reflected in the result, give an initial
rating of Good and demote as necessary depending on how well the result would satisfy the user
intent.
Tu IP
e r o m rs
When
17 the s f eve
2.1 dayquery requests a type of business with a generic level of service, providing a result 24 lthat
offers more
, A
6.2 service
p than requested still satisfies user intent and should receive an initial
2 , 20
ratinga e Dof
54 r il l c h
Excellent. .6 by 2, 20 A pri y Mi
Mi 24 y, b
cha fro ue sda 254.6
When the query does m
el not
De specify
IP the type of service, any relevant result can
T be
2 . 16. rated Excellent.
ver 17
s

61
 P
Query Resultom I rs Rating and Explanation
r
2 4 f Deve
,2 0 el Relevance Excellent
r i l 2 icha Tu
es
p M 17 Walmart
Query is for a generic
a y , A 6 by Supercenter
Walmart . 2.1 day, and the result is a
A
6.2 that
esd .254 East Broadway Walmart Supercenter store 54 priloffers more
Tu .3435
16 . 6 2
services than the average Walmart by 2store.
, User
172Blvd, Tucson, AZ 85716 02
intent has been met and there isMno 4 f to
ichneed
ael rom
demote for service level. De IP
[walmart] ver
s
Relevance Excellent

Walmart Neighborhood
Market The query does not specify the type of Walmart,
5500 E 22nd St, Tucson, and any Walmart can be rated Excellent. Demote
AZ 85711 further for distance.

Relevance Good (User Intent)

Walmart Neighborhood Query is for a store with specific level of service.

[walmart Market Walmart Supercenters are very large stores that
supercenter] 5500 E 22nd St, Tucson, have a full range of grocery and general
AZ 85711 merchandise. A Walmart Neighborhood Market is
generally smaller with a more limited array of
grocery and general merchandise.
Relevance Good (User Intent)
Nordstrom The query is for an outlet store, but the result is for
[nordstrom 55 E Grand Ave, Chicago,
rack] a full-price store. The result satisfies the query
IL 60611 intent, but to a lesser degree.
Bank of America Relevance Excellent
10900 Orangewood Blvd,
Orlando, FL 32821

[bank of When the query is for a bank or a general bank

america] Bank of America ATM brand, an ATM or a branch location of that specificIP
Tu m s
e
17 sda 10900 Orangewood Blvd, brand are equally relevant. fro ever
2.1 y, 4
6.2 Ap Orlando, FL 32821
2 , 202 ael D
54 r h
.6 il 2, 2 pril Mic
by , A y
Mi 024 day 54.6
b
cha fro e s
el D m I Tu .16.2
P
eve
rs 172

62
 Query Result Rating and Explanation
IP
ro m rs Relevance Excellent
0 2 4 f Deve
,2 el
r i l 2 icha Tu
p
, A 6 by
M 17 esda
a y . 2.1 y,
esd 54 6.2 Ap
Tu .16.2 54 ril 2
.6
172 by , 202
Mi
cha 4 fro
el D m I
The result is a bank branch location. Since evemany
P
Citibank branches contain ATMs, and would be able to r s
3333 E Tropicana Ave provide the same level of service as an ATM, this
Las Vegas, NV 89121 result usually fulfills the user’s intent.

[ATM] Note that if research indicates the result does not

offer cash services, rate it Bad.

Relevance Excellent
Citibank ATM 7-Eleven
3421 E Tropicana Ave This is an ATM located inside a 7-Eleven
Las Vegas, NV 89121 convenience store. It satisfies the primary intent of
the category.
Relevance Bad (User Intent)
A user has asked for a specific fast food restaurant
McDonald’s and the result is another fast food restaurant that
[burger king] 6875 Sand Lake Rd, offers similar food and service. Even though the
Orlando, FL 32819 service level in the two restaurants is similar, this
result does not match the user intent for the
named restaurant.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

63
5.19. Rating Relevance When Result IP Status is PERMANENT_CLOSURE
ro m rs
0 2 4 f Deve A business/POI that has its status set to
2 , 2 hael Tu requires special consideration
l
pri y Mi
c PERMANENT_CLOSURE es
1
a y A
, 6b
.
7
during relevance rating.2.1 day,
esd 54 6.2 Ap
Tu .16.2 54 ril 2
.6 ,2
172 Note: A result without any status by indicated
Mi 024 should be
rated as usual, including when research c ha indicates
f r the
el D om I
business/POI is closed or does not exist. eve P
rs
There are some situations where you can expect to see results with the status
PERMANENT_CLOSURE and others where such results are not expected. The following sections will
describe how to identify and rate them.

5.19.1. Expected PERMANENT_CLOSURE Status

IP
Sometimes
Tu
e you can expect to see results whose status is shown as PERMANENT_CLOSURE.rom ers
17 sda f v
2.1 y,
20 24 l De
6 A 2, e
This can.25happen
4.6 ril 2,when:
p ha
pril Mic
by 202
Mi 4 da y, A .6 by
• The permanently cha fclosed
rom result satisfies the user intent completely. ues .254
e T .16
AND l D IP
eve 172
• There is/are no other rresult(s)
s that satisfy the actual user intent in the area of location intent.

64
Examples of results where PERMANENT_CLOSURE status is expected
IP
• Navigational queries: ro m rs
2 4 f Deve
• Queries that can only , 2 hreturn
0 el a single result, which is permanently closed. This could be
because the POI r i i c a
l 2or business name is unique or the query Tcontains
ues location intents like
A p yM 1 7 da
locality or ,
a street
y .6 components.
b 2 y
.16 , A
uesd for
• Chain queries . 2 54closed chains:
.25 pri
4.6 l 2,
T .16
• All chain2 2
by closed
1 locations within the area of location intent are permanently
7 Mi 024 and the closest
open chain result is significantly farther away. c ha from
el D I
eve P
Rating Approach rs

Rate results with an expected status of PERMANENT_CLOSURE as if they were open. This means
that in most cases the rating will be either Navigational or Excellent, because even though they are
closed, these are the best or only results that could ever be returned.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

65
5.19.1.1. Expected PERMANENT_CLOSURE Status: Navigational Query
IP
o m rs
The user is looking for a unique4 business f eve in a specific location.
r
0 2 D
2 , 2 hael Tu
l c
pri y Mi
Query User
es
2.1 danday, Viewport
A
, 6b 1 7
a y .
es d 5 4 6 .25 Apri
Tu .16.2santa cruz]
[99 bottles User and fresh viewport 4.6 in lSan
2 Luis Obispo, CA
1 7 2 by , 202
Mi
cha 4 fro
el D m I
eve P
rs

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

66
 Result IP Rating and Explanation
ro m rs
4 f eve
2 D
2 , 20 hael Relevance Navigational
Tu
r i l i c es
p yM 1
a y A
, 6b
.
Business/POI 72.1 day,
esd .254 On The 6.2 Ap
① 99 Bottles uOf Closed/Does not Yes
T .1Beer
6 54 ril 2
.6
Wall 172 exist by , 202
Mi
PERMANENT_CLOSURE cha 4 fro
This permanently closed restaurant is the onlyeresultl D m Ithat
110 Walnut Ave, Santa Cruz, CA eve P the
meets the user intent, which makes it expected. Choose rs
Business/POI Closed/Does not exist checkbox and rate the
business as if it were open.
Relevance Bad (User Intent)
② 99 Cents Only Stores
260 E 10th St, Gilroy, CA The 99 Cents store does not match the user intent and is rated
Bad.
Relevance Bad (User Intent)
⓷ 99 Bottles & Cocktails While also a restaurant with a name that starts with 99 Bottles,
8901 Katella Ave, this is not in Santa Cruz, does not match the user intent, and is
Anaheim, CA rated Bad.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

67
5.19.1.2. Expected PERMANENT_CLOSURE IP Status: All chains closed in area
ro m rs
0 2 4 f Deve
Chico’s has closed all of its , locations
2 el in Canada. The closest locations to the user are across the
r i l 2 icha Tu
border in the United States.
p yM 1 es
a y A
, 6b
.
72.1 day,
esd 54 6.2 Ap
Tu .16.2 54 ril 2
Query User and .6 Viewport
172 by , 202
Mi
cha 4 fro
[chico’s] Fresh viewport in Toronto, ON, user in Hamilton,
el D m
I ON
eve P
rs

Result Rating and Explanation

Relevance Excellent
Business/POI Closed/
① Chico’s Yes
Does not exist
PERMANENT_CLOSURE
100 City Centre Dr, The permanently closed location for Chico’s is in the center of the
Mississauga, ON fresh viewport. Since there are no open locations anywhere close
to the area, this result is expected. Choose the Business/POI
Closed/Does not exist checkbox and rate the business as if it
were open.
Relevance Excellent

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap , a e
54 ril r il 2 Mich
② Chico’s.6 by 2, 20 The open Chico’s closest to the user is just across p the border.
2 y, A .6 by
5151 Main St, Mich 4 fro Because it is the closest open result, it is rated
es da Excellent.
54
Williamsville, NY
ael m Tu .16.2
De IP
United States ver 172
s

68
 Result Rating and Explanation
IP
⓷ Chico’s om vers
frRelevance Good (Distance/Prominence)
2 4 D e
3349 Monroe Ave Ste 45, , 2 ael 0
l 2 ch Tu
Rochester, NY pri y Mi As the second-closest open es the Chico’s in Rochester is
location,
1
United States y A
, 6b 72.1 day,
a
esd 54
. demoted to Good. 6.2 Ap
Tu .16.2 54 ril 2
.6
172 by , 202
Mi
cha 4 fro
el D m I
5.19.2. Unexpected PERMANENT_CLOSURE Status eve P
rs
These are results whose status is shown as PERMANENT_CLOSURE, but are not expected to be
shown at all.

Results with the status PERMANENT_CLOSURE are unexpected when there are also open results in
the area of location intent that would satisfy the actual user intent fully without changing or altering
the user query.

Examples of situations where results with PERMANENT_CLOSURE status are not expected

• Category queries:
• There are always a large number of possible results for category queries like [restaurant]
or [hair salon]
• Note: In cases where there is only one match for the category query within a large area and
it is marked with the PERMANENT_CLOSURE status, consider it an exception and choose
Business/POI is closed or does not exist, then rate it as if it were open. This should be
extremely rare.
• Queries with several possible interpretations:
• These are queries could have several possible results and/or result types available, and do
not depend on PERMANENT_CLOSURE results.
• Most chain queries:
• There are often multiple locations of a chain available within the area of location intent, and
a permanently closed result does not need to be shown in these cases.

Rating Approach

Unexpected permanently closed results should be demoted by 2 for relevance which means the
highest rating starts at Acceptable.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

69
5.19.2.1. Unexpected PERMANENT_CLOSURE IP Status: Open Options are Nearby
ro m rs
0 2 4 f Deve
There are many options available l
enear the user for this category query,
i
,2
l 2 icha Tu so there is no reason to show
r
a permanently closedApbusiness. M 17 esda
a y , 6 by 2.1 y,
s d 54 . 6.2 Ap
e 54 ril 2
Tu .16.2 .6 Viewport
Query User and by , 202
172 Mi
cha 4 fro
[vintage store] User and fresh viewport in Washington,
el D m I DC
eve P
rs

Result Rating and Explanation

Relevance Excellent
① Meeps Vintage
2104 18th St NW, Washington, Meeps Vintage matches the user intent and is close to the user
DC within the fresh viewport.

Relevance Excellent
② Miss Pixie's
1626 14th St NW, Washington, Miss Pixie’s sells vintage clothing and is among the closest
DC results for this category query.
Tu IP
Bad or Acceptable m rs
⓷17Buffalo
es Exchange Relevance f r o ve
2.1 day, (User Intent) 0 24 l De
PERMANENT_CLOSURE
6.2 A 2, 2
ha
e
5 pril 2 ril Mic
1318 14th4.St
6 b NW,, 2Washington, Business/POI Closed/ p
DC y M 02 Yes a y, A .6 by
ich 4 fro Does not exist es d 54
ael m Tu .16.2
De IP
ver 172
s

70
 Result Rating and Explanation
IP
m rs
4 fro The
eve permanently closed Buffalo Exchange did sell vintage
0 2 D
,2 el clothing, but since there are other open stores that do this in the
r i l 2 icha Tu
p yM area of location intent, this result
1 eiss unexpected. The relevance
y A
, 6b 72.1 day,
a
esd 54
. rating starts at Acceptable. Given 6.2theAabundance of nearby
Tu .16.2 54 pril 2
results, this could be rated Bad, as well.
. 6b ,2
172 y M 024
ich fro
ael m
De IP
ver
s

6. Name and Category Accuracy

The Name and Category Accuracy rating is used to evaluate the accuracy of a Business/POI name.
Your final rating will take into consideration both the accuracy of the Business/POI name and the
category assigned to it. Inaccuracies in either or both of these elements will result in rating
demotions.

You’ll see this rating referred to throughout the guidelines as both “Name Accuracy” and "Name and
Category Accuracy.”

Business/POI Name and Category Accuracy can be rated as:

• n/a
• Correct
• Partially Correct
• Incorrect
• Can’t Verify

If you give a final Name and Category Accuracy rating of Partially Correct or Incorrect, you may be
presented with two checkboxes:

• Name Issue
• Category issue

If they appear, use one or both them to select the reason(s) for your rating.

6.1. Name Not Applicable (n/a)

The n/a rating should be used for all address type results, including residential addresses, streets,
localities, and so on.
Tu Business/POI type results, address type results do not actually have a result name. Instead, IP
Unlike e r o
f eve
m rthe
s
17 sda 4
first 2line
.16 ofy, address
Ap type results appears as the result title. This is because this field is meant 202 aeto lD
. 2 2 ,
present the 54 most
.6 il 2, relevant
r part of the address information. l c h
by 202 A pri y Mi
Mi y, b
cha 4 fro u e sda 254.6
el D m I T .16.
P
eve
rs 172

71
 IP
ro m rs
0 2 4 f Deve
,2 el
r i l 2 icha Tu
p
, A 6 by
M 17 esda
a y . 2.1 y,
esd 54 6.2 Ap
Tu .16.2 54 ril 2
.6
172 by , 202
Mi
cha 4 fro
el D m I
eve P
rs

Since address results do not have a name or category, their Name and Category Accuracy cannot be
evaluated. This is why the n/a rating should be selected.

Result Rating and Explanation

1703 NW Taylor St Name and Category Accuracy n/a
1703 NW Taylor St
Topeka, KS 66608 This is a residential address, not the name or title of a business or POI.

1600 Pennsylvania Ave Name and Category Accuracy n/a

1600 Pennsylvania Ave, Although this is the address of a well-known POI (the White House), it
Washington, DC, 20500 is still an address result and contains no name or title. It cannot be
United States rated for Name Accuracy.
Name and Category Accuracy n/a
Paris, France
Paris, France This is the name of a locality and country, not the name of a business
or POI.

6.2. Result Names

Your final Name and Category Accuracy rating will take into consideration both the accuracy of the
Business/POI name and the category assigned to it.

First, consider the name.

Tu Correct Name IP
6.2.1. e r o m rs
17 sda f ve
2.1 y,
20 24 l De
A business/POI A e
54 pril result name is accurate when it is used on the POI’s official website or on
, other
a official
6.2
. 2 r il 2 Mich
resources. Even 6 by if, 2the
02 official website does not use the name, if it is used on other official sources, the
p
y, A .6 by
name is correct.MNote ich fro 4 that the name has to be used to refer to the particular POI.
d a The
4 corporate name
a m ues 6.25
by itself is not automatically
e l D IPthe correct name. T 1
eve 1 72.
rs

72
 IP
Business Name ro m rs
0 2 4 f Deve
, 2 hael
Every name that a specific i l 2 business
c location uses to refer to itself Tisuconsidered correct. These
A p y Mi
r 1 7
esd
ay
names can be listed ,in a6variety of ways in different sections of the 2entity's
6.2 , Aofficial website or official
a y . b . 1
e s d 54 pri
social media website(s):
u
T .16 . 2 5 4.6 l 2
172 by , 202
Mi
cha 4 fro
• Chain business locator page on the official website el D m I
• About/About Us section on an entity’s official website eve P
rs
• Signs and storefronts seen on official sites or social media pages
• Claimed social media pages

If these resources are not available, other reliable sources that can be used for researching business
names include:

• Signs and storefronts seen on recent street or online imagery or crowdsourced review pages
• Recent articles in primary publications (newspapers or similar publications that do their own
reporting)
• Official restaurant menus (user photos or scanned images from restaurants)

If the name cannot be confirmed with these resources and there is nothing objectively wrong with it,
rate it Can’t Verify.

Corporate name

The corporate name (and sometimes brand or product name) is often used to refer to a particular
entity, but might be not the preferred name for a specific location. This depends on the particular
company and the specific result.

Some official websites have a local language and an international (English) version. Consider the
name given in the international version only if English is the language/script of the test locale, the
query, or the result region, or if the official company, chain, or brand name is commonly used and
understood in English in this market. If it is not, select the Result name/title is in unexpected
language or script checkbox. No further rating is required.

Result Name Official Business Name Rating and Explanation

Name Accuracy Correct

McDonald’s McDonald’s The chain calls all stores McDonald’s and has the
name in front of all locations as corporate
IP
Tu branding. o m rs
17 esda f r ve
2.1 y, 0 24 l De
6.2 Ap Name Accuracy Correct 2, 2
ha
e
54 ril 2 ril Mic
.6 p
by , 202 The name is considered Correct, y, A .6because
by it is
Peet’s Coffee M&i a
cha 4Peet’s
fr - Polk Street d
used on the sign on theTstorefront.
4
ues 6.25 The store is
Tea el D om I 1
eve P 72. Street” on the
officially called “Peet’s -1Polk
rs website, as it refers to the Polk Street location.

73
 Result Name Official Business Name Rating and Explanation
IP
m s Name Accuracy Correct
4 fro ever
0 2 D
,2 el
r i l 2 icha Tu
es
p yM 1
a y A
, 6b
.
72.1 day,
esd 54 6.2 Ap
Tu .16.2 54 ril 2
.6 ,2
172 The chain Best Buy uses a bylocation
Mi 024 modifier in
Best Buy Best Buy San Jose their store names, but their store fr
cha sign
el D om(logo)
IP
shows only the corporate brand name eve“Best Buy”
and can be rated Correct. r s

Name Accuracy Correct

The Microsoft storefront shows only the Microsoft
logo without any text. On the webpage, stores are
Microsoft Microsoft Store referred to as “Microsoft Store” or named
together with a location modifier such as
“Microsoft Store – South Coast Plaza”. Because of
the close similarities between the result name and
the store name, rate Correct.

Location modifier or affiliation

Businesses can include the name of the locality or the larger complex or organization they belong to
as additional information. These modifiers, even when not specifically used by the official resources,
can be considered correct. A name with missing modifier can also be considered correct as long as
the modifier isn’t crucial for understanding the particular result. If a modifier is present, it must be
spelled correctly. If it is misspelled, the name is partially correct.

See your Country Specific guidelines for cases where the location modifier is essential for
understanding the result.

Result Name Official Business Name Rating and Explanation

Tu IP
17 esda Name Accuracy Correct f r o m rs
ve
2.1 y,
20 24 l De
6.2 Ap , a e
54 ril 2 r il 2 Mich
Apple
.6
by , 202 Apple Valley Fair The result name is missing the ,location
p modifier
Mi y A .6 by
cha 4 fro (Valley Fair) given on the official
d a
es .25 website,
4 but is still
el D m I considered Correct. T u 6
.1
eve P 172
rs

74
 Result Name Official Business Name Rating and Explanation
IP
ro m rs Name Accuracy Correct
0 2 4 f Deve
,2 el
r i l 2 icha Tu
p
, A 6 by
M 17 esda
Peet’s Coffee sday Peet’s
. – Ferry Bldg SF The result name is2.1Correct
6.2 , Ap because it is used as
y
e .254 the name on the official 54website,
.6 il 2, 2 while the specific
u r
T .16
172 store has an optional locationby modifier.
Mi 024
cha fro
el D m I
eve P
Name Accuracy Correct rs
Old Navy – Belle Old Navy doesn’t officially use the mall name as
Old Navy
Isle Station part of the store name, but the location modifier is
correct, so the business name is rated Correct.
Name Accuracy Correct
Delgado
Community
Charity School of The result for the Nursing School includes the name
College –
Nursing of the college that it is affiliated with. Even though
Charity School of
Nursing this form is not official, it is rated Correct.

Stylized logos and letters

A variation is still correct when a business uses stylized logos and letters (like the backwards “R” in
Toys ”R” Us) that are outside the regular set of letters.

Result Name Official Business Name Rating and Explanation

Name Accuracy Correct

Toys ‘R’ Us Toys Я Us This business uses a special character in its name,
so the name is still considered Correct.

“The” is missing or added

• Missing: The use of definite articles depends on the individual result. When a company using
“the” is often referred to without it, the name is correct both with and without the article.
• Added: A business/POI that does not officially include a definite article in its name but has one
included in the result should be considered partially correct.
Tu IP
e r o m rs
17 sda f ve
2.1 y, Name
Result Official Business Name Rating and Explanation 20 24 l De
6.2 A , a e
54 pril 2 r il 2 Mich
.6 p
by , 202 Name Accuracy Correct y, A by
Mi 4
cha fro u e sda 254.6
Home Depot
el D m I
The Home
P Depot The official name of this T business
2 . 16. is “The Home
eve 1 7
rs Depot,” but since it is so often referred to as
“Home Depot” the name is considered Correct.
75
6.2.2. Partially Correct Name IP
ro m rs
f eve
4from
A partially correct name differs 0 2 D the official versions but can still be recognized by the user.
Partially correct names rcan , 2 hael minor and moderate misspellings,
li 2 include
c Tu service level mismatches, and
p y Mi 1 es
missing or unnecessary a y , 6name
A
. b parts, including holding names/corporate72.1 daystructures.
,A When the
business nameuon esd the 5 4
storefront does not include the corporate status 6.2(Ltd., p Inc., etc.) seen in the
r
T .16.2 54
. 6
il 2
result, it is partially
172 correct. by 202 ,
Mi
cha 4 fro
el D m I
eve P
6.2.2.1. Minor and Moderate Misspellings and Missing or Extra Words rs

Consider names partially correct when they contain issues that don’t prevent the user from
identifying the business:

• Name contains repeated, redundant, or missing information or parts

• Incorrect or missing punctuation or special characters
• Unnecessary or missing spaces
• Unexpected use of lower/upper case and ALL CAPS letters
• Acronyms are often expected in ALL CAPS: YMCA, TGIF
• Minor and moderate misspellings that don’t influence the user’s understanding. See your
Country-Specific guidelines for more information on misspellings.
• Mix of expected languages in the result title. Expected languages are the languages of the
query, test locale, or region, or of an official business name.

Result Name Official Business Name Rating and Explanation

Name Accuracy Partially Correct
Macys Macy’s
The result is missing an apostrophe.

Name Accuracy Partially Correct

HM H&M
Missing the “&” in H&M is a misspelling but the
name is still recognizable.

Name Accuracy Partially Correct

uhaul uhaul U-Haul

The result name is duplicated and in all lowercase
Tu with no “-”. IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2
.6 Name Accuracy Partially Correct p ril Mic
by , 202 y, A .6 by
Mi a
c 4 fro d
ues 6.25
4
Seven Eleven hael7-Eleven m T
The name is in an unexpected
72. form not used by the
De IP 1
ver business itself. 1
s

76
 Result Name Official Business Name Rating and Explanation
IP
ro m rs Name Accuracy Partially Correct
0 2 4 f Deve
GAMESTOP GameStop ,2 el
i l 2 icha The name writtenTin
uesALL CAPS is not expected for
p r M
y , A 6 by this business and
17 demoted.
2.1 day,
a . 6.2 Ap
esd 54 54 rilCorrect
Tu .16.2 Name Accuracy Partially .6 2
172 by , 202
Mi
cha 4 fro
el D m I
eve P
rs
Mosjaw Moosejaw The name of this outdoor store has two missing
letters but is still identifiable.

Name Accuracy Partially Correct

Ecofuture
Ecofutures Building Inc The business shows two misspellings and the
Buildng Co
incorrect business structure (Co. vs. Inc.).

Name Accuracy Partially Correct

Napoli The result name has additional parts not used by

Coffeehouse & Napoli Coffee the business. Because the additional parts are in
Pastries line with the business and don’t make the result
ambiguous, it is considered Partially Correct.

Name Accuracy Partially Correct

The additional “superstore” is not used officially,

GAP Superstore GAP but also does not change the user’s ability to
identify the well formatted and correct corporate
name and is therefore considered Partially
Correct.

Name Accuracy Partially Correct

Tu IP
o m rs
17 esda f r ve
2.1 y,
BerkeleyLaw BerkeleyLaw 0 24 l De
6.2 Ap The query [law] was issued in a cz_CZ , (Czech)
2 a e
54 of
Univerzitní ril University of r il 2 Mich
.6 2, locale and the result locale is the US y(English).
p
California b y 2
Mi 24California
0
Consider this Partially Correct da y, Adue
.6 bto the mix of
cha fro e s 54
el D m I Tu .16and
expected languages: English .2 Czech.
eve P 17 2
rs

77
 Result Name Official Business Name Rating and Explanation
IP
m s Name Accuracy Partially Correct
4 fro ever
0 2 D
,2 el
r i l 2 icha Tu
es
p yM 1
a y A
, 6b
.
72.1 day,
esd 54 6.2 Ap
Tu .16.2 54 ril 2
.6
172 by , 202
Mi
cha 4 fro
el m I
Aqua Spa 夢幻⽔ Aqua Spa - Ocean The query [aqua spa] was issued in D the
eve zh-Hant_HK
P
(Hong Kong) test locale and the result locale r s is in
都 City
the US (English). Consider this Partially Correct
due to the mix of expected scripts.

Name Accuracy Partially Correct

URLs can give an indication of a businesses’ official

name, but because a URL lacks formatting choices,
it should generally not be used to confirm the
att AT&T official business name. Similar restrictions exist for
certain social media such as Twitter.

The company’s name is confirmed by the URL

(att.com), but the name stated in the URL, “att”, is
clearly poorly formatted, but still recognizable.

Name Accuracy Partially Correct

University of University of California Irvine is more than a location modifier for this
California Irvine university. The city name differentiates the Irvine
location from other universities in the University of
California network.

Tu Name Accuracy Partially Correct IP

m rs
17 esda f r o ve
2.1 y,
20 24 l De
6.2 Ap Even though the Nike symbol appears
e
2, onhathis
54 ril 2 ril Mic
.6 p
Nike by , 202 NIKELAB 21M NYC store’s official website, the preferred
y, A .6 by store name
Mi a
cha 4 fro d
for this specific location uisesnot.2the
54 general brand
el D m I name but the NIKELAB name T 6
.1 seen on the store
eve P 172
rs sign and website.

78
 Result Name Official Business Name Rating and Explanation
IP
m s Name Accuracy Partially Correct
4 fro ever
0 2 D
,2 el
The Sears Sears i l 2 icha Sears does not useTu “The” in any of their official
r
p yM es
y A
, 6b webpages. Adding
1 72.1itdto
ay,the company name gives
a .
es d 5 4 6 25 April Correct.
the name a rating of .Partially
Tu .16.2 4.6 2
172 by , 202
Mi
6.2.2.2. Service-Level Mismatch cha 4 fro
el D m I
eve P
rs
Chain businesses often indicate the level of service provided at that location in their name. If the
result name does not reflect the correct type, it is considered a service-level mismatch and is
considered partially correct.

Result Name Official Business Name Rating and Explanation

Name Accuracy Partially Correct

Patagonia Outlet Patagonia The result name suggests that the store is an outlet,
which it isn’t.

Name Accuracy Partially Correct

Depending on its size and the services available,
Delhaize Delhaize Supermarkt this chain business comes in five varieties. The
result is missing part of the name indicating its
service level.
Name Accuracy Partially Correct

Best Buy Best Buy Express A Best Buy Express is a vending machine and not a
store. This is a service-level mismatch and
considered Partially Correct.
Name Accuracy Partially Correct

Best Buy Express Best Buy The user is expecting a vending machine where
there is a store. This is a service-level mismatch
and considered Partially Correct.

Tu IP
e r o m rs
17 sda f ve
2.1 y, 0 24 l De
6.2.2.3.6Holding
.25 priName and Corporate Structure
A 2, 2
ha
e
4.6 l 2, p ril Mic
by 202
Mi 4 da y, A .6 by
4
es .25explicitly
ha from structures are not considered correct if they are
Holding names orccorporate
el D I Tu .not
1 6 used by
the individual stores. Holding P
eve names or names that include corporate structure2 are considered
r 17
partially correct or incorrects depending on how recognizable the name is in context with the particular
business.
79
 Result Name Official Business IP
ro m rs Name Explanation
f e v e
, 2 024 el D Name Accuracy Partially Correct
l 2 ich a Tu
r
p yMi es
1
The addendum “LLC”
A
IT’SUGAR LLC ay, IT’SUGAR
. 6 b 72.1 dayrefers
, A to the corporate
d 54 structure and should 6.2not
e s
Tu .16.2 54 be pri used for the store,
l2
. 6
However, this name is stillbrecognizable.
,
1 7 2 y M 2024
ich fro
Name Accuracy Partially Correct ael m
De IP
ver
The addendum “Inc.” refers to the company’s s
Nordstrom, Inc. Nordstrom corporate structure and should not be used for
the store. However, the store can still be
recognized.

6.2.3. Incorrect Name

An incorrect result name is one that can’t be recognized because of severe misspelling or ambiguous
or unnecessary/missing parts in the name.

Consider names incorrect when they contain issues including:

• Severe misspellings that prevent the user from identifying the business because of:
• Change in meaning
• Misspelling that results in an entirely different word or gibberish
• Holding names that are completely different than the recognized name
• Unnecessary or missing parts in the name that prevent the user from recognizing the
business
• Slang and inappropriate language
• Using the previous name of the same entity that is not a variation of the current name and
therefore cannot be identified

Note: If a result name is incorrect, the final Name and Category Accuracy rating will always be
Incorrect, even if the category is correct.

Result name Official Business Name Rating and Explanation

Name Accuracy Incorrect

Tu IP
o m rs
17 esda f r ve
2 y 24 l De
JAB.1Holding
6.2 , Ap 2, 20 e
54 ril 2 Peet’s Coffee The holding company name is completely ha
Company .6 , p ril Mic
by 2
Mi 024 different than the store name.
da y, A .6 by
cha fro es 54
el D m I Tu .16.2
eve P 172
rs

80
 Result name Official Business Name Rating and Explanation
IP
m s Name Accuracy Incorrect
4 fro ever
0 2 D
,2 el
r i l 2 icha Tu
es
p yM 1
a y A
, 6b
.
72.1 day,
esd 54 6.2 Ap
Tu .16.2 54 ril 2
.6
172 by , 202
Mi
IEA IKEA cha 4 fro
In short business names, even small el Derrors
m
IP can
prevent the user from recognizing the vbusiness.
e ers

Name Accuracy Incorrect

Zatas Tacos + Zacatecas Tacos + The misspelling is severe and does not allow the
Tequila Tequila user to identify the business with certainty. The
user is likely under the impression that it is a
different restaurant.

Name Accuracy Incorrect

The misspelling changes the meaning, which

Taco Bull Taco Bell makes the name ambiguous: It could be a “Taco
Bell” chain store or a different business named
“Taco Bull”.

Name Accuracy Incorrect

With the unnecessary word “Pizza,” the name

Walgreens Pizza Walgreens becomes ambiguous and the user does not know if
this is a pizzeria named Walgreens or a wrongly
labeled Walgreens pharmacy.

Name Accuracy Incorrect

Tu IP
e r o m rs
17 sda f ve
2.1 y, 0 24 l De
6.2
Cheesecake A
54 pril 2 The Cheesecake Factory When missing the word “factory”, the , result
2
il 2 and
a name
e
.6 “Cheesecake” is not specific enough
pr M ichthe chain
by , 202 , A 6 by
ywith
Mi 4 business cannot be identifiedda
54. certainty.
cha fro es
el D m I Tu .16.2
eve P 172
rs

81
 Result name Official Business Name Rating and Explanation
IP
m s Name Accuracy Incorrect
4 fro ever
0 2 D
,2 el
r i l 2 icha Tu
es
p yM 1
y A
, 6b 72.1 day,
UPS a
esd 5USPS4 . USPS (United States6.2PostalAp Service) and UPS
ril
Tu .16.2 (United Parcel Service)54are
. 6 both2 in the delivery
172 by , 202
business, but are entirely different
Mi companies.
cha 4 fro
el D m I
eve P
rs
Name Accuracy Incorrect

Starbucks &
Marks & Spencer By switching Marks with Starbucks, the business
Spencer
can no longer be identified.

Name Accuracy Incorrect

Mickey D’s McDonald’s Mickey D’s is British slang for McDonald’s brand.
However it is not an official variation of the brand
name.
Name Accuracy Incorrect
Showing a former name that is not shown on the
Bridgestone arena’s official webpage is not a good experience.
Sommet Center
Arena Even when the name might still be in use among
users, if a result shows a former name, rate it
Incorrect.

6.3 Result Category

Once you have determined the correctness of a result’s name, you must evaluate the accuracy of its
category in order to determine the final Name and Category Accuracy rating. The category of a result
refers
Tu to the category of the Business/POI. IP
e r o m rs
17 sda f ve
Not 2every
.16 yresult
,A will include a category, but when one appears, you will find it below the 2 24 l De
address
0
2, e
.2 p ha
details 54.6 ril 2, pril Mic
by 202
Mi 4 da y, A .6 by
cha fro
If the category is missing es .254
el D morI listed as N/A, make your final Name and Category
Tu .16Accuracy rating based
on the name alone. eve P 1 72
rs

82
6.3.1. Correct Category
IP
When a business or POI is categorized ro m rcorrectly,
f eve
s the category accurately reflects the business,
service, or function of the entity. 4
2 This D includes broad or alternate categorizations that are not the
preferred choice but arerinot , 20 hael
l 2 misleading.
c Tu
p y Mi 1 es
a y A
, 6b
.
72.1 day,
A correct name sd 54 with a correct category is rated Correct for Name
epaired 6.2 A
Tu .16.2 54 andpri Category Accuracy.
l2
. 6 ,
1 7 2 b y M 2024
• Not every result will include a category. If the category is missing or listedichas N/A, f do not
ael rom
demote. De IP
ver
• Some categories may seem slightly too specific or too general. As long as the categorization s
is not misleading, consider it correct.
• Categories can vary for similar POIs and vary per market. Localization of categories should be
taken into account when deciding on correctness.

Result Name and

Category Rating and Explanation
Category
Category Accuracy Correct
Restaurant Toqué
French Cuisine Restaurants are commonly classified by their respective cuisines. French
Cuisine is an appropriate category for the result.

Category Accuracy Correct

Jocko’s World Famous
Chicken and Seafood This categorization may seem a bit too specific but it is not misleading.
Seafood Restaurant Although this restaurant sells more than just seafood, categorizing it as a
seafood restaurant still properly reflects the nature of this entity.
Category Accuracy Correct

Walmart As long as research shows that the particular Walmart location

Grocery Store represented by the result sells groceries, this would be an appropriate
category. This is because grocery is a major department in this store and
represents a large part of what it sells.

Tu IP
e r o m rs
17 sda f ve
2.1 y,
20 24 l De
6.2 A , a e
54 pril 2 Category Accuracy Correct r il 2 Mich
.6 p
Walmart by M , 202 a y, A .6 by
4
Discount Store icha from This category accurately represents the POI. Walmart
es d 54is known to offer
el D I merchandise at low prices. Tu .16.2
eve P 172
rs

83
6.3.2. Incorrect Category IP
ro m rs
0 2 4 f Deve
, 2 haefinall
When the category is wrong,r i l 2 ithec Name and Category AccuracyTu rating is always Incorrect. This
es
p yM 1
is true whether theayresult
A
.
72.1 day,
, 6 bname is Correct, Partially Correct, or Incorrect.
esd 54 6.2 Ap
Tu .16.2 54 ril 2
.6
Consider the category
172 incorrect when it is: by , 202
Mi
cha 4 fro
• Wrong el D m I
eve P
• Misleading rs
• Misspelled
• Incomplete (missing parts or has uncommon/odd abbreviations)
• In an unexpected language/script. The category must match the language/script of the query,
test locale, or result region

Result Name and

Expected Category Final Rating and Explanation
Category
Incorrect (Category Issue)

Denver Zoo Category is wrong since the result is a zoo. This

Zoo
Active Life category does not represent the nature of the result.
Final Name Accuracy rating is Incorrect.

Incorrect (Category Issue)

Macy’s The result is a department store and should not be

Bar Department Store categorized as bar. Final Name Accuracy rating is
Tu Incorrect. IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

84
 Result Name and
Expected Category IP Final Rating and Explanation
Category m rs
ro
2 4 f Deve
,2 0 el Incorrect (Category Issue)
r i l 2 icha Tu
p
, A 6 by
M 17 esdaThe result is a department
Category is misleading.
a y . 2.1 y,
esd 54 .25 Apri
store and it should be6categorized as one. Although
Tu .16.2 4
this store does sell shoes,.6the
l2
category
, does not
172 by 202
Macy’s M
reflect the wide variety of otherimerchandise
4 it
cha fro
Shoe Store Department Store offers. It is misleading to categorize l D mresult
ethis IP as
eve
simply a shoe store. Final Name Accuracy rsrating is
Incorrect.

Incorrect (Category Issue)

Category is misspelled. Any misspelling in the
category name should be considered wrong. Final
Name Accuracy rating is Incorrect.

Fry’s Electronics
Electronics Store
Electrnics

Incorrect (Category Issue)

Macy’s Category is incomplete. The category shown is not a

Department Store common abbreviation for “Department Store” and
Depart Store
appears incomplete. Final Name Accuracy rating is
Incorrect. IP
Tu o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

85
 Result Name and
Expected Category IP Final Rating and Explanation
Category m rs
ro
2 4 f Deve
,2 0 el Incorrect (Category Issue)
r i l 2 icha Tu
p
, A 6 by
M 17 esda
a y . Test Locale: Germany2.1 y,
esd 54 6.2 Ap
Tu .16.2 54 ril 2
.6 ,2
172 Category is in an unexpected by language or script.
Aral Mi 024
Tankstelle The category “Gas Station” is in English
c ha rominstead of
f
Gas Station the expected German “Tanskstelle.”el De IP
ver
English should be considered an unexpected s
language in this locale (even if it could be understood
by a user there). Final Name Accuracy rating is
Incorrect.

Incorrect (Name Issue, Category Issue)

The result name should be considered partially
Macys correct because it does not include the proper
Bar Department Store punctuation: “Macys” should be “Macy’s.” The
category of Bar for this department store is wrong.
When the name is partially correct and the category
is wrong, rate Name Accuracy Incorrect.

6.4. Can’t Verify

When, due to a lack of available data online, the business or POI name cannot be confirmed, rate
Can’t Verify. This can be because of a lack of official resources or street imagery, or can be the case
for small businesses that don’t maintain their own webpage or social media profile.

6.5 Transit Names

Transit stations and other transit results (like airports and shipping ports), are often named after the
locality or street where they are located and can include a transit indication such as "Station" or
“Subway.” The transit indication in the result name/title is considered optional and can be missing
and still be considered correct. The user query for [san mateo station] can therefore return the
name San Mateo Station or simply San Mateo to be Correct. The category of the result will help you
correctly interpret the result because categories for transit POIs should be a reference to transit.

Keep in mind that some transit POIs located on street intersections may have a result title that is the
name of the street intersection (e.g. “Lincoln Way & 19th Avenue”). This is also considered Correct. IP
Tu o m rs
e r
17 sda
2.1 are 4 f Deve
2can
If there y, multiple
A transit systems operating out of the same station, any of the systems 20 l be
6.2 p 2, ichae
included 5in4.6therilname
2, to be Correct. If transit stations are close to each other, but users
i l
pr y M have to walk
b 2 A
outside to get from y Mi one0 2 building to another, consider the results for the two stations y , as two separate
b
cha 4 fro e sda 254.6
POIs. el D m I u
T .16 .
eve P 172
rs

86
 Query Result Rating and Explanation
IP
Millbrae ro m rs Name Accuracy Correct
2 4 f Deve
Millbrae,,CA 0
2 ael “Millbrae” has noTtransit indication in the result
Category:i l 2 Train
ch Station u
A p y Mi
r name, but the category
17 esda indicates it is a train station.
[Millbrae ay, 4.6 b 2.1 y,
s dMillbrae BART Name Accuracy 6.2 Ap
Correct
station] Tu 6.25
e 54 ril 2
Millbrae,
1 CA .6
172
.
“Millbrae BART” has a transit by ,indication
2 for the
Category: Train Station Mi 024
User and BART system in the result name.ha from
c
viewport el D I
P
in Palo Alto, CA Millbrae Amtrak Name Accuracy Incorrect (Category eve Issue)
rs
Millbrae, CA “Millbrae Amtrak” has an incorrect Amtrak transit
Category: Train Station indication. Only BART and Caltrain operate from
Millbrae station.

6.6. Parking Names

A parking lot may or may not have a name. Confirm this on the lot’s official webpage:

• The generic names “Parking,” “Garage,” or “Lot” (or any other words that indicate parking
can take place at the location) are considered Correct when no official name can be found.
• If an official name can be found, rate the generic names “Parking,” “Garage,” or “Lot” (or any
other words that indicate parking can take place at the location) as Partially Correct.
• If the parking lot is specialized (for instance, motorcycle-only parking), and the result’s name
doesn’t reflect that specialization, the result should be rated Incorrect for name accuracy.

Accept the following combinations of names as Correct if no official name is found:

• (Business name/Plaza name/Shopping area name) + (parking/ garage/lot)

• Without the addition of parking/garage/lot, the name is Incorrect
• Parking/ Garage/Lot (or any other words that indicate parking can take place at the location)

Query Result Rating and Explanation

Name Accuracy Correct
Union Square Garage
This garage’s official website confirms its name.
Name Accuracy Partially Correct

Parking
(Result is for the Union Research shows that the official name for this
Square Garage) parking location is Union Square Garage
Tu IP
e r o m rs
17 sda f ve
2.1 y,
20 24 l De
6.2 A , a e
54 pril 2 Safeway Parking Name Accuracy Correct r il 2 Mich
[Parking]
. 6 by , 202 p
Mi 4 (Result is for the parking d a y, A .6 by
cha fro
lot mattached to a ues .254
User and viewport l D e IP This parking lot has no official
T
2.1 website or name, but
6
in San Francisco, CA Safeway
e ver store in San 7
is associated with a Safeway store.
1
s
Francisco)

87
 Query Result Rating and Explanation
IP
Parking from vers Name Accuracy Correct
e
(Result , 2 02is4 for
el Dthe parking
l 2 ich to aa Tu
lot
pri attached
M 17 esda
A
, Safewayby This parking lot has
2.1 no yofficial website or name.
a y . 6 store in San 6.2 , Ap
esd .25Francisco)
4
54 r
u
T .16 .6 il 2, 2
172 by
Mi 024
Safeway Name Accuracy Incorrect
cha fro
(Result is for the parking el D m I
Without the words “Parking,” “Garage,” eve orP “Lot,”
lot attached to a rs
Safeway store in San users will have no way to know they can park at this
Francisco) Safeway.

6.7. Final Name and Category Accuracy Rating (Summary Table)

This table shows the final ratings produced by different combinations of name correctness and
category accuracy.

Final Name and Category

Name/Title Correctness Category Accuracy
Accuracy Rating
Correct Correct or N/A Correct
Correct Incorrect Incorrect

Partially Correct Correct or N/A Partially Correct

Partially Correct Incorrect Incorrect

Incorrect Correct or N/A Incorrect
Incorrect Incorrect Incorrect

Remember: If you give a final Name and Category Accuracy rating of Partially Correct or
Incorrect, you may be presented with two checkboxes:

• Name Issue
• Category issue

If they
Tu appear, use one or both them to select the reason(s) for your rating. IP
e r o m rs
17 sda f ve
2.1 y,
20 24 l De
6.2 A , a e
54 pril 2 r il 2 Mich
.6 p
by , 202 y, A .6 by
Mi 4 da
cha fro es 54
el D m I Tu .16.2
eve P 172
rs

88
7. Address Accuracy: Components and Issues
IP
ro m rs
Address Accuracy is split into two 4 f maineve parts: Components and Issues and Result Expectation. This
0 2 l D
section will discuss Components ,2 eand Issues and the next section will
Tu discuss Result Expectations.
r i l 2 icha
p
, A 6 by
M 17 esda
y 2.1 y,
7.1. Address Components
s a
d 54 . 6.2 Ap
e 54 ril 2
Tu .16.2 .6 ,2
172 Address components are the elements used to by form
Mi 02the4 f address details
for each result. These components include street number, c h ael romunit/apt,
street name, locality, region/state, postal code, and country. De IPThe
ver
components are defined in these guidelines with a global approach s in
mind. There may be variations for specific markets that are not
addressed here. See your Country Specific guidelines for more
information on the address component requirements for each type of
result.

This section covers the issues that can be associated with the address
components as well as the possible issues that can be associated with the address itself. It refers to
the checkboxes presented in the rating interface when Incorrect is selected. Checkboxes should be
selected for incorrect or missing information. Issues can occur within parts of the address or the
entire address.

Choose all identified incorrect or missing components. If the issue is not tied to individual
components but to an issue pattern, choose the appropriate issue instead.

Never select issues and components at the same time to report the same problem. That is, do not
rate Incorrect —Language/Script issue for the entire address and also Incorrect—Street Name
because street name is in an incorrect language.

When a Language/Script issue is present, make sure to check the address components for
accuracy and to select the appropriate checkbox. For instance, if you select language issue for the
entire address, you can also mark street number as incorrect, since this is an error that's not
language related.

7.1.1. Street Number

If the result address has an incorrect or missing street number rate Address Accuracy as Incorrect –
Street Number.

Tu IP
o m rs
17 esdResult Official Address Rating and Explanation 24 f Deve r
2.1 ay,
6.2 Ap , 20 ael
54 ril 2
. Address Accuracy l 2 ichNumber
Incorrect p–riStreet
7-Eleven 6 by , 202 834 E Fremont Ave, y, A 6 by
M
Mi a
836 E Fremont Ave,cha 4 froSunnyvale, CA Select the Street number checkbox 4.
ues 6.25 because the
d
Sunnyvale, CA 94087 el D m T
street number in the result address
.1 is incorrect.
ev94087, USA
IP
ers 172

89
 Result Official Address Rating and Explanation
IP
m s Address Accuracy Incorrect – Street Number
Defour fro ever 47,
Potgieterstraat
4
0 2 D
Potgieterstraat, 1053 1053 , 2 XSel Select the Street number checkbox because the
i l 2 icha Tu
XS Amsterdam, p r Amsterdam,
M street number is missing
17 es in the result address.
Netherlands a y , A 6 by
. Netherlands 2.1 day,
esd 54 6.2 Ap
Tu .16.2 54 ril 2
.6
172 by , 202
Mi 4f
The way street numbers are assigned varies by country and area. Some patterns chyou
ael may
rom see:
De IP
ver
Street Number Extensions s

Some markets use a street number extension system. Street number extensions are part of the street
number, not a further breakdown of it like building or unit numbers. If a street number extension is
incorrect or missing from a POI address it should be treated as an incorrect/missing street number.
Refer to Country Specific Guidelines for more details.

Result Official Address Rating and Explanation

Address Accuracy Incorrect – Street Number
Elkjøp Halden Walkersgate 8c, In Norway, street number extensions are part of the
Walkersgate 8, 1771 1771 Halden, street number and are not unit numbers. The street
Halden, Norway Norway number in the result is missing a street number
extension ‘c’ which is listed as part of the official street
number.
Address Accuracy Incorrect – Street Number
REMA 1000 Tynset Elfengveien 4 B, In Norway, street number extensions are part of the
Elfengveien 4 A, 2500 Tynset, street number and are not unit numbers. The street
2500 Tynset, Norway Norway number in the result has an incorrect number
extension ‘A’ when ‘B’ is listed as the official street
number extension.

Address Range

Address ranges are used to assign numbers to a stretch of road. Given the nature of these ranges,
not all numbers will have a building assigned to them.

When an address range is given by the query or returned as a result, consider it Correct when:

• The result street number is within the queried range

• The result address range exists and contains the queried street number
•TueThe range or number matches the odd/even numbering system for left/right side of street IP
r o m rs
s
17 required f ve
2.1 day, by the country 0 24 l De
6.2 A , 2 a e
54 pril 2 r il 2 Mich
. 6
The same criteria p
by , apply
2 to POI addresses. y, A .6 by
Mi 024 da
cha fro es 54
el D m I Tu .16.2
eve P 172
rs

90
 Suggestion Official Address Rating and Explanation
IP
ro m rs Address Accuracy Correct
The Crutched Friar 0 2 4 f Deve
el No need to select
Tu the Incorrect – Street Number
2
39 Crutched Friars, ril 2, icha
London p yM checkbox since17 the
es street number in the
y , A 6 b39-41 Crutched Friars, 2.1 day,
s a
d 54. London EC3N 2AE, suggestion is within6.2theAofficial address range.
e
Tu .16.2 54 pril 2
.6
172 United Kingdom Address Accuracy by , 202 – Street Number
Incorrect
Mi
The Crutched Friar cha 4 fro
45 Crutched Friars, Select the Incorrect – Street Numberel D m checkbox
I
eve P
because the street number in the suggestion is
London rs
outside of the official address range.
Address Accuracy Incorrect – Street Number
26 Winchester
25-27 Winchester
Avenue Select the Incorrect – Street Number checkbox
Avenue, Burpengary
Burpengary East Qld
East Qld 4505 Australia because the number 26 is even while the official
4505 Australia address range is odd.

Address Accuracy Incorrect – Street Number

Select the Incorrect – Street Number checkbox
Rua de Dom Hugo 17 because the street range in the suggestion does
Apartamentos Oporto 4050 Porto
Rua de Dom Hugo 1-45 Portugal not exist. This is a random address range and
Porto should be considered incorrect even if it contains
the official street number.

7.1.2. Unit/Apt

A street number can be divided into unit, apartment, or building numbers. Commonly seen forms
include the use of letters: A, B, C as well as the character # in front of a number: #420. Less common
are forms like ½.

A unit number should be correct and present when the official address of a business/POI contains a
unit number.

When a business does not list a unit number and the unit number cannot be confirmed, no unit
number should be given in the result. Rate Incorrect – Unit/Apt when unit number is present in the
rating tool in these cases.

Result Official Address Rating and Explanation

Free People Address Accuracy Correct IP
333TuSantana Row o m rs
17 esda This is the correct address listed on the official f r ve
Suite
2.1 #1110
y website of the business. 0 24 l De
6.2 , Ap 2, 2
ha
e
San Jose,54 CAri95128
.6 l 2, 2 ril Mic
p
by
Mi 024 a y, A .6 by
cha fro Address Accuracy Incorrect
es d 54– Unit Number
Free People el D 333
m Santana Row Tu .16.2
333 Santana Row IP
eSuite
ver #1110 This result address is missing
172the unit number listed
San Jose, CA 95128 Sans Jose, CA 95128 on the official website. Unit number checkbox should
be selected.
91
 Free People Address Accuracy Incorrect – Unit Number
333 Santana Row IP
ro m rs This result address has a different unit number than
Suite #2490 0 2 4 f Deve the one listed on the official website. Unit number
2 el
San Jose, CA 95128 il 2, icha checkbox should beTuselected.
p r M 17 esda
a y , A 6 by 2.1 y,
. 6.2 Ap
esd 54 54 ril 2
Tu .16.2 .6
172 by , 202
Mi
7.1.3. Street Name cha 4 fro
el D m I
eve P
If the result address has an incorrect or missing street name rate Address Accuracy as Incorrectrs –
Street Name.

Result Official Address Rating and Explanation

Van Gogh Museum Address Accuracy Correct
Museumplein 6, 1071
DJ Amsterdam, This is a correct address as displayed on the official
Netherlands website of the business.

Van Gogh Museum Address Accuracy Incorrect – Street Name

Museumplein 6,
Van Baerlestraat 6,
1071 DJ Amsterdam,
1071 DJ Amsterdam, This address has the wrong street name. Street
Netherlands
Netherlands name checkbox should be selected.
Van Gogh Museum Address Accuracy Incorrect – Street Name
6, 1071 DJ
Amsterdam, This address has a missing street name. The street
Netherlands name checkbox should be selected.

Alternative Street Names

A street can have alternate names or route
numbers, as well as multiple names in different
languages in bilingual areas. Consider a street
name correct when the name used is still valid and
in the language expected given the test language,
result region, or user query. If the street name has
changed and the older name is no longer in use,
consider the old name to be Incorrect – Street
Name if returned.

Tu IP
e r o m rs
17 sda f ve
2.1 y,
20 24 l De
Misspelled A e
54 Street Names
6.2 pr 2, ha
.6 il 2, 2 pril Mic
by 02 y, A .6 by
Misspellings in M the street
4
ich fro name, including missing diacritics (e instead of é, l a
instead
d 4 of ł) may be
a m ues 6.25
rated Incorrect – Street e l D Name.
I See your Country Specific guidelines for more
T 1 information.
eve P 1 72.
rs

92
 Result Official Address Rating and Explanation
IP
ro m rs Address Accuracy Incorrect – Street Name
Van Gogh Museum 4 f Deve 6,
Museumplein
0 2
el
Musuemplein 6, 1071 2, 2 icDJ
ha Amsterdam, The result street name
Tu is misspelled (“ue” instead of
i l1071
DJ Amsterdam, r
p yM “eu”), so the street
es
17 name
y , A 6 Netherlands
b 2.1 day, checkbox should be
Netherlands sd 54.
a
selected 6.2 Ap
e 54 ril 2
Tu .16.2 .6
172 by , 202
Address Accuracy Incorrect
Mi –4Street Name
cha fro
Bozego Ciala el D m I
Bożego Ciała, The result street name is missing diacriticseve Pin two
Bozego Ciala, letters (ż and ł) which should be treated as rs a
Wrocław, Poland
Wrocław, Poland misspelling in the Polish market. The street name
checkbox should be selected.

Street Directions and Types

Street directions (North (N), East (E), South (S), West (W)) as well as street types (Street (St),
Boulevard (Blvd), Avenue (Ave), etc.) are part of the street name. If they are incorrect or missing, the
street name is wrong and rated Incorrect – Street Name. Exceptions are when such elements of a
street name are used interchangeably for the same street.

Result Official Address Rating and Explanation

Address Accuracy Incorrect – Street Name
Van Gogh Museum This address has the wrong type of street: both
Museumplein 6,
Museumkade 6, 1071
1071 DJ Amsterdam, “plein” (square) and “kade” (quay) are street types.
DJ Amsterdam, The official street type is listed as ‘plein’, therefore
Netherlands
Netherlands the type of street is considered wrong and the
checkbox for street name should be selected.

118 El Camino Real 118 E El Camino Address Accuracy Incorrect – Street Name
118 El Camino Real, Real, Sunnyvale, CA This address is missing the direction. Therefore, the
Sunnyvale, CA 94087 94087 street name checkbox should be selected.
Blue Stones Address Accuracy Incorrect – Street Name
3530 El Camino
3530 E El Camino
Real, Santa Clara, This result address has additional direction, which is
Real, Santa Clara, CA
CA 95051 wrong and does not exist in real life.
95051

7.1.4.
Tu Sub-Locality and Administrative Subdivisions IP
e r o m rs
17 sda f ve
Some2.1countries
y, A or areas require an additional subdivision, like sub-locality, for correct 24 l De
address
20
6.2 pr e
2, icha is to
information.
54 See
.6 il 2your Country Specific guidelines for specific guidance. The general pr ilguidance
, M
y M 2024
rate a wrong bsub-locality , A 6 by is required
as Incorrect – Sub-Locality. This is also true if the sub-locality
a y
ich fro d 4.
but missing. ael m T ues 6.25
De IP .1
ver 172
s

93
 IP
7.1.5. Locality ro m rs
0 2 4 f Deve
Misspellings within the locality , 2 ael
r i l 2 ichname, including missing diacritics (e
Tuinstead of é, l instead of ł) may be
esd
p yM 1
rated Incorrect – Locality.
y , 6 b See your Country-Specific Guidelines for
A 72.1more
ay information.
e s a
d 54 . 6.2 , Ap
Tu .16.2 54 ril 2
.6
Every result requires
172 the correct locality component within its address details. by In, 2cases of local
Mi 024
government reforms or other changes in naming, the result has to reflect the official cha name.
fro
Exceptions are made when alternate names are accepted. el D m I
eve P
rs
Result Official Address Rating and Explanation
Van Gogh Museum Address Accuracy Incorrect – Locality
Museumplein 6, 1071 Museumplein 6, 1071
DJ Utrecht, DJ Amsterdam, This address has the wrong locality. Locality
Netherlands Netherlands checkbox should be selected.

Address Accuracy Incorrect – Locality

Van Gogh Museum Museumplein 6, 1071
Museumplein 6, 1071 DJ Amsterdam, This address has a missing locality therefore
DJ Netherlands Netherlands locality checkbox should be selected.

Jana Matejki Jana Matejki Address Accuracy Incorrect – Locality

Jana Matejki 90-237 Łódź
Polska The locality within the street result is missing
90-237 Lódz diacritics in two letters (Ł and ź) which should be
Polska treated as a misspelling in the Polish market.

7.1.5. Region or State

Each country has its own understanding of what is expected (correct) or unusual (incorrect) for
region or state components. See your Country Specific guidelines for more information.

Result Official Address Rating and Explanation

Incorrect – Region/
Address Accuracy
1384 Navarro Dr, State
1384 Navarro Dr
Sunnyvale, CA 94087, This address is missing the state, which is a
1384 Navarro Dr,
USA mandatory component in the USA. Region/State
Sunnyvale, 94087, USA
checkbox will be selected for missing state.
IP
Tu Correct with rom ers
17 esda Address Accuracy 4 f Dev
2.1 y, formatting02issue l
6.2 AMuseum
Van Gogh 2
2, ichae
54 pril 2 Museumplein 6, 1071 i l
Museumplein.6 6,,1071 Region is not a mandatory component pr M in the
by 202 DJ Amsterdam, y, A 6 by
DJ Amsterdam, MiNorth-
cha 4 fro Netherlands Netherlands, but if present a has. to be correct.
esd .254
Holland, Netherlands el D m I Tunecessary,
Since the region is not 6 it is a
eve P 7 2.1
rs redundant address component and should be
1
flagged as a formatting issue.

94
 Result Official Address Rating and Explanation
IP
ro m rs Incorrect – Region/
2 4 f Deve Address Accuracy
,2 0 el State
Van Gogh Museum ril 2 icha Tu
p Museumplein
M 6, 1071 esd
Region is not17a2mandatory component in the
Museumplein 6, 1071 y , A 6 by .16 ay, A
d 54 DJ Amsterdam,
a . Netherlands, but if.2present
DJ Amsterdam, esNorth-
Tu .16.2 Netherlands 54 pril 2has to be correct.
Brabant, Netherlands The correct region for.6theby city
, 2 of Amsterdam is
172 M 02
North-Holland, therefore the ichregion/state
4f
r
checkbox will be selected. ael D om I
eve P
rs
7.1.6. Postal Code

The postal code accompanies the locality name and provides further detail about where a feature is
located. See your Country Specific guidelines for more information on when postal codes are a
mandatory address component.

If a postal code is not mandatory but is present in the result address, rate Correct as long as the
postal code applies to at least part of the feature (street, locality, large POI without an expected
address, etc.).

For many localities, more than one postal code may apply. As long as the returned postal code is
correct for at least a part of the feature (street, locality, large POI) rate Correct. Columbus, OH, for
example, contains 45 postal codes.

Postal code standards differ between locales so be sure to consult your Country Specific guidelines
for details.

Consider any country specific conventions when it comes to the use and correctness of shortened
postal codes. For example, the US postal code does not need the four-digit extension that follows the
five digit main code. Ignore it if it appears.

Result Official Address Rating and Explanation

Van Gogh Museum Address Accuracy Incorrect – Postal Code

Museumplein 6,
Museumplein 6, 1071
1071 DJ Amsterdam, This address has the wrong postal code “DM”
DM Amsterdam, instead of the correct “DJ.” Postal code checkbox
Netherlands
Netherlands should be selected.
Van Gogh Museum Address Accuracy Incorrect – Postal Code
Museumplein 6,
Museumplein 6
1071 DJ Amsterdam, This address has a missing postal code. Postal code
Amsterdam,
Netherlands checkbox should be selected. IP
Netherlands
Tu
e r o m rs
17 sda f ve
2.1 y,
20 24 l De
6.2 A , a e
54 pril 2 r il 2 Mich
.6 p
7.1.7. Country by , 202 y, A .6 by
Mi 4 d a 4
cha fro
m T ues 6.25
The country is a “nicel D
e to have”
I piece of information, but should always be included1 when the result is
eve P 1 72.
located in a country other thanrs the test locale. If missing, rate Incorrect and select the Country
checkbox.
95
 Test IP
Address in Result o mAddress
s in Reality Rating and Explanation
Locale 4 f ever
r
0 2 D
,2 el
l 2 icha Address
Tu
17 Accuracy Correct
r i es
1384 Navarro
, A 6 by Dr,
p M 1384 Navarro Dr,
y 2.1 day,
en_US Sunnyvale,
d a 4 CA
. Sunnyvale, CA 6.2 Aaddress
This is a correct since the test
ues 6.25
T94087 94087
54 pril 2
.
.1 6
locale is the USA.by 20 ,
172 Mi 24
cha fro
Address Accuracy Correct el D m I
1384 Navarro Dr, 1384 Navarro Dr, eve P
de_DE Sunnyvale, Sunnyvale, CA This address includes the country rs name
CA,94087, USA 94087, USA since it is outside of Germany, which is the
test locale.
Address Accuracy Incorrect – Country

Museumplein 6, The country is mandatory in this example

Museumplein 6, because the address is in the Netherlands,
en_US 1071 DJ
1071 DJ Amsterdam, which is outside the user's US test locale.
Amsterdam
Netherlands Country checkbox should have been
selected.

7.2. Address Does Not Exist

An address-type result needs to be associated with a building or with a plot of land that has been
officially assigned that address. If you find strong evidence that there is no building at the address or
that no plot of land has been officially assigned the address, rate Incorrect – Address does not exist
and leave a detailed comment including links. If there are not enough resources available to make an
informed decision, rate Can’t Verify.

Within markets that use street number extensions, if the result offers an address with a generic street
number, but the street number alone does not exist without an extension (e.g. result returns “163
Main St.”, but only “163A Main St.” and “163B Main St.” exist), rate the address as Incorrect –
Address does not exist, since the street number without the extension is not a valid, real-life address.
Note that street number extensions differ from the building numbers referred to in Unit/Apt section.

In rare cases, an existing street address can be found in a different locality. Always mark such cases
as Incorrect – Address does not exist and not as Incorrect – Locality.

Use the Incorrect – Address does not exist checkbox for any address result that doesn’t
exist, like a street or sub-locality result. This rating should not be applied to POI addresses.

Tu IP
e r o m rs
17 sda f ve
7.3.2Language/Script
.16 y, A Issue in Address 20 24 l De
2, e
.25 pri ha
4.6 l 2, pril Mic
The address bdetails
y M 202must4 da y, A .6 b(like
be in a language and script that matches the test language y en_US), the
i
user query, or the result
c ha f r region. e s 54
el D om I Tu .16.2
P
eve
rs 172

96
Use the Address Accuracy Incorrect – Language/Script Issue checkbox if you find issues of this
nature in any of the address components IP in the address details of any result. (For business/POI
names and address titles in unexpected ro m rs languages, see Result title/name in unexpected language.)
0 2 4 f Deve
l
2, 2 hae T“Cafe
These examples show pincorrect ril Mic language and script for the result 1
ues Timber, 1066 Hippy Hollow
d
A y 7
Rd, Red Boiling Springs,
d a y ,
4 . 6TN 37150” with a user in the US using English.
b 2 .16 ay, A
es 5 .25 pri
Tu .16.2 4.6 l 2,
1 7 2 by 202
Mi
cha 4 fro
el D m I
eve P
rs

Any combination of unexpected language or script is considered Incorrect. An exception can be

made in cases when only special characters are added that are not used in the expected language.

Results located in a market with different scripts are hard to verify. Use the normal research steps to
confirm the address. It is not expected that you understand markets and address formats outside
your local knowledge expertise, so do the best you can without doing more research than normal.

Rate mixed languages and scripts found in any address details as Language/script Issue when
they use a different language or script than the one used in the query, test, or result location.

7.4. Country-Specific Issue

The variety of address formats and distinctive country specific issues is broad. In general, use the
checkbox for Country Specific Issue when there is an address problem that is not covered by the
available checkboxes. This includes things like instances when an address also requires a
municipality in addition to locality and state, but those components are either missing or incorrect.
See your Country Specific guidelines for more information.

7.4.1.Country-Specific Issue vs. Correct with Formatting Issue

Any additional components beyond the regular address format for a country are rated:

• Correct with formatting issue if correct

• Incorrect – Country Specific Issue if very unusual or wrong

7.5. Other Issue

Tu IP
o m rs
Issues
17 snot
e d mentioned in these guidelines are reported using the Incorrect – Other Issue checkbox. f eveIf
r
24 l to
.16 ay, Athis option, be sure to leave a comment as well as links to the resources you20used
you 2choose e D
.25 pri 2 , h a
identify the 4.6issue.
l 2 The checkbox is also used for: l c
by , 202 A pri y Mi
Mi y, b
cha 4 fro e sda 254.6
• Duplicate address el D mcomponents u
T .16.
IP
• Name of POI reappears eve
rs
in the address details 172
• Natural features that contain street address elements (see Natural Features)
• P.O. Box addresses
97
You may also use this checkbox if you IPnotice formatting issues along with any Incorrect
components you’ve already selected. m This
s
4 f ever is because once you mark a component Incorrect, you
ro
can no longer choose Correct 2 l DFormatting issue.
, 20 with e
r i l 2 i cha Tu
es
p yM 1
7.6. Correct with a
A
, 6b
Formatting
y . Issue
72.1 day,
esd 54 6.2 Ap
Tu .16.2 54 ril 2
.6 ,2
When all the result
172 address information is correct and present, but not in the byformat
Mi 024expected, mark it
as Correct with Formatting issue. Formatting issues include the order of address cha components
fr and
el D om I
other minor issues that are not necessarily considered wrong. They do not include misspellings eve P
which are addressed under the relevant individual components. Some reasons to rate Correct rs with
formatting issue:

• Components are in unexpected order

• Non-required but correct address components
• Extra spacing
• Double comma [,,]
• Rate Incorrect if a required component is missing
• Valid but redundant or unnecessary components (See your Country Specific guidelines for
more information)

If optional components already discussed in this chapter appear in the address, use the guidance
provided in the section that applies to those components, not the Correct with formatting issue
rating. If your market has additional address components, consult your Country Specific guidelines
before demoting.

7.7. Can’t Verify

An address is rated Can’t Verify when it cannot be confirmed as Correct or Incorrect. This is
usually the case when there is a lack of resources or an unexpected address format is given on the
official website.

• Lack of resources:
• No official webpage found
• No official address listed
• General lack of official resources
• Lack of street imagery
• Unexpected address formats used by official resources can include:
• Intersection address (Main St and 2nd St)
• Exit address (Exit 5, Hwy 101)
• Descriptive address (Main St between 6th and 7th Streets)

AskTyourself: Is the location given by the result address at least not wrong given all information IP
ues r o m I rs
have
17 found? f ve
2.1 day, Use the following examples to learn how reach a conclusion. 0 24 l De
6.2 A , 2 a e
54 pril 2 r il 2 Mich
Note: If an address
. 6 by , 202contains missing or incorrect components, it can be confirmed p as Incorrect.
Mi incorrect y, A .6 by
Mark the individual 4
cha fro components. See your Country Specific guidelines
es .25 more information
d a for
4
on missing or incorrect m u
e l Dcomponents.
I T 16
eve P 1 72.
rs

98
7.7.1. Can’t Verify for Street Number
IP
The following example shows address o m details
f ever
r s for a business called “Utopia.” No information online
confirms the address and only 4
2 a few D street numbers can be confirmed with official resources.
2 , 20 hael Tu
l c
pri y Mi 1 es
Rule y
and
A
, 6Explanation
b 72.1 dayExample
a
esd .254
. 6.2 , Ap
u
T .16 54 ril 2
.6
172 by , 202
Mi
The street number has to fall within the possible cha 4 fro
range of addresses. el D m I
eve P
rs
The street number 165 falls within the possible
street numbers ranging from 103 to 175.

Those are the houses closest to the result

address that could have been confirmed.

Rate the address Can’t Verify.

7.7.2. Can’t Verify for Street Name

The following examples give different address details for a business called Aztec. The official address
is “Granite Ave & W Babcock St, Bozeman, MT” and is in a different format than the result addresses.

Rule and Explanation Example

The result address has to provide access and

be within the possible range of street numbers.

W Babcock St provides access to the business

and the number appears to be within the range
of addresses we can confirm.

Rate the address Can’t Verify.

Granite Ave provides access to the business

and the number appears to be within the range
ofTaddresses we can confirm. IP
u o m rs
17 esda f r ve
2.1 y,
20 24 l De
Rate6the Ap
.25 address Can’t Verify. 2, e
4.6 ril 2, ha
p ril Mic
by 202
Mi a y, A .6 by
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

99
8. Address Accuracy: Result Expectations
IP
ro m rs
0 2 4 f Deve
You will see three kinds of2results:, 2 hael Tu
i l c
A p y Mi
r 17 esda
, 6b 2.1 y,
• Business/POI
e s day results
54. 6.2 Ap
• Address u
T type . 2
6 results 54 ril 2
2.1 .6
7 by , 202
• Features without an expected address
1 Mi
cha 4 fro
el D m I
Different address details are expected for each result type. For example, the Amazon river eve Phas no
rs
street address but its name is accompanied by the country, while the fast food place Wienerschnitzel
shows a complete address. You will need the appropriate expectations in order to rate addresses
accuracy.

Wienerschnitzel Eiffel Tower

75 Saratoga Ave 5 Avenue Anatole France
Santa Clara, CA 95050 75007 Paris
United States France
1 Church St Grand Central Terminal
1 Church St Manhattan
Burlington, VT 05401 New York, NY
United States United States
Amazon Yellowstone National Park
Brazil Natural Feature Yellowstone National Park
WY 82190
United States

8.1. Business/POI Result

The address details of a business or POI generally consist of: street number, street name, locality,
region, postal code, and country.

The address given is confirmed Correct when it points to the same physical location listed on the
official webpage or other official resources and all mandatory components for your market are
present. See your Country Specific guidelines for details on mandatory address components.

8.1.1. Business/POI Address Research and Resources

Use official resources to confirm an address when a business or POI’s official website does not
provide a full address or if there is a conflict with the address in the result. These resources can
include:
IP
•TueSocial media sites claimed by the business/POI and updated within the last 6 months r o m rs
17 sda f ve
•2.1 Street
y, A imagery (any recent online imagery showing streets and buildings) 20 24 l De
6.2 2, e
54 pauthorities
• Postal r (for postal codes and locality names) ha
.6 il 2, 2 p ril Mic
• Governmentby
Mi 0property
24 registries a y, A .6 by
cha fro es d 54
el D m I Tu .16.2
P
If a business or POI hasevmore 172 accept any of them
ers than one official address for the same location,
as Correct.

100
If no official resources can be found, Irate P according to consensus from multiple reliable sources.
Reliable resources include: ro m rs
0 2 4 f Deve
l
2, 2 ichae
l publications Tu
• Articles in primary r i
p yM (newspapers or similar publications
1 esd that do their own
, A 7 a
reporting) da 4.6
y b 2 .16 , A y
• Crowdsourced
u es .25user review sites .25 pri
4.6 l 2,
T .16
1 7 2 by 202
Mi 4f
When no official resources are available and address components are missing or chclearly
ael romincorrect,
check to see if those components are required in the market or region of the result and IP the
De select
ver
appropriate checkboxes under Incorrect. See your Country Specific guidelines for more information. s

Some resources, like data aggregators, spammy directory sources, and so on, are unreliable, and
consensus between unreliable resources should be disregarded.

• Valid alternate street and locality names When valid alternate names for streets or
localities are used interchangeably, consider all versions Correct.
• Valid alternate street addresses: When valid alternate addresses are returned, consider all
versions found on the official website or confirmed by official sources as Correct.

When the address listed by the official website or resources is in a different format than the one seen
in the result, confirm if the address given is Incorrect or Can’t Verify. See Can't Verify for more
information.

If there is any obvious error in an official source, like a misspelled country or city name, and the
same error appears in the result, rate the erroneous component Incorrect.

8.1.2. Alternative Official Addresses

Some official addresses may contain a vanity street name or have no official street number. In rare
cases they may even lack a complete street address. Refer to the official webpage as well as to
common address formats in your country to determine the accuracy of each business or POI address.

P"#"G"#"%Q)(9E+M)B+%0,,E);;);

When the official webpage does not give a complete address with street number and name for a
large entity (mall, university, etc.):
• Rate the result address Correct when it matches the address of any department or entity at
the same location complex or campus.
• Rate the result address Correct when it lists the correct locality for the entity. If the exact
locality is unclear because the entity borders multiple localities, rate Can’t Verify.
•TueThe locality is always expected, even when no complete address is provided. If missing, IP
r o mraters
s
17 Incorrect – Locality. f ve
2.1 day, 0 24 l De
A 2 e
• 6Region
.25 prand
4.6 il 2, postal code must also appear in countries where they are mandatory 2, ha
pril Mic
components.
by 202See your Country Specific guidelines for more information.y, A by
Mi
cha 4 fro ue sda 254.6
el D m I T .16.
P
eve
rs 172

101
 Result Address Official IP
o m Address
s Rating and Explanation
4 f ever
r
2 D Address Accuracy Correct
2 , 20 hael Tu
l c
pri y Mi e
72 sday has no official street
Dartmouth College y , A b Dartmouth1College
.16 , A
da 54.6 address listed on .25their
4.6 rwebsite. The address
s
10 N Main St,Tu 6.2
e pi
l2
.1 in the result belongs to by the2Office
, of
Hanover, NH 03755
172 M 024
Admissions, which is particof thef
ha rom larger
university, therefore the address el D is Correct.
I
eve P
rs
Dartmouth College Address Accuracy Correct
Dartmouth College Hanover, NH The college lists only the locality as its
Hanover, NH 03755 official address and the result matches that
03755 USA address and is therefore Correct (even
though it is missing a street number and
name).
Address Accuracy Incorrect – Locality
Dartmouth College
NH A locality is expected in the address details
03755 for most POIs. Rate Incorrect – Locality
when the locality is given by the official
webpage but missing in the result.

In addition to a street address, a store or department can have the name of the complex or campus
that contains it and be rated Correct.

Result Address Official Address Rating and Explanation

Address Accuracy Correct

Stanford School of 559 Nathan Abbott This result is a department within Stanford
Law Way, Stanford, CA University. The address is Correct because the
Stanford University, 94305 larger entity name and correct locality is listed
Stanford, CA 94305 as the address.

Address Accuracy Correct

TheTuCheesecake 3041 Stevens Creek IP
This result is a business within Westfield4Valley o m s
Factory
17 esda Blvd f ever
r
2.1 y, Fair shopping mall. The address is Correct 2 D
Westfield
6.2 Valley
A
54 pril 2
Fair, Santa Clara, 2 , 20 hael
because the larger entity name and l c
Santa Clara,
.6 CA , 2
by CA 95050 A pri ycorrect
Mi
95050 M 0 2 ,
locality are listed as the address.
ay .6 b
ich 4 fro esd .254
ael m u
T .16
De IP
ver 172
s

102
 IP
If the entity has an official address m s
4 f everthe result address belongs to another entity in the same
ro and
complex or on the same campus, 2 D
2 , 20 haelrate Incorrect. Tu
l c
pri y Mi 1 es
a y A
, 6b
.
72.1 day,
d 4 6.2 Ap
ues 6.25 54 ril 2
Result Address
T .1 Official Address Rating and
.6 Explanation
by , 202
172 Mi
cha –4 fStreet
Incorrect el D om I Number
r
Address Accuracy
& Street Name eve P
Stanford School of rs
559 Nathan Abbott The result address belongs to the larger entity
Law
Way, Stanford, CA (Stanford University). The department has an
450 Serra Mall,
94305 official address that is different from the
Stanford, CA 94305
university’s address, so the result address is
rated Incorrect.
Incorrect – Street Number
Address Accuracy
Stanford University & Street Name
559 Nathan Abbott 450 Serra Mall, The result address belongs to a smaller entity
Way, Stanford, CA Stanford, CA 94305 within the university (Stanford School of Law).
94305 The university has an official address that is
different, so this address is rated Incorrect.
Address Accuracy Incorrect – Street Number
The Cheesecake
3041 Stevens Creek The result address belongs to the larger entity
Factory
Blvd (Westfield Valley Fair mall) that contains the
2855 Stevens Creek
Santa Clara, restaurant. The Cheesecake Factory’s official
Blvd
CA 95050 website lists a different address, so the
Santa Clara, CA 95050
address Incorrect.
Address Accuracy Incorrect – Street Number
Westfield Valley Fair 2855 Stevens Creek
3041 Stevens Creek Blvd The result address belongs a business (The
Blvd Santa Clara, Cheesecake Factory) within the mall. the
Santa Clara, CA 95050 CA 95050 shopping mall has an official address that is
different, so the address is rated Incorrect.

8.1.2.2. Result Missing the Street Address

When both the result and the official webpage show identical but incomplete street addresses
(missing street name, street number, or both) and the locality is correct, consider the address IP
Tu
Correct. m s
17 esda 4 fro ever
2.1 y,
6.2 Ap 2 , 202 ael D
54 r h
.6 il 2, 2 pril Mic
by , A y
Mi 024 day 54.6
b
cha fro e s
el D m I Tu .16.2
P
eve
rs 172

103
 Result Address Official Address Rating and Explanation
IP
ro m rs Address Accuracy Correct
0 2 4 f Deve
Pilot Thomas ,2 el
r i l 2 icha This result is for
Tu a self-serve gas station for
es
Cardlock , A 6 by State Hwy 115 &
p M 1
commercial vehicles.
72.1 day, While we would normally
y
State Hwy 115 e&sd 54
a . Mustang Drive, expect a full address6.2 forA
u . 2 54 prthis
il 2 type of result, the
Mustang Drive, 2.1
T 6 Andrews, TX 79714 .
official website lists only 6 byan, intersection.
20 The
17
Andrews, TX 79714 2
result listing matches the M ich 4 fwebsite,
official so
ael rom
the result is rated Correct. De P I
ver
s
Address Accuracy Can't Verify

Strand Central Park This result is for a automated book kiosk.

E. 60th St & 5th Ave, While we would normally expect a full address
Kiosk
Manhattan, NY for this type of result, the official website lists
789 5th Ave
10065 only an intersection. The result listing is a full
Manhattan, NY 10065
street address, so the result is rated Can't
Verify.

When the street address is missing from the result but the official webpage has a street address,
consider the address Incorrect.

Result Address Official Address Rating and Explanation

Address Accuracy Incorrect – Street Name

Pilot Thomas State Hwy 115 & This result is for a self-serve gas station for
Cardlock Mustang Drive, commercial vehicles. The official website lists
Andrews, TX 79714 Andrews, TX 79714 an intersection as the address. The result
address is missing the two streets (State Hwy
115 & Mustang Dr). Mark the result Incorrect
– Street Name.

Address Accuracy Incorrect – Street Number

Stanford University
450 Serra Mall, The result address is missing the street
Serra Mall, Stanford, CA
Stanford, CA 94305 number given on the official website, therefore
94305
the address accuracy is Incorrect – Street
Number.

8.1.2.3.
Tu P.O. Box, Mailing Addresses, and Management Offices IP
e r o m rs
17 sda f ve
2.1 y,
20 24 l De
A
6.2 that e
2, icBoxes,
Addresses 54 pril point to a different location or building, such as management offices,il P.O. ha
. 6 2 p r M
mailing addresses,
by , 20or shared office spaces, are not valid and are rated Incorrect y, A– .Other
by Issue.
Mi 24 da 4 6
cha fro es 5
el D m I Tu .16.2
eve P 172
rs

104
 IP
ro m rs
Result Address
0 2 4 f Deve Address
Official Rating and Explanation
,2 el
l 2 icha Address Accuracy
Tu
17 esda Incorrect – Other Issue
p r i M
a y , A 6 by 2.1 y,
. A
6.2 official
John F. Kennedyesd 54 The address on the 54 pril 2 airport site is for
Tu .16.2 4 World Trade .
International17Airport
2 The Port Authority of 6NY by & ,NJ
2 corporate
Center, 150 Mi 024
4 World Trade Center, office, which is not the location cha of frothe actual
Greenwich St., e
airport. Even though the result address l m
De IP
150 Greenwich St.,
New York, NY 10007 matches the address listed on the official ver site,
New York, NY 10007 s
it is a different location and does not refer to
the location of the result POI.

8.1.3. Businesses/POI with Moving Locations

Moving entities can either be on a fixed schedule or move at random. In some cases, entities appear
to be moving because they are located in a truck or similar vehicle, but are actually permanently
based at the same location.

Random location
The location of randomly moving entities cannot be predicted and should not be shown on the map.
Rate such businesses as Result is closed or does not exist.

Fixed schedule
Some entities, such as food trucks, move on fixed schedules. Their stops and schedule are usually
posted on their official webpage. The most accurate location for these entities is the address of their
longest stay over a full cycle of the given schedule (i.e. if a business has a weekly cycle and stays in
one spot for four days, that spot will be the only acceptable address for it). Mark any other address as
Incorrect – Other Issue. In cases of a tie, consider any of those locations Correct.

Fixed location
Businesses that operate out of a truck or bus that is stationary are evaluated like a standard business.
The vehicle does not need to be parked at the location after closing hours to be considered at a fixed
location.

8.1.4. Events

Some events can be very prominent but happen only a few days a year, others are regularly recurring.

Regularly
Tu recurring (weekly/monthly) IP
m rs
Rate e
17 events
s like weekly farmer’s markets like any other business. f r o ve
2.1 day, 0 24 l De
6.2 A , 2 a e
54 pril 2 il 2 Mich
Annual Events .6
by , 202 pr
Mi 4 d a y, A .6 by
ch fro es .254
Events that happenaonce Tu only
el D ma Iyear, such as Burning Man or the Sziget Festival, 6 occur for a short
e P 7 2.1
time each year, but attract vermassive amounts of people and media attention. Users can be interested
1
s
in these kinds of events outside the time they are held.

105
If the query and location intent are clear, IP assign an appropriate relevance rating, otherwise rate Bad.
Treat seasonal stores (like Spirit fHalloween rom vers store) and seasonally open POIs (like California’s Great
e
America theme park) the same , 2 024way
el Das annual events.
l 2 ch a Tu
A pri y Mi 1 7
esd
ay
a y, .6 b an event may not have an official address.
Depending on its dlocation, 2.1 This
6.2 , Akind of event should be
e s 5 4 pri
treated like a landmark
u
T .16 . 2 or natural feature. 5 4.6 l 2
172 by , 202
Mi
Singular or Non-Established Events cha 4 fro
el D m I
eve P
Non-recurring events from the past don’t carry any map significance and are rated Business/POI rs
closed or does not exist, unless the location of the event became a POI (due to its historical
importance) that carries the name of the event further.

8.2. Address Type Results

Address type results generally include:

• Street number, street name, postal code, locality and country (when outside of the test
locale).

8.2.1. Address Result

An address usually includes a street number, street name, locality, postal code and state/region. It
can be the same as the mailing address or other addresses provided by the official resources. Use
the chapter Address Formats, below, as well as your local knowledge, to identify the necessary
components and format.

• The address given has to be associated with a building or a plot of land officially assigned
that address.
• P.O. boxes are not valid addresses in the map context. Rate such addresses as Incorrect –
Other Issue.

If your research shows that the address does not exist, see Address Does Not Exist.

Address Mandatory components Explanation

13 Navarro Dr, Street Number, Street Name,
Sunnyvale, CA Street Type, Locality, State,
94087 Postal code Mandatory components may vary by
country. Check your country specific
Street Name, Street Type, guidelines for a complete list.
Museumplein 5,
Street Number, Postal code,
1071DJ Amsterdam
Locality IP
Tu o m rs
e
17 sda f r ve
2.1 y,
20 24 l De
6.2 A , a e
54 pril 2 r il 2 Mich
8.2.2. Address
. 6 by Formats
,2 p
Mi 024 da y, A .6 by
s
cha fro are used in different countries. The sequence anduepresentation
Various address formats 54 of the
el D m I T .16.2
components is adaptedeto P
match the local needs. For example, the street 2
number
7 comes before the
ver 1
s
street name in the United States but after it in Germany. See your Country Specific Guidelines for
more information.
106
It might be impossible to confirm an address IP on official resources when another format is used. Rate
Can’t Verify if the address points ro m the
to r s same location using an alternate format and there are no
f v e
missing or incorrect components. 2 0 24 l De
2, e
ha Tu
p ril Mic 1 es
a y A
, 6b
.
y 72.1 day,
d 4 6.2 Ap
ues 6.25
8.2.3. StreetTResult 54 ril 2
.6
.1 by , 202
172 Mi
Depending on the length of the street, different address components are expected. cha 4 fro
el D m I
ev P
Mandatory components may vary per country. See your Country Specific guidelines for aercomplete s
list.

• Local roads: Local roads that stay within a certain locality or county should carry the
appropriate locality and state name.
• Highways/Interstates: Longer roads that travel between cities or even states don’t require a
locality or state component. If such components are present, they must be accurate.

U.S. Route 395 covers almost the entire distance from Canada to Mexico. It passes through four
states and connects countless towns, such as Big Pine, CA. Within that locality, it carries for a short
distance the name N Main St. The two results have different expectations regarding components.

There are several forms that are appropriate for the result
U.S. Route 395 because of its length:

• U.S. Route 395 or US 395

• U.S. Route 395, California
• US 395, Big Pine, California, United States

For the result N Main St, there is only one expected form
because the road is short and stays within the locality:

• N Main St, Big Pine, CA United States

8.2.4. Locality Result

A locality result can be a city, village, municipality or neighborhood. In the U.S. the result usually
includes the state it is part of.

Mandatory
Address Explanation IP
Tu components o m rs
17 esda f r ve
2.1 y, 0 24 l De
Sunnyvale,
6.2 Ap CA Locality, State Mandatory components may varyil per 2 e
2, country.
54 ril 2 ha
.6 pr Mic
by , 202
Amsterdam, Check your country specific ,guidelines for a
Mi Locality a y A .6 by
Netherlands cha 4 fro complete list. es d 54
el D m I Tu .16.2
eve P 172
rs

107
 IP
8.2.5.Postal Code Result ro m rs
0 2 4 f Deve
Postal codes are returned , 2 hathe el user query matches the specific numbers or letters.
r i l 2wheni c Tu
es
p yM 1
a y A
, 6b
.
72.1 day,
esd 254 6.2 Ap
Mandatory 54 ril 2
QueryTu 2.16. Address .6
by Explanation
,2
17 components Mi 024
cha fro
Sunnyvale, CA Locality, State, Postal el D m I
[94087]
94087 code eve P may
Mandatory components rs
vary per country. Check your
Museumplein, 1071 Country Specific guidelines for
[1071 DJ] DJ Amsterdam, Postal code, Locality a complete list.
Netherlands
8.2.6.State/Region/Territory Result

If the user makes the query from a country outside the state or region result, that result must be
accompanied by the country name.

Mandatory
Address Explanation
components
California State name
If the result is outside of the test locale, country
North-Holland Region name
name is a mandatory component.
Puerto Rico Territory name

8.2.7. Country Result

The country is the highest administrative level and has no other address component.

Mandatory
Address Explanation
components
Netherlands Country The country is the highest administrative level
Romania Country and has no other address components.

8.3. Features Without an Expected Address

There are several kinds of features where no address is expected by the user. This could mean no
street
Tu name or number or, in some cases, no address components of any kind, are expected to mbe rs
IP
shown. e
17 sdThese types of results have different rating criteria when it comes to Address Accuracy. f r o ve
2.1 ay,
20 24 l De
6.2 A , a e
54 pril 2 il 2 Mich
8.3.1. Natural
.6 Features
by , 202 pr
Mi 4 d a y, A .6 by
Natural features are fr
chaspecific es .254 and other
el D om I landforms or ecosystems like rivers, mountains,
Tu .jungles,
16
geological features. They P names that can be rated, but typically do not72have
evehave a street address, so
1
rs be returned without any street address components. If a street address
natural feature results should

108
is present, it is considered Incorrect – Other Issue, even when pointing to a building that is
associated with the feature (like a ranger IP station or visitor center).
ro m rs
2 4 f Deve
• A locality may be an, acceptable 0
2 ael address if it is appropriate for the size of the feature, as it can
help locate a small r i l 2feature,
i Tu For larger features, such as a
ch like a hot spring, within the locality.esd
A p yM 1 7 ay
y, .6 b may not make sense and would be rated2.1Incorrect
mountain, adalocality 6.2 , Ap – Other Issue.
e s 5 4
• The state Tu the 1 6.2feature is in can also be provided as the feature’s address 54 ril 2and rated Correct.
.6
• If a postal
.
172code is included, it must be correct by , 202
M 4
• If a very large or expansive natural feature, like a river or mountain, spansicmore ha frthan
el D om I one
country, any one of these countries can be a Correct address. If no country at all eveappears,
P
this is also Correct. r s

Parks and other protected areas are artificial boundaries created to help protect the natural feature.
Those POIs are often named after the natural feature they contain. In cases where a feature can be
considered a POI, such as Mount Rushmore or a state park beach, the official address can be
returned. There might be other natural features within a park that reference the park name as part of
their address details.

Treat landmasses like islands and continents as natural features with no expectation of a street
address. If one is returned, rate it Incorrect – Other Issue.

Result Details Official Address Rating and Explanation

Wreck Beach The beach can be confirmed as located within
No official address
Vancouver Vancouver and is therefore rated Correct.
The result contains the name of a street that
Wreck Beach
provides access to the beach. But the street is
NW Marine Dr, No official address
not expected and therefore rated Incorrect –
Vancouver
Other Issue.
The result contains the name of a street that is
Wreck Beach
nowhere near the beach. The street is not
W King Edward Ave, No official address
expected and therefore rated Incorrect – Other
Vancouver
Issue.
This glacier is located in the borough of Juneau.
Mendenhall Glacier The postal code in the address is associated
No official address
Juneau, AK 99801 with that locality, therefore both components
should be considered Correct.
Mendenhall Glacier The given address belongs to the overseeing
8510 Mendenhall Loop No official address Forest Office. The glacier should not have this
Rd,TJuneau address and is rated Incorrect – Other Issue. IP
u o m rs
17 esda r
4 f aDeve
2.1 y,
A Mount Rushmore is both a mountain 20 2and
el
6 2,park. ha The
Mount.2Rushmore
54 pril 2 13000 Highway 244 monument within its own national i l i c
.6 , 2#31-1, Building 31, Suite 1 pr y M
13000 HWYby244 0 address given on the official , ANational Parks
M 24 da y
4 .6 b
Keystone, SD icha from Keystone, SD 57751 Service website confirms
e s the result address as
5
el D I Tu .16.2
eve P Correct. 17 2
rs

109
8.3.2. POIs Without an Expected Address
IP
POIs without an expected address f ever from regular POIs and businesses in that the user would not
ro differ
m s
expect a street name and number 2 4 to
D be shown.
2 , 20 hael Tu
l c
pri y Mi 1 es
These types of POIsa y , include,
A
. 6 b but are not limited to: 72.1 day,
esd 54 6.2 Ap
Tu .16.2 54 ril 2
.6
• Parks (Golf
172 courses and theme parks not included) by , 202
Mi
• Monuments cha 4 fro
• National Landmarks el D m I
eve P
• Park-like heritage sites rs
• Bridges
• Squares
• Parking lots
• Transit POIs - these can include airports (including airport terminals), ferry ports, subways,
bike share stations, train and bus stops

The rating criteria described in the sections below apply to all features without an expected address.

See Official Address Present if this kind of POI has an official address

8.3.2.1. Minimum Address Component

Whether there is an official street address or not, POIs without an expected address do not need to
show it. The locality must be returned whenever a POI is small enough to fit entirely within it. A POI
that covers an area overlapping several localities does not require a locality component.

See your Country Specific guidelines for more information on mandatory address components.

Result Official Address Rating and Explanation

Address Accuracy Correct

Tu IP
o m rs
17 esdaStation
Quincy 220 S. Wells St, This is a transit POI so no street address is 4expected.
f r ve
2.1 y, 0 2 l De
Chicago,
6.2 ILAp Chicago, IL 60606 The result address is just the locality. The
2, POI
2
ha is
e
54 ril 2 ril Micand it
.6
by , 202 physically located within the given locality
p
A by
Mi ay, official
matches the one listed withinsdthe .6 address.
cha 4 fro ue .254
el D m I T .16
eve P 172
rs

110
 Result Official Address Rating and Explanation
IP
ro m rs Address Accuracy Correct
0 2 4 f Deve
,2 el
r i l 2 icha Tu
This is a heritage1sitee so no street address is
p M 72 sday
Stonehenge , A 6 by expected. The result.1address
y
esd 54 None
a . 6.2 , Ap is just the locality.
Amesbury, Salisbury
Tu .16.2
r
There is no official street54address
.6 il 2, 2 but since the POI is
172 physically located only within by given
Mi 024locality it can be
considered correct. cha fro
el D m I
eve P
rs
Address Accuracy Correct

Tongariro National This is a park and heritage site POI so no street

Park None address is expected. No locality is listed for this
New Zealand result. Since this POI covers an area that overlaps
several localities no locality component is required.

Address Accuracy Incorrect – Locality

351 N Union St, This is a park POI so no street address is expected.
Founders Park
Alexandria, VA No locality is listed for this result. Since this park fits
Virginia
22314 into only one locality, Alexandria, the missing locality
component must be considered incorrect.

8.3.2.2. Official Address Present

Official address is a full street address:

Some of these features have an official street address listed on their website or found on other official
sources, but users wouldn’t necessarily expect the address to be shown. Since a full address is not
expected, the result does not need to contain a full address even if there is one found via official
sources. Do not automatically consider any missing street address components as incorrect.

Full Address: When the result contains a full address it should be rated Correct if:
• The result and official addresses are identical
Street: When the result address is just a street it should be rated Correct if:
• The result address street is the same as the street within the official address

Consider the following examples for Embarcadero Station in San Francisco:

Tu IP
o m rs
17 esdaResult Official Address Rating and Explanation 4 f eve r
2.1 y, 2 D
6.2 A
54 pril 2 Address Accuracy Correct 2 , 20 hael
l c
Embarcadero.6
by , 202 A pri y Mi
y, b
Station Mi
ch 4 fr sda 254.6
The result has a full addresse
298 Market St, Sanael D om IP T that
u
. 16. is the same as the
address listed on the official 2
17 website.
Francisco, CA 94111 evers

111
 Result Official Address Rating and Explanation
IP
ro m rs Address Accuracy Correct
Embarcadero 0 2 4 f Deve
,2 el
Station l 2 icha The result address
Tu
17 isejust
sda a street. Since the street
p r i M
Market St, a y , A 6 by 2
matches the street listed
.16 y,within the official address it
sd 54 . .25 Apri
San Francisco,ueCA should be considered correct.
T .16.2 4.6 l 2
172 by , 202
Mi 4f
Address Accuracy Incorrectch–aeStreet
ro
l D m INumber
Embarcadero 298 Market St, San eve P
Station rs
Francisco, CA 94111 The result has a full address. The street number does
388 Market St, San not match the number listed within the official
Francisco, CA 94111 address and should be considered incorrect.

Embarcadero Address Accuracy Incorrect – Street Name

Station The result address is just a street. The street is not
Davis St, the same as the street listed within the official
San Francisco, CA address and should be considered incorrect.
Address Accuracy Incorrect – Locality
Embarcadero
Station The result has no address details at all. Locality is the
minimum component required for this kind of result
and should be rated Incorrect – Locality if missing.

Official address is a partial street address

When the result address is more specific than the official address it can be rated as Can’t Verify or
Incorrect, unless another official source can be found to confirm the returned address.

Full Address: When the result contains a full address it should be rated Can’t Verify if all of the
following apply:
• It does not belong to another POI/entity
• The street within the result address matches the street listed as the official address

If the full address belongs to another building not associated with the POI it should be rated
Incorrect.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

112
Consider St Nicholas’ Church in Berlin, IP Germany:
ro m rs
0 2 4 f Deve
,2 el
r i l 2 icha Tu
esd Explanation
Result A p yOfficial
, 6b
M Address Rating
1 72.1 anday
a y
d 54 . 6.2 , Ap
e s 54 ril 2 Can’t Verify
Tu .16.2 Address Accuracy .6
172 by , 202
Mi
St. Nicholas’ Church The result POI is a landmark church cha 4and
fro museum.
e m
Nikolaikirchplatz 3, The result has a full address. The street l De number
IP is
not associated with any other POI or v
entity
e and the
10178 Berlin, r s
Germany street within the address matches the official street
address.
Address Accuracy Incorrect – Street Number
St. Nicholas’ Church Nikolaikirchplatz The result has a full address. The street number
Nikolaikirchplatz 5, 10178 Berlin, belongs to a building not associated with the POI and
10178 Berlin, Germany should be considered incorrect. The street within the
Germany address matches the official street address.
Incorrect – Street Number,
Address Accuracy
St. Nicholas’ Church Street Name
Poststraße 1, The result has a full address. The street name does
10178 Berlin, not match the official street name, so both address
Germany components should be considered incorrect.

8.3.2.3. No Official Address

If no official street address is found, the result street address can be rated as Can’t Verify or
Incorrect unless another official source, like street imagery, can be found to confirm the returned
address. When there is no official address the returned street address cannot be confirmed and
therefore cannot be considered correct. (Please see your Country-Specific guideline for more
details.)

Full Address: If the full address belongs to another building not associated with the POI (even if they
are on the same street) it should be rated Incorrect. When the result contains a full address it should
be rated Can’t Verify if all of the following apply:

• It belongs to a building associated with the intended POI/entity

• The street provides access to the intended POI

Tu IP
e r o m rs
17 sdWhen
Street: the result address is just a street it should be rated Can’t Verify if: f ve
2.1 ay,
20 24 l De
• 6The A
.25 street provides access to the intended POI 2, e
p
4.6 ril 2, ha
p ril Mic
by 202
Mi a y, A .6 by
Determining Access: 4
cha fro es d 54
el D m I Tu .16.2
e P 172
A person must be able tovereach rs the POI directly from the given street by walking or driving. This
includes:
113
 • Streets providing access by following the boundaries of the feature or leading into it.
• T-intersections: IP
• A street ending at an o m s
intersection does not provide access to the feature on the other
4 f ever
r
side of it. 0 2 D
, 2 ael
• A street providesr i l 2 ichaccess to a feature when it continuesTu through the feature (even as a
es
p yM 1
different
A
, 6type
road b with or without a different name) as long 72.1 dasay
e s a y
d 54 . 6.2 ,itApkeeps its original name on
theTother
u 6.side
1
2 of the feature, and by doing so provides physical 54 access.
. 6
ril
2,
. 2
• 172
Ignore access restrictions when considering whether a street provides by access
Mi 024 or not.
cha fro
el D m I
eve P
rs

Result Rating and Explanation

Address Accuracy Can’t Verify

Grosvenor Square Garden The result address is the street in front of the result POI. Like the
Grosvenor Square, example illustrated above, this street provides direct access to the
London result POI.

Tu IP
o m rs
17 esda r
f eve
2.1 y,
6.2 Ap Address Accuracy Incorrect – Street ,Name 2024 el D
54 ril 2 2 ha
Grosvenor .6 Square ril Mic
by , 20 Garden The street ends in a T-intersection with the park p
y, Aon bthe
y other side.
N Audley St. Mic 24 fr The street does not continue on the otherusideda
es as
. 6
5 it becomes S
4
ha
London el D om I T .16.2
Audley St. and is therefore rated Incorrect.
eve P 172
rs

114
 Result Rating and Explanation
IP
om vers Accuracy
frAddress Incorrect – Street Name
2 4 De
0 l
i l 2, 2 ichaeThe result address is just a street.TuThe street does not provide
Charles de Gaulle Airport
r
Ap y M
es
direct access to the result POI and
17 should
2.1 day, be considered Incorrect.
Rue A. Parreux, sday, 4.6 b 6.2 Ap
5
Mauregard Tue .16.2 54 ril 2
.6
172 by , 202
Mi
cha 4 fro
el D m I
eve P
Address Accuracy Incorrect – Street Number rs
Charles de Gaulle Airport The result has a full address. The street provides direct access
4 Rue de la Fossette, however, the street number belongs to a building not associated
Mauregard with the result POI and should be considered Incorrect.

Address Accuracy Incorrect – Street Number, Street Name

Charles de Gaulle Airport The result has a full address. The street does not provide direct
64 Rue de Claye, access to the suggestion POI and the street number is associated
Mauregard with another entity. Both address components should be
considered Incorrect.
Address Accuracy Incorrect – Locality

Zurich Airport Since the airport is associated with a distinct locality “Kloten” it
requires at least a locality name and is rated Incorrect – Locality if
this is missing.

9. Pin Accuracy
For each result returned, you will find a pin on the map. Rate the accuracy of each pin’s placement
using this scale:

• Perfect
• Approximate
• Next Door
• Wrong
• Can’t Verify

The pin should be a reflection of the result: The location represented by the pin should reflect the
result. Pin ratings should be evaluated individually and not influenced by address or other data. AIPpin
canTbeu correct when other rating components are rated wrong. m s
fro ever
17 esda 4
2.1 y,
6.2 Ap 2 , 202 ael D
r h
Missing54Pins
.6 il 2, 2 A pril Mic
by , y
Mi 024 day 54.6
b
cha fro e s
u 6.2 five or more
If a pin for a result does not
el D m IPappear on a map, rate the pin Wrong. If this Thappens
.1
times in a row, release theeve task for technical reasons and explain why in the1 72comments box.
rs

115
9.1. General Considerations IP
ro m rs
eve
4 f Dmore
The following chapters will provide 0 2 detail on how to evaluate pin placement based on the
2 , 2 hael Tu the pin.
feature presented. They pridescribe
l
Mi
c issues to consider when evaluating es
1
a y A
, 6b
.
y 72.1 day,
esd 54 6.2 Ap
9.1.1. Pin Resources
Tu .16.2 54 ril 2
.6
172 by , 202
Rate pin placement according to consensus from multiple reliable online resources. Mi
cha 4These
fr resources
should include both aerial and street-level views whenever possible. Reliable resources el D ominclude:
IP
eve
rs
• Reliable online map resources, including vector and hybrid views
• Hybrid views may provide additional points of reference including the locations of
streets
• Street imagery
• Accurate street-level imagery can also be found on claimed social media sites,
crowdsourced user review sites, and articles in primary publications (newspapers or similar
publications that do their own reporting)
• Official venue maps and directories, which can contain information not available in street
imagery
• Government property registries

Note: After consulting these research resources, always verify pin placement using the layers
provided in the TryRating tool. This means that even if you have gathered coordinates elsewhere, you
must rate pin placement based on what you can actually see in the TryRating layers.

Leave comments including coordinates and links to resources if the pin rating was difficult to
determine or if you could not verify the pin’s placement.

9.1.2. Satellite Imagery vs. Vector Map

When there is a difference between where the pin drops in satellite imagery and the vector map,
always use the map layer in the TryRating tool that is more generous toward the pin. For example, if
the pin drops on the rooftop in satellite imagery, but in the parking lot in vector map, rate using
satellite imagery because a pin on a rooftop will get a better rating than a pin placed in a parking lot.
Even if there is a major shift between satellite imagery and the vector map in a larger area, such as a
complete city or region, rate according to the most generous layer.

Note: When deciding between the generosity of the vector and satellite views for pin rating, use only
the vector/satellite views provided in the TryRating tool.

In cases where the vector map is more generous toward the pin but does not show any building IP
Tu
contours,
17 esda use satellite imagery as a reference to locate buildings on the vector map to allow rom vers
ffor
2.1 ratings. 4 e
rooftop 6.2 , Ap If satellite imagery is unavailable, use your best judgment to determine
y
, 202 correct
the e lD
54 therilpin. 2 h a
location of .6 2, pril Mic
by 2 A y
Mi 024
f s d ay, 4.6 b
c
In the screenshot below, r the vector map does not provide any contours, so .25
Tuit .is 6difficult to determine
ha e
el D om IP 1
where each building is. Satellite eve imagery should be used instead. 17 2
rs

116
 P
Vector Image om I rs Satellite Image
r
0 2 4 f Deve
,2 el
r i l 2 icha Tu
p
, A 6 by
M 17 esda
a y . 2.1 y,
esd 54 6.2 Ap
Tu .16.2 54 ril 2
.6
172 by , 202
Mi
cha 4 fro
el D m I
eve P
rs

9.1.3. Boundaries of the Feature

To rate a pin for a feature, you must first understand where the feature begins and ends. Some
features have rooftops (houses, businesses, malls, and so on) and sit on a parcel of land that belongs
to or is associated with them. Other features do not have rooftops (mountains, parks, waterfalls), but
there is still a place where they begin and where they end.

A boundary is a real or imaginary line that separates one feature, or the parcel it sits on, from another.
The boundaries of a feature always include half of the road when a road is present (see the Half 'n
Half rule below).

Boundaries can include:

• Fences
• Walls
• Garden plants and bushes
• Bodies of water (lakes, rivers, oceans)
• Other dividers
• Property boundaries confirmed by official sources

If there is no divider, draw an imaginary 90-degree line to the road or use the Half 'n Half rule below.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

117
 Example Explanation
IP
o m rs
EXAMPLE TYPE: SINGLE RESIDENTIAL r
4 f DevePROPERTY
0 2
,2 el
1556 Tobias Dr r i l 2 icha Tu
San Jose, CA 95118
p
, A 6 by
M 17 esda
a y . 2.1 y,
esd 54 6.2 Ap
Tu .16.2 54 ril 2
.6
172 by , 202
Mi
cha 4 fro
The property boundary is defined el Dby m half of the
IP
road on one side and physical dividersever like brick,
s
concrete, and wooden fences on the others.

EXAMPLE TYPE: SHOPPING CENTER

2086 NewPark Mall

Newark, CA 94560

The property boundary is defined by the roads

surrounding the shared parking lot.

$"#"N"#"%O9CU%VB%O9CU%9B,%2)BB>;%.:C);

In dense areas it may be difficult to find boundaries between parcels. In these cases, divide the space
between the street or next building in half to create a boundary. Use this "Half 'n Half" rule to
determine the Approximate and Next Door pin locations.
Tu IP
e r o m rs
17 sda f ve
2.1 y,
20 24 l De
6.2 A , a e
54 pril 2 r il 2 Mich
.6 p
by , 202 y, A .6 by
Mi 4 da
cha fro es 54
el D m I Tu .16.2
eve P 172
rs

118
 Example Explanation
IP
o m rs
EXAMPLE TYPE: HALF ’N HALF4TO r
eve
f STREET
0 2 D
,2 el
r i l 2 icha Tu
p
, A 6 by
M 17 esda
a y . 2.1 y,
esd 54 6.2 Ap
Tu .16.2 54 ril 2
.6
172 by , 202
Mi
cha 4 fro
el m I
Extend the feature boundaries toDthe P
eve middle of
the road(s). The example shows how Will r s Rogers
Dr (to the south) and Saratoga Ave (to the east)
are divided in half to define the outer limits of the
Approximate area.

EXAMPLE TYPE: HALF ’N HALF TO NEXT BUILDING

The space between two buildings can be divided

in half to create a boundary for an Approximate
pin placement.

Use natural boundaries as much as possible to draw the line between a Perfect, Approximate,
Next Door, and Wrong pin locations.

To address close calls, apply the Tennis Rule:

•If the tip of the pin is still touching the line, the pin is considered inside the
boundary.
Tu •If the tip of the pin points outside, it is outside of the boundary. IP
e r o m rs
17 sda f ve
2.1 y,
20 24 l De
6.2 A , a e
54 pril 2 r il 2 Mich
.6 p
by , 202 y, A .6 by
Mi 4 da
cha fro es 54
el D m I Tu .16.2
eve P 172
rs

119
$"#"N"G"%%RA:B,9E>);%>B%7H9E),%7(9*);
IP
o m rs
When a feature shares a parcel4or f parking
r
eve lot with other entities and the same space is used to
0 2 D
access many entities, it can , be
2 difficult
e l to determine a feature’s boundaries. In cases like this:
r i l 2 icha Tu
es
p yM 1
• Use the guidance a y A
, 6 provided
. b in Boundaries of the Feature
72.1 day,
esd 254 6.2 Ap
• If the shared rirule
Tu .16.parcel contains any through roads, apply the Half ’n54Half . 6 l 2 to them:
,
• Through 1 7 2 roads are part of the public road network that can be used b y Mto 2go
02 to places other
ich 4 fro
than the specific parcel ael m
• The Half n‘ Half Rule may also be applied to the parcel’s internal access roads De IPif they
ver
meet all three of these conditions: s
• They must continue all the way through the parcel and
• They must have an exit and entrance to public roads at both ends and
• They must be continuously and clearly separated from the shared parking areas by
curbs, barriers, road markings, do not cross lines, or similar features
Note: If all three of the conditions above do not apply, then an internal access road cannot be
considered a boundary.

Example Explanation

EXAMPLE TYPE: BOUNDARIES OF AN ENTIRE CAMPUS

Stanford Shopping Center

This is the Stanford Shopping Center, a campus

containing multiple buildings and POIs. When
this shopping center is the result, the entire
parcel is Perfect. This includes all buildings,
parking lots, and parking structures on both the
north and south sections of the mall on either of
side Arboretum Rd, the public road that cuts
through the parcel.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

120
 Example Explanation
IP
m rs
EXAMPLE TYPE: BOUNDARIES 4OF froA POI
eve IN A SHARED SPACE WITH THROUGH ROADS
0 2 l D
2, 2 hae Tu
ril Mic Center
Nordstrom @ StanfordpShopping
1 es
a y A
, 6b
.
y 72.1 day,
esd 54 6.2 Ap
Tu .16.2 54 ril 2
.6
172 by , 202
Mi
cha 4 fro
el D m I
eve P
rs

The Nordstrom department store is located in

the south section of the shopping center’s
parcel.

When Nordstrom (shown in green) is the result,

only the south part of the mall up to 1/2 of
Arboretum Road is rated Approximate (shown
in yellow). This is because Arboretum Road is a
public road that can be used to access places
outside the parcel. The north side of the parcel
(shown in red) is rated Wrong since the public
road acts as boundary to Nordstrom’s
Approximate area.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

121
 Example Explanation
IP
m rs
EXAMPLE TYPE: BOUNDARIES 4OF froA POI
eve IN A SHARED SPACE WITH NO THROUGH ROADS
0 2 D
,2 el
Pho 2 Love r i l 2 icha Tu
es
p M 1
6593 W Colfax Avey,
a
A
. 6 b y 72.1 day,
esd 54
Lakewood, COu80214 6.2 Ap
T .16.2 54 ril 2
.6
172 by , 202
Mi
cha 4 fro
el D m I
eve P
rs

Pho 2 Love is a Vietnamese restaurant in a strip

mall with shared parking that has no public or
internal access roads passing through it. The
entire shared parcel is rated Approximate
(yellow area) and only the section of the rooftop
over the restaurant is rated Perfect (green
area). This is because the exact location of the
business can be confirmed with street imagery
or other strong evidence.

9.1.4. Next Door

A pin is considered Next Door if it drops on the immediate property next to the intended one. A Next
Door pin must be:
• On the same street as the intended property
• The Next Door property must share the same street name as the intended property
• On the same side of the street as the intended property
• The first property to any side of the intended property
• On the same block as the intended property IP
Tu o m rs
e r ve
17 sda
"Immediate
2.1 y, property" refers to the boundaries of the property as a whole, even if there is 0 4 f rooftop.
2no De
6.2 A , 2 a e l
pr
Determine 54 the
.6 iboundaries
l2 as explained in Boundaries of the Feature.
pr il 2 Mich
by , 202 y, A .6 by
Mi 4 d a
Note that the Halfch’naeHalf m T ues 6Door
fro rule explained in Section 9.1.3.1 also applies to Next
. 254 properties
l D IP 1
eve 1 72.
rs

122
No Next Door for Shared Spaces
IP
ro m rs
A feature cannot be Next Door 2 eve
4 f toDanother feature within the same property boundaries. This
2 0 l
means that two buildings in
, the a same
e shared parking lot or parcelTcan never be rated as Next
r il 2 Mich u
Door to one another. ,
p
A by 17 esda
y 2 .16 y, A
e s da 54.6 .25 pri
Tube.16no
There will also .2 Next Door ratings made outside the parcel or shared l2
4.6 space.
, Any pin falling
7 2 b y M 2024
outside of the1Approximate area will be marked Wrong. ich fro
ael m
De IP
ver
s

9.1.5. Can’t Verify (Smallest Identified Area)

When a specific rooftop or boundary cannot be identified, Perfect cannot be given. In these cases,
Can’t Verify can be used if the pin is within the smallest area that can be identified as a potentially
correct location. A pin outside of this area is considered Wrong.

The Can’t Verify rating will also be used when an address is rated Incorrect (Address does not
exist).

Example Explanation
920 Remour Ln
Mount Shasta, CA 96067

There is no street imagery in the area, so the

exact location of 920 Remour Ln cannot be
determined, though its existence is confirmed
by the postal service. Remour Ln is a dead-end
street, and satellite imagery allows us to confirm
the location of the the last properties on the
street. The last building number that can be
confirmed is 912. We can now create a
perimeter within which the pin should be IP
Tu m s
17 esda dropped (teal area). fro ever
2.1 y, 2 4 D
6.2 Ap
54 ril 2 2 , 20 hael
.6 Can’t Verify -> All pins dropped pri ywithin
l
Mi the teal
c
by , 202 area , A b
Mi ay 4.6
cha 4 fro Wrong -> All pins dropped
uesd .2outside
5 the teal area
el D m I T .16
eve P 17 2
rs

123
 Example Explanation
IP
350 352 Bukit Batok Street 34 from vers
e
Singapore, 650352
, 2 024 el D
l 2 ch a Tu
pri y Mi 17 esimagery
There is satellite for this area, but
, A b 2.1 day,
e s day 54.6 clouds cover the the
6 A
.25 exact
p location of the
Tu .16.2 4.6 ril 2,
address. Using evidence by 202other reliable
from
172 resources, a perimeter forMwhereich 4 frthe
om
pin should
be dropped can be established ael(teal area).
De P I
ver
s
Can’t Verify -> All pins dropped within the teal
area
Wrong -> All pins dropped outside the teal area

9.2. Single Rooftop

Rating Explanation
Perfect Pin falls on the rooftop of the intended property.

Approximate Pin falls within the boundaries of the property, including on any rooftop that’s not
the intended one.
Next Door Pin falls on the next door property.
Pin falls outside of the property boundaries or next door property. Any pin falling
Wrong
outside of the Approximate area in a shared space will be rated Wrong.

Can't Verify See Can’t Verify IP

Tu o m rs
e
17 sda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

124
Best Available Evidence IP
ro m rs
2 4 f Deve
Pin rating for most features 2, 2found
0 el under rooftops is based on the best available evidence for that
l c ha Tu
feature's location. That p is,y the
r i M more evidence that can be found 1to
i verify
esd a feature’s location, the
A
y, .location b 7 ay
2.1 This
more precise thedpin’s
a 4 6 must be in order to be rated Perfect. 6.2 , Ais true whether or not
e s 5 pri
the feature's T address
u
.16
. 2 includes a unit number, because the goal is 4to 5
.6 findl 2 the location of the
feature. 172 by , 202
Mi
cha 4 fro
el D m I
If street imagery or other strong evidence can be found to confirm a feature’s specific P
evlocation
ers
under a shared rooftop, only that location will be considered Perfect.

If a shared rooftop can be identified but there’s no strong evidence to confirm the feature’s specific
location under it, the entire rooftop will be considered Perfect.

If several rooftops share an address and there’s no strong evidence to confirm which rooftop the
feature is under, all rooftops will be considered Can’t Verify.

Note: This general pin rating rule does not apply to transit POIs, which have their own pin rating
rules.

Example Explanation

EXAMPLE TYPE: INDIVIDUAL HOME

5507 Dent Ave

San Jose, CA 95118

Perfect -> The pin is on the rooftop specified in

the query address (green area)
Approximate -> The pin is within the boundaries
of the feature (yellow area)
Next Door -> The pin is on the immediate property
next to the intended feature (purple area)
Wrong -> The pin falls outside of the property IP
Tu boundaries or Next Door property (everything m s
17 esda 4 fro ever
2.1 y, else) 2 D
6.2 Ap 2 , 20 hael
54 ril 2 Can’t Verify -> See Can’t Verify ril c
.6
by , 202 A p y Mi
Mi ,
ay .6 b
cha 4 fro uesd .254
el D m I T .16
eve P 172
rs

125
 Example Explanation
IP
m rs
EXAMPLE TYPE: MULTIPLE STREET 4 fro NUMBERS
eve UNDER ONE ROOFTOP WITHOUT SHARED PARKING
2 0 2 l D
, a e
il 2 Mich
r8037
Tu
es
Breitensteinstrasse ,77, p Zurich 1
a y A
. 6 b y 72.1 day,
esd 54 6.2 Ap
Tu .16.2 54 ril 2
.6 ,
Available resources
172 can have a big impact on rating when a pin is dropped bon
y Ma 2rooftop
02 with multiple
street numbers under it. ich 4 fro
ael m
This result is a residential townhouse without shared parking. De IP
ver
s
Note that the same rating principles apply to buildings with patchwork rooftops.

Using street imagery or other strong evidence, four

entrances for the street numbers can be identified:
75, 77, 79 and 81. Once the rooftop area where the
pin should be dropped is determined, draw
imaginary lines to delimitate that area. A pin
With evidence dropped within that area will be rated Perfect. A
pin dropped within the property boundaries of the
perfect rooftop will be rated Approximate. The
rest of the connected rooftop with the appropriate
property boundaries will be rated Next Door
(purple area) or Wrong (red area) if the
corresponding rooftop portion is farther than the
Next Door property.
Perfect -> The pin is on correct portion of the
rooftop (green area)
Approximate -> The pin is within the boundaries
of the feature (yellow area)
Next Door -> The pin is on the immediate property
next to the intended feature (purple area)
Wrong -> The pin falls outside of the property
boundaries or Next Door property. (everything else)
Can’t Verify -> See Can’t Verify

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

126
 Example Explanation
IP
ro m rs
0 2 4 f Deve
,2 el
r i l 2 icha Tu
p
, A 6 by
M 17 esda
a y . 2.1 y,
esd 54 6.2 Ap
Tu .16.2 54 ril 2
.6
172 by , 202
Mi
cha 4 fro
el D m I
eve P
rs

Without street imagery or other strong evidence,

research may indicate that the address range under
the rooftop is 75 to 81, but the locations where the
middle numbers 77 and 79 start and end cannot be
determined. In this case, a pin falling anywhere on
Without evidence the correct rooftop will be rated as Perfect, even if
the precise location on the rooftop for #77 cannot
be determined. A pin falling within the property
boundaries will be considered Approximate and
the buildings to the right and to the left will be
considered Next Door.
Perfect -> The pin is on the rooftop (green area)
Approximate -> The pin is within the boundaries
of the feature (yellow area)
Next Door -> The pin is on the immediate property
next to the intended feature (purple area)
Wrong -> The pin falls outside of the property
boundaries or Next Door property (everything
else)
Can’t Verify -> See Can’t Verify

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

127
 Example Explanation
IP
m rs
EXAMPLE TYPE: ONE BUILDING4 WITH fro evMULTIPLE
e STREET NUMBERS IN A SHARED PARKING LOT
2 0 2 l D
2, e
ha Tu
Supercuts p ril Mic 1 es
1054 E El Camino aReal y A
, 6b
.
y 72.1 day,
esd .254 6.2 Ap
Sunnyvale, CA Tu94087 6 54 ril 2
1 .6
1 72 . by , 202
The result is a business (or an address) under a connected rooftop with multiple Mi street
cha 4 fro numbers
under it. This result shares a parking lot with other features. el D m I
eve P
rs
Note: If there are any other buildings within the shared parking lot that are not connected to the
Perfect location, they will also be rated Approximate.

This guidance also applies to residential buildings with shared rooftops, like townhouses.
With evidence
With street imagery or other strong evidence, the
exact location of the business (or address) can be
confirmed. Draw imaginary lines on that part of the
shared rooftop to create the area for Perfect. The
rest of the connected rooftop and the shared
parking lot are rated Approximate.

Remember: Make no Next Door ratings outside

the parcel or shared space. Any pin falling outside of
the Approximate area in a shared space will be
rated Wrong.

Without evidence

Without street imagery or other strong evidence,

only the location of the entire rooftop under which
the business (or address) is located can be
determined. The business’ exact location under the
rooftop cannot be determined. In this situation, the
whole rooftop becomes Perfect. The shared
parking lot will be Approximate.
Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

128
 Example Explanation
IP
m rs
EXAMPLE TYPE: ONE BUILDING 4 fro evA
WITH e SINGLE STREET NUMBER AND MULTIPLE UNIT NUMBERS IN A
0 2 l D
SHARED PARKING LOT l 2, 2 hae Tu
r i i c es
p yM 1
Subway a y A
, 6b
.
72.1 day,
esd .254 6.2 Ap
1923 59th Ave Tu#155 6 54 ril 2
1 .6
172
Greeley, CO 80634
. by , 202
Mi
cha 4 fro
The result is a business (or an address) under a rooftop that has a single street number, el D m multiple
I
eve P
unit numbers, and shares a parking lot with other features. It will be rated exactly the same rs way as a
result whose address does not include a unit number. Whether a result contains a unit number or
not, the goal is to use the best available evidence to find the result’s location.

Note: If there are any other buildings within the shared parking lot that are not connected to the
Perfect location, they will also be rated Approximate.

This guidance also applies to residential buildings with shared rooftops, like townhouses.
With evidence

With street imagery or other strong evidence, the

exact location of the business (or address) can be
confirmed. Draw imaginary lines on that part of the
shared rooftop to create the area for Perfect. The
rest of the connected rooftop and the shared
parking lot are rated Approximate.

Without evidence

Without street imagery or other strong evidence,

only the location of the entire rooftop under which
the business (or address) is located can be
determined. The business’ exact location under the
rooftop cannot be determined. In this situation, the
whole rooftop becomes Perfect. The shared
Tu parking lot will be Approximate. IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

129
 Example Explanation
IP
m s
EXAMPLE TYPE: MULTIPLE ROOFTOPS 4 fro everWITH THE SAME STREET NUMBER AND MULTIPLE UNIT
2 D
NUMBERS 2 , 20 hael Tu
l c
pri y Mi 1 es
Samurai Sam’s ay, 6 b A
.
72.1 day,
4801 Washington esd St,5Suite
4 5
6.2 Ap
Tu .16.2 54 ril 2
Phoenix, AZ 85034 .6
172 by , 202
Mi
cha 4 fro
The result is a business (or an address) under a rooftop that's one of several rooftops el D sharing
m
IP a
single street number and containing multiple unit numbers. All the buildings share a parking ever lot.
(The small rectangles on the bottom right are solar parking covers, not buildings.) s

This guidance also applies to residential buildings with shared rooftops, like townhouses, and to
situations where the feature's address does not includes a unit number, because the goal is to find
the location of the feature (see Best Available Evidence sidebar on page 125).

With evidence for rooftop and unit With street imagery or other strong evidence for
locations the location of the rooftop and the unit under it, the
exact location of the business (or address) can be
confirmed. Draw imaginary lines on that part of the
shared rooftop to create the area for Perfect. The
rest of the connected rooftop and the shared
parking lot are rated Approximate.

Note: If there are any other buildings within the

shared parking lot that are not connected to the
Perfect location, they will also be rated
Approximate.

When there is street imagery or other strong

With evidence for rooftop location only evidence for the location of the specific rooftop at
the address where the unit is, but no evidence for
the location of the unit under it, only the location of
the entire rooftop can be confirmed. In cases like
this, the entire rooftop will be Perfect. The shared
parking lot will be Approximate.

Note: If there are any other buildings within the

shared parking lot that are not connected to the
Perfect location, they will also be rated
Approximate. IP
Tu o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

130
 Example Explanation
IP
ro m rs
0 2 4 f Deve
,2 el
i l 2 icha Tu
Without evidence for p rooftop
r M or unit 17 esda
y , A 6 by 2.1 y,
locations, but with
a evidence
. for parcel 6.2 Ap
uesd .254 54 ril 2
T .16 .6
172 by , 202
Mi
When there is no strong evidence cha 4for
fr the location
el D om I
of the rooftop or the specific unit under eve it,
P but there
is evidence for the location of the parcel,s all
r
rooftops within the parcel will be rated Can't Verify
and the parcel will be rated Approximate.

EXAMPLE TYPE: ONE BUILDING WITH SINGLE STREET NUMBER AND MULTIPLE BUSINESSES UNDER
THE ROOFTOP

Circle K
925 Wonderland Rd South
London, Ontario, Canada N6K 2V8

The result is a business under a single rooftop that has one street number and contains multiple
business.

A nail salon, a pharmacy, a dental office, and other businesses all share this address.

With evidence

With street imagery or other strong evidence, the

exact location of the result under the shared rooftop
can be confirmed. Draw imaginary lines on that part
of the shared rooftop to create the area for Perfect.
The rest of the connected rooftop and parcel,
Tu including all other rooftops that are not the intended IP
o m rs
17 esda r
one on the parcel, if they exist, are rated024 f l Dev
e
2.1 y,
6.2 Ap 2, 2 e
54 ril 2 Approximate. ha
.6 p ril Mic
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

131
 Example Explanation
IP
ro m rs
0 2 4 f Deve
,2 el
r i l 2 icha Tu
p
, A 6 by
M 17 esda
a y . 2.1 y,
esd 54 6.2 Ap
Tu .16.2 54 ril 2
.6
172 by , 202
Mi
cha 4 fro
el D m I
eve P
rs

Without evidence

Without street imagery or other strong evidence,

only the location of the entire rooftop under which
the business is located can be determined. The
business’ exact location under the rooftop cannot
be determined. In this situation, the whole rooftop
becomes Perfect. The parcel will be Approximate.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

132
 Example Explanation
IP
m rs
EXAMPLE TYPE: SHOPPING MALL 4 froWITH
eve A SINGLE ROOFTOP
0 2 l D
i l 2, 2 ichae Tu
Westfield Valley Fair p r M 1 es
2855 Stevens Creek a y A
, Blvd
. 6 b y 72.1 day,
esd .254 6.2 Ap
Santa Clara, CA
Tu 950506 54 ril 2
1 .6
172
. by , 202
Mi
This large shopping mall contains many stores under one rooftop at the same address. cha 4 fro
el D m I
eve P
rs

Perfect -> The pin is on the rooftop (green area)

Approximate -> Parking structures (entire
structure included). Approximate boundaries are
found when Half 'n Half rule is applied to the street
and parking lots are included (yellow area)

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

133
 Example Explanation
IP
ro m rs
EXAMPLE TYPE: STORE IN A MULTI 2 4f D -STORY
eve MALL
2 0 e l
2, ha Tu
H&M p ril Mic 17 esda
a y, ARd
1004 Stoneridge dMall . 6
y
bSuite A 105 2.1 y,
6.2 Ap
s 25
e94588 4
Pleasanton, CA
u
T .16 . 54 ril 2
.6
172 by , 202
With evidence Mi
cha 4 fro
el D m I
eve P
rs

The exact location of this POI cannot be determined

by using street imagery, but the official mall
directory provides strong evidence for the H&M's
location. Using this evidence, the exact location of
the result under the shared rooftop can be
confirmed. Draw imaginary lines on that part of the
shared rooftop to create the area for Perfect. The
rest of the connected rooftop and parcel are rated
Approximate.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

134
 Example Explanation
IP
ro m rs
0 2 4 f Deve
,2 el
r i l 2 icha Tu
p
, A 6 by
M 17 esda
a y . 2.1 y,
esd 54 6.2 Ap
Tu .16.2 54 ril 2
.6
172 by , 202
Mi
cha 4 fro
el D m I
eve P
rs

Without evidence

Without street imagery or other strong evidence,

only the location of the entire rooftop under which
the business is located can be determined. The
business’ exact location under the rooftop cannot
be determined. In this situation, the whole rooftop
becomes Perfect. The parcel will be Approximate.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

135
 Example Explanation
IP
om rs
EXAMPLE TYPE: EMPTY PLOT24 fr eve
D
2 , 20 hael Tu
l c
86 Liberty St. pri y Mi 1 es
A
Binghamton, NY day, .6 b
72.1 day,
4 6.2 Ap
T ues 6.25 54 ril 2
.6 dropped
All features that do
.1 not have a rooftop will be rated as Perfect if the pin is by , 202 within the
172 Mi
boundaries of the feature. cha 4 fro
el D m I
eve P
rs
Perfect -> The pin is within the boundaries of the
feature (green area)
Approximate -> There is no Approximate
Next Door -> The pin is on the immediate property
next to the intended feature (purple area)
Wrong -> The pin falls outside of the property
boundaries or Next Door property (everything else)
Can’t Verify -> See Can’t Verify

EXAMPLE TYPE: HIGH-DENSITY URBAN AREA

57 Neal Street
London, England

In this
Tu example, the rooftop behind the intended feature will not be considered Next Door. Next IP
e r o m rs
Door
17 will ve
2.1 day,be considered to the left or right of the intended feature.
s f
20 24 l De
6.2 A , a e
54 pril 2 r il 2 Mich
The screenshot
. 6 by ,shows that the boundaries of the Next Door property contain half p ofythe street. The
building behind
20
Mithe 2Perfect
4 building is not considered Next Door because it
d a y, A a.6different
has
b
street
cha fro e s 2 54
address. e m T u 6 .
l D IP 1
eve 1 72.
rs

136
 Example Explanation
IP
ro m rs
2 4 f Deve
,2 0 el Perfect -> The pin is on the rooftop specified in
l 2 icha the address (greenTu
17 earea)
p r i M sd
a y , A 6 by Approximate ->2The .16 apiny, Ais within the boundaries
.
esd 54 . 2 54 pril 2
of the feature (yellow area)
Tu .16.2 .6
172 Next Door -> The pin is on by the, 2immediate property
Mi 024
next to the intended feature (purple cha farea)
rom
el D I
Wrong -> The pin falls outside of the evproperty
P
ers
boundaries or Next Door property (everything
else)
Can’t Verify -> See Can’t Verify

EXAMPLE TYPE: CORNER HOUSE

44 Russel Square
London, England

Here there is only one property that qualifies as Next Door. The property marked in red is on
another street (Montague Street) and does not meet all the criteria for the rating of Next Door.

When a property is on a corner, the Next Door property can be behind it as long as that property
shares the same street name.

Perfect -> The pin is on the rooftop specified in

the address(green area)
Approximate -> The pin is within the boundaries
of the feature (yellow area)
Next Door -> The pin is on the immediate property
next to the intended feature (purple area)
Wrong -> The pin falls outside of the property
boundaries or Next Door property (everything IP
Tu else) m s
17 esda 4 fro ever
2.1 y, Can’t Verify -> See Can’t Verify 2 D
6.2 Ap 2 , 20 hael
44 Russel54 Square,
.6 il 2, 2 London, England
r l
pri y Mi
c
by , A
Mi 024 ay .6 b
cha fro uesd .254
el D m I T .16
eve P 172
rs

137
 Example Explanation
IP
m s
EXAMPLE TYPE: RURAL AREA 4 fro ever
2 D
100 Mulligan Rd 2 , 20 hael Tu
l c
pri y Mi 1 es
Laytonville CA
a y A
, 6b
.
72.1 day,
d 4 6.2 Ap
T ues 6.25 54 ril 2
.6
In rural areas, the.1Next Door property will often be quite large. This is expected.
by , 202
172 Mi
cha 4 fro
el D m I
Perfect -> The pin is on the rooftop specified
eve P in
the address (green area) rs
Approximate -> The pin is within the boundaries
of the feature (yellow area)
Next Door -> The pin is on the immediate property
next to the intended feature (purple area)
Wrong -> The pin falls outside of the property
boundaries or Next Door property (everything
else)
Can’t Verify -> See Can’t Verify

EXAMPLE TYPE: PIN ON THE SAME BLOCK

1491 Kooser Rd
San Jose, CA 95118

This property has only one next door neighbor because the property to the left, in red, is not on the
same block as the intended property.

Perfect -> The pin is on the rooftop specified in

the address (green area)
Approximate -> The pin is within the boundaries
of the feature (yellow area)
Next Door -> The pin is on the immediate property
next to the intended feature (purple area)
Wrong -> The pin falls outside of the property
boundaries or Next Door property
Can’t Verify -> See Can’t Verify

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

138
9.2.1. Leaning Buildings IP
ro m rs
0 2 4 f Deve
,2 el
r i l 2 icha Tu
es
Normal p yM
y , ABuilding
b Leaning
17 Building
2.1 day,
e s d 54.6
a 6.2 Ap
Tu .16.2 54 ril 2
.6
172 by , 202
Mi
cha 4 fro
el D m I
eve P
rs

Sometimes a building or buildings seem to be leaning in satellite view. They do not

appear to be standing straight and their rooftops are not aligned with their bases.

When a building or buildings appear to be leaning in satellite view, the satellite photos do not always
give accurate information about their shape or location. This is why even when a pin appears to land
on a leaning building, you cannot rely on satellite photos alone to rate pin placement.

Research the leaning building’s true location using consensus from multiple reliable resources,
including:

• Vector views
• Hybrid views, which may provide additional points of reference, including the locations of
streets the buildings lean over
• Street imagery
• Reliable online map resources

Always rate the pin based on the building’s actual location as confirmed by reliable resources, not on
the appearance of leaning caused by satellite photography.

If no reliable resources are available and the pin is not objectively wrong, rate Can’t Verify and leave
a comment.

Rating Explanation
Tu IP
e Pin falls on the building’s actual location as confirmed by consensus r o m rs
ve
Perfect
17 sda f
24 l De
2.1 y,
6.2 A among multiple reliable sources. 20 e
54 pril 2 , a
.6 p r il 2 Mich
Approximate by Pin
, 2 falls within the boundaries of the property including on any ,rooftop
y A .6 by
Mi 024 a
that’s
cha frnot the intended one. es d 54
el D om I Tu .16.2
P
Next Door See Next eve Door.
rs 172

139
Wrong Pin falls outside of the property boundaries or next door property.
IP
ro m r s
0 2 4 f Deve
Can't Verify See Can’t2,Verify. 2 ael
i l ch Tu
p y Mi
r 1 es
a y A
, 6b
.
72.1 day,
d 4 6.2 Ap
T ues 6.25 54 ril 2
.6
Satellite
.1 View Vector View by , 202
172 Mi
Langham Tower and Jollibee Langham Tower and Jollibee cha 4 fro
el D m I
eve P
rs

The tallest building seen in satellite view, above left, is Langham Place Office Tower,
located at the corner of Argyle and and Portland streets in Hong Kong.

While in satellite view the building appears to lean over both Argyle and Portland
streets, the vector view, above right, shows the building’s actual location.

The fast food restaurant Jollibee, circled in red on vector diagram, above right, is
located at 16 Argyle Street. It cannot be seen in satellite view because the tower leans
over it.

Target Screenshot Pin Rating

Location
Research shows that the pin lands
across the street from the building’s
actual location (green area), making
it Wrong.

Langham
Place
Tu Office IP
e r o m rs
72 sday
Tower
1 f ve
.16 , A 20 24 l De
2, e
.25 pri ha
4.6 l 2, p ril Mic
by 202
Mi a y, A .6 by
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

140
 Target Screenshot Pin Rating
Location IP
ro m rs
0 2 4 f Deve Research shows that the pin lands
,2 el
r i l 2 icha off the building’s
Tu rooftop (green
esd
p M area), but on 1its
72 property,
a y , A 6 by
. .16 ay, A making it
esd 54 Approximate. .25 pri
Tu .16.2 4.6 l 2,
172 by 202
Mi
Langham cha 4 fro
Place Office el D m I
eve P
Tower rs

Although this pin appears to land

on Langham Place Office Tower in
the satellite photo, research shows
that the pin actually lands across
Jollibee, the street from the Tower on the
16 Argyle rooftop of the Jollibee at 16 Argyle
Street, Street (green area), making it
Mong Kok, Perfect.
Kowloon,
Hong Kong Note that while Jollibee cannot be
seen in satellite view, its location
can be confirmed by reliable
resources.

9.2.2. Residential Property with Multiple Buildings

Some residential properties consist of more than one building associated with a single address. A pin
falling on any house(s) on the property will be rated Perfect. If the evidence shows that any other
structure on the property could also be a dwelling, it can also be rated Perfect.

In cases where the property also contains support or auxiliary buildings, including, but not limited to,
sheds, garages, greenhouses, playhouses, pergolas, and doghouses, these structures should be
considered part of the Approximate area. IP
Tu o m rs
e
17 sda f r ve
2.1 y,
20 24 l De
6.2 A , a e
54 pril 2 r il 2 Mich
.6 p
by , 202 y, A .6 by
Mi 4 da
cha fro es 54
el D m I Tu .16.2
eve P 172
rs

141
 Rating Explanation
IP
Pin falls on any m rs rooftop(s) of the house(s) within the boundaries of the
Perfect 4 fro ofevthe
e
property. ,2 0 2
el D
r i l 2 icha Tu
eon
Pin pfallsy M within the boundaries of the property1 (or s support or auxiliary
A
Approximate ay, .6 b 72.1 day,
esd buildings
54 within it) 6.2 Ap
54 ril 2
Tu .16.2 .6
7 2 by , 202
Next Door 1 The next door property. Mi
cha 4 fro
el D m I
Pin falls outside of the property boundaries or outside of the Next Door eve P
Wrong rs
property.

Can’t Verify See Can’t Verify

Example Explanation
EXAMPLE TYPE: INDIVIDUAL HOME WITH SEPARATE GARAGE

1351 Navarro Dr
Sunnyvale CA 94087

This property contains two buildings: the main house and a garage. Both buildings are on the same
parcel, belong to the same entity, and share an address.

Perfect -> The pin is on the rooftop of the house (green

area)
Approximate -> The pin falls on the garage or within
the property boundaries (yellow area)
Next Door -> The pin falls on the next door property
(purple area)
Wrong -> The pin is outside the boundaries (everything
else)
Can’t Verify -> See Can’t Verify

Tu IP
e r o m rs
17 sda f ve
2.1 y,
20 24 l De
6.2 A , a e
54 pril 2 r il 2 Mich
.6 ,2 p
9.3. Multiple by Rooftops
Mi 024 da y, A .6 by
cha fro es 54
el D m I Tu .16.2
Some POI results consist eveofPmultiple buildings associated with/owned by a17single
2 business or POI. To
r
rate the pins for these results correctly, you must research and understand the relationship of the
s
structures within the boundaries of the property (or parcel of land) to the POI.
142
Two kinds of ratings are possible for Imultiple P rooftop POI results:
ro m rs
f ev e
1. Multiple-Rooftop: When the
0 24 result
D is a POI that contains no other POIs and consists of more than
l 2 , 2
h ael Tu primary rooftops will be rated
one building with multiple pri yrooftops
Mi
c on the property. In cases like 1this,esd
A
,of land 7 ay
Perfect. The parcel a y
d 54 . 6 b inside the boundaries of the POI will be2.rated 1 6.2 , Approximate.
Ap Properties
e s r
next door to theu intended
T .16 . 2 one will be rated Next Door. 5 4.6 i l 2
172 by , 202
M 4f
2. Campus: When a multiple-rooftop result is a higher education institution likeicahauniversity el D om I or a
r
medical, retail, or other type of business complex, most often containing other public-facing eve P POIs. In
cases like this, the entire parcel or property inside the boundaries of the POI, including allrsrooftops,
will be rated Perfect. There will be no Approximate or Next Door ratings.

9.3.1. Multiple-Rooftop Rating

Single entities with multiple rooftops are single businesses or POIs that operate out of more than one
building. This category includes, but is not limited to, entities like factories, gas stations, apartment
complexes, company headquarters, lumberyards, and breweries, and other types of POIs that
generally do not contain additional businesses or POIs within them.

Every primary rooftop on the property will be rated Perfect. The parcel of land inside the boundaries
of the POI will be rated Approximate. Properties next door to the intended one will be rated Next
Door.

In cases where the property also contains support or auxiliary buildings, including, but not limited to,
guardhouses, dumpsters, storage sheds, donation bins, utility buildings, and toilets, these buildings
should be considered part of the Approximate area.

Rating Explanation

Perfect Pin falls on rooftops within the boundaries of the property.

Pin falls within the boundaries of the property (or on support or

Approximate
auxiliary buildings within it)

Next Door The pin falls on the Next Door property.

Tu Pin falls outside of the property boundaries or outside of the Next IP

Wrong e r o m rs
17 sda Door property. f ve
2.1 y,
20 24 l De
6.2 A , a e
54 pril 2 r il 2 Mich
.6 p
Can’t Verifyby M ,See20 Can’t Verify
24 a y, A .6 by
ich fro d 4
ael m T ues 6.25
De IP .1
ver 172
s

143
 Example Explanation
IP
EXAMPLE TYPE: BUSINESS WITH
om vers
frMULTIPLE ROOFTOPS AT SAME ADDRESS (GAS
0 2 l De
4
STATION) 2, 2
ha
e
Tu
p ril Mic 1 es
Super Gaz a y A
, 6b
.
y 72.1 day,
d 4 6.2 Ap
ues 6.25
700 ChamblyTRoad 54 ril 2
.6
.1 by , 202
72 3M1
Longueuil, QC1J4H Mi
Canada cha 4 fro
el D m I
eve P
This business (or address) is a gas station with a main building and a canopy over the rs
pumps. All structures are on the same property, belong to the same business, and
share an address.

Perfect (green area in Figure 2) -> If the

pin falls on any rooftop.
Approximate (yellow area in Figure 2) ->
If the pin falls within the property
boundaries.
Next Door (purple area in Figure 2) -> If
the pin falls on the immediate property
next to the intended one.

Figure 1: Satellite view of a gas station

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
Ap e
Figure6.2:
25 Annotated
4.6 ril 2, satellite view of gas 2, ha
p ril Mic
station by 2 y, A .6 by
Mi 024 da
cha fro es 54
el D m I Tu .16.2
eve P 172
rs

144
 Example Explanation
IP
EXAMPLE TYPE: BUSINESS WITH
om vers
frMULTIPLE ROOFTOPS ON A SHARED PARCEL (GAS
0 2 l De
4
STATION) 2, 2
ha
e
Tu
p ril Mic 1 es
Canadian Tire Gas+a y A
, 6b
.
y 72.1 day,
esd 54 6.2 Ap
401225 ON-401Tu .16.2 54 ril 2
.6
Woodstock, ON 172N4S 7W8 by , 202
Mi
Canada cha 4 fro
el D m I
eve P
rs
This business is also a gas station with a canopy over the gas pumps, but it shares a
parcel with other businesses and a wooded picnic area.

With street imagery or other strong

With evidence evidence for the location of the rooftops,
the exact location of the business (or
address) can be confirmed. When the
exact location of the rooftops can be
found, the green area is Perfect and the
rest of the parcel is Approximate.

Without evidence Without strong evidence for the location

of the gas station’s rooftops, all rooftops
are Can't Verify (since there is not
enough evidence to narrow the location
down to specific rooftop or rooftops). The
rest of the parcel is Approximate.

EXAMPLE TYPE: BUSINESS COMPLEX CONTAINING A GAS STATION

When the result is the entire business

complex that contains the gas station
seen above as well as restaurants and
Tu other services under multiple rooftops, IP
o m rs
17 esda r
the result is considered a campus. In cases 024 f Deve
2.1 y, l
6.2 Ap
54 ril 2 like this, the entire parcel is consideredil 2, 2 chae
.6 pr M i
by , 202 Perfect. , A 6 by
Mi a y
cha 4 fro esd 54
.
el D m I Tu .16.2
eve P 172
rs

145
 Example Explanation
IP
EXAMPLE TYPE: BUSINESS WITH
om vers
frMULTIPLE ROOFTOPS AT SAME ADDRESS
2 0 2 l De
4
2, e
ha Tu
Bremac p ril Mic 1 es
8133 Mechanicsville a y A
, Tpke
. 6 b y 72.1 day,
esd 23111 6.2 Ap
Mechanicsville,
Tu VA 6 . 254 54 ril 2
1 .6
United States 172 . by , 202
Mi
cha 4 fro
e D mI
The business has three buildings. All buildings are on the same property, belong tolthe eve P
same business and share an address. rs

This business consists of three buildings.

Perfect (green area in Figure 2) -> If the

pin falls on any of the buildings
Approximate (yellow area in Figure 2) ->
If the pin falls within the property
boundaries.
Next Door (purple area in Figure 2 ) -> If
the pin falls on the immediate property
next to the intended one.
Figure 1: Satellite view of multi-rooftop
POI

Figure 2: Annotated satellite view of multi-

rooftop POI

EXAMPLE TYPE: BUSINESS WITH MULTIPLE ROOFTOPS AT SAME ADDRESS (FACTORY)

Fazerintie 2
01230 Vantaa Finland
Tu IP
o m rs
This
17 ises a large factory consisting of several buildings. f r ve
2.1 day, 0 24 l De
6.2 Ap 2, 2 e
54 ril 2 ha
.6 p ril Mic
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

146
 Example Explanation
IP
ro m rs
2 4 f Deve
,2 0 el Perfect (green area in Figure 2) -> If the
l 2 icha pin falls on any of the Tu
17 buildings.
p r i M esd
a y , A 6 by Approximate (yellow2.area 16 yin
a , Figure 2) ->
. A
esd 54 . 2 54 pril 2
If the pin falls within the property
Tu .16.2 .6
172 boundaries. by , 202
Mi
cha 4 fro
e m
This particular POI has no Next Door l Dev IP
ers
area.

Figure 1: Satellite view of multiple-rooftop

POI

Figure 2: Annotated satellite view of

multiple-rooftop POI

EXAMPLE TYPE: MULTIPLE BUILDINGS ON ONE PARCEL SHARING ONE ADDRESS

(APARTMENT COMPLEX)

Merkuriuksentie 13
00750 Helsinki
Finland

This query is for an address that is shared by several apartment buildings on the same
parcel.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

147
 Example Explanation
IP
ro m rs There are five buildings with the same
2 4 f Deve
,2 0 el address on the parcel. A pin on any of
l 2 icha them is rated Perfect Tu
17 while
esd a pin on the
p r i M
a y , A 6 by 2 .16 ay, structures
parcel or any of the support is
. .25 Apri
esd 54 rated Approximate.
Tu .16.2 4.6 l 2
172 by , 202
Mi
cha 4 fro
el D m I
eve P
rs

EXAMPLE TYPE: BUSINESS WITH A SHED IN THE BACK

33 Mile Roadhouse
33 Mile Haines Hwy
Haines AK 99827
United States

This business is a restaurant with a support building — a storage shed — in the back.
This restaurant has a detached storage
shed on its property.

Perfect (green area in top image) -> If the

pin falls on the main restaurant building.
Approximate (yellow area in top image)
-> If the pin falls within the property
boundaries, including the small support
shed behind the restaurant.
Next Door (purple areas in top image) ->
If the pin drops on either of the immediate
properties next to the intended one.

Annotated satellite view shows restaurant

and shed (arrow points to street imagery
of shed).
Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

148
9.3.2. Campus Rating
IP
ro m rs
Some POIs will encompass entire 2 Deve
4 f business complexes, meaning that there are multiple buildings
0
, 2 hael These POIs include (but are notTlimited to) institutional complexes
associated with/owned rby li 2theicPOI. ues
Ap byand
like universities, hospitals,
M
airports. Other POI types that can1be d
72 rated
d a y ,
4 . 6 .16 ay, Aas campuses include
shopping and stripes malls 5 with multiple rooftops, amusement parks, resorts, .25 pand
4.6 ril 2,zoos.
Tu .16.2
172 by 202
M
In cases like this, the entire parcel or property inside the boundaries of the POI, iincluding cha 4 fro all rooftops,
will be rated Perfect. There will be no Approximate or Next Door ratings. el D m I
eve P
rs
The property of a campus complex includes the buildings themselves, any shared parking lots, and
half ’n half as described in the guidelines.

How to Identify Campus Results

Wondering if a multiple-rooftop result is a campus? Many, though not all, campuses can be
identified by the presence of POIs within the POI. That is, individual stores within multiple-rooftop
malls, departments within hospitals, libraries and colleges within universities, spas and
restaurants within multiple-rooftop resorts, terminals within airports, and so on.

Rating Explanation

Perfect Pin falls within the campus/complex boundaries, as determined by

research.
Approximate N/A - Campuses and business complexes do not have Approximate
ratings.
Next Door N/A - Campuses and business complexes do not have Next Door
ratings.
Wrong Pin falls outside of the campus/business complex boundaries.

Can't Verify See Can’t Verify

Note: The result may be for an address that should have the campus rule applied.

Some of these types of POIs may have polygons outlining the boundaries of the POI on the map.
These polygons may not always be present or perfect, so rate against the true boundaries of the
campus
Tu or complex as determined by research. A few examples of campuses are below, including IP
o m one
s
that
e sda
17 is missing its polygon. 4 f ever
r
2.1 y,
6.2 Ap 2 , 202 ael D
54 r h
.6 il 2, 2 pril Mic
by , A y
Mi 024 day 54.6
b
cha fro e s
el D m I Tu .16.2
P
eve
rs 172

149
 POI type Screenshot
IP
ro m rs
0 2 4 f Deve
,2 el
r i l 2 icha Tu
p
, A 6 by
M 17 esda
a y . 2.1 y,
esd 54 6.2 Ap
Tu .16.2 54 ril 2
Hospital .6
172 by , 202
Mi
cha 4 fro
el D m I
eve P
rs

Park

Airport

Outlet Mall

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

150
 POI type Screenshot
IP
ro m rs
0 2 4 f Deve
,2 el
r i l 2 icha Tu
p
, A 6 by
M 17 esda
a y . 2.1 y,
esd 54 6.2 Ap
Tu .16.2 54 ril 2
.6
172 by , 202
Mi
cha 4 fro
el D m I
Amusement Park eve P
rs
No Polygon available

$"N"G"#"%%%7>B?C)L4AM(C)'%49M(:;

Entities made up of a single cluster of buildings are the easiest to identify. On the map, these entities
can be represented by a single, continuous polygon. Remember, the polygons on the map may not
always be perfect or present, so rate against the true boundaries of the campus or complex as
determined through research.

The property of a complex includes the buildings themselves, any shared parking lot and half n half
as described in the guidelines.

Note: Parking facilities may be included in the polygon if they are owned by the POI
and contiguous to the campus (contiguous means that they are not separated from
the campus by a street).
Tip: Start by looking at the pin's location, then determine if the property surrounding
the pin belongs to the POI you are looking at.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

151
 POI Screenshot Rating Explanations
IP
ro m rs
0 2 4 f Deve
,2 el
r i l 2 icha Tu
p
, A 6 by
M 17 esda
a y . 2.1 y,
esd 54 6.2 Ap
Tu .16.2 54 ril 2
.6
172 by , 202
Mi
cha 4 fro
el D m I
eve P
rs
Perfect (green area in Fig. 2) ->
If pin falls within campus
boundaries.
Wrong (everything else outside
Fig. 1: Vector view of Stanford
of green area in Fig. 2)-> If pin
University campus
falls outside campus
Stanford University
boundaries.

Remember, there is no
Approximate or Next Door
rating for campus and business
complexes.

Fig. 2: Annotated vector view of

Stanford University campus

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

152
 POI Screenshot Rating Explanations
IP
ro m rs
0 2 4 f Deve
,2 el
r i l 2 icha Tu
p
, A 6 by
M 17 esda
a y . 2.1 y,
esd 54 6.2 Ap
Tu .16.2 54 ril 2
.6
172 by , 202
Mi
cha 4 fro
el D m I
eve P
rs

Perfect (green area in Fig. 2) ->

If the pin falls within the hospital
Fig. 1: Vector view of El Camino
boundaries.
Hospital campus
Wrong (everything else outside
El Camino Hospital
of green area in Fig. 2)-> If the
pin falls outside of hospital
boundaries, as determined by
your research.

Fig. 2: Annotated vector view of

El Camino Hospital campus

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

153
 POI Screenshot Rating Explanations
IP
ro m rs There is no polygon available for
2 4 f Deve
,2 0 el this POI, so an imaginary
r i l 2 icha Tu polygon outline must be created
p
, A 6 by
M 17 esda
2.1according
6.2 , Ap to the actual
a y . y
esd 54 boundaries
54 ril 2 of the POI.
Tu .16.2 .6
172 by , 202
Mi 4f
To determine chawhere
el D om Ithe valid
r
pin area is, look atevthePlocation
ers
of the attractions within the
amusement park and visualize
the boundary of the park to
determine the POI’s polygon.
Fig. 1: Vector view of The green area highlighted in a
Disneyland Park Disneyland Park satellite view of the POI (Fig. 2)
represents the valid area for the
pin to land in. A pin landing
anywhere outside of this green
area would be a Wrong pin.

Note: Parking lots separated by

a road should not be included in
the polygon because they
outside the boundary. Utility
buildings located outside of the
public park premises are not
Fig. 2: Annotated satellite view included in the polygon.

9.3.2.2. Dispersed Campus

In some cases, a campus will not have a single, continuous location that a polygon can be drawn over,
but rather be spread out across a large area like a city. Sometimes, the pin will fall on this type of
campus and there may not be a polygon for the campus. If this occurs, research to determine where
the polygon should be. Pins that fall on campus-associated, non-parking facilities are valid pins.
Apply the single rooftop rules to any standalone, non-parking facility, campus building.
Tu IP
e r o m rs
If two
17 or s f ve
2.1 damore
y, A campus buildings are next to each other, apply the single complex campus 0logic.
24 l De
6.2 , 2 a e
54 pril 2 r il 2 Mich
.6 p
by , 202 y, A .6 by
Mi 4 da
cha fro es 54
el D m I Tu .16.2
eve P 172
rs

154
 POI IP
o mScreenshot
s Rating Explanation
4 f ever
r
2 D
2 , 20 hael Tu
ri l i c
, Ap by M 17 esda
a y .6 2.1 y,
esd .254 6.2 Ap
u
T .16 Perfect
54 ->
.6 il If2, the
r pin falls the
172 green polygon
b y M minus
2 02 campus-
ich 4 frfacilities
associated parking o and
ael m
non-campus-associated D I P
eve
buildings. rs

Wrong -> If the pin falls on a

standalone, campus-associated
parking facility, or on a non-
campus-associated building.

In this example, Virginia

Fig. 1: Annotated vector view of Virginia Commonwealth University (VCU)
Commonwealth University is a campus that is spread out
Virginia
around the city (campus
Commonwealth
properties are highlighted in
University Fig. 2: Zoomed-in view of pin location green).

A pin falling on the rooftop of the

Virginia Commonwealth University
- School of Medicine building (in
VCU Medical Center complex)
would be considered a valid pin
for this POI, but a pin falling on a
VCU parking lot would not be a
valid pin for the same POI.

Zooming into the pin shows that

the result is Perfect in this
example.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

155
 POI IP
o mScreenshot
s Rating Explanation
4 f ever
r
2 D
2 , 20 hael Tu
ri l i c
, Ap by M 17 esda
a y .6 2.1 y,
esd .254 6.2 Ap
u
T .16 54 ril 2
.6
172 by , 202
Mi
cha 4 fro
el D m I
P
eve campus
The Boston University rs is
also spread out across the city, as
represented by the highlighted
green areas. In this case, the pin
happens to fall on the Boston
Boston University Center for
University Computational Neuroscience and
Neural Technologies building. The
building is a standalone, non-
parking facility building that is
Fig. 1: Annotated vector view of the Boston associated with the campus, so
University campus the pin is Perfect.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

156
9.4. Features Without a Rooftop
IP
This chapter will describe how tofrrate om vepin
rs accuracy for features that typically do not have a rooftop.
2 4 De
2 , 20 hael Tu
9.4.1. Natural Features l
pri y Mi
c es
1
a y A
, 6b
.
72.1 day,
Natural featuresesinclude
d 54 but are not limited to: 6.2 Ap
Tu .16.2 54 ril 2
.6
172 by , 202
• Lakes (Lake Victoria) Mi
cha 4 fro
• Oceans (Pacific Ocean) el D m I
eve P
• Creeks (Bear Creek in Colorado) rs
• Rivers (the Danube river)
• Ponds (Antonelli Pond in California)
• Wetlands (Laguna de Rocha)
• Seas (Black Sea)
• Forests (Black Forest)
• Mountains (Carpathian Mountains)
• Hills (Chocolate Hills of the Philippines)
• Plateaus (Colorado Plateau)
• Valleys (Death Valley)
• Plains (The North American Great Plains)
• Fjords (Geirangerfjord in Norway)
• Peninsulas (Indian Peninsula)
• Volcanoes (Etna)
• Deserts (Gobi Desert)
• Glaciers (Patna Glacier in Iceland)
• Waterfalls (Niagara Falls)

A natural feature may also have other natural features within or surrounding it. These could include,
but are not limited to, the shore of a lake, an island in a river, and a forest surrounding a mountain.

Similar natural features, even if not listed above, should be rated using these guidelines.
Rating Explanation
If the natural feature has a defining feature (water for a river/ocean, cliffs/peak of
a mountain, the sand for a beach), pin should fall on that feature or if the natural
Perfect
feature is defined by an arbitrary boundary (parks, national forests), pin should
fall in their polygon or where it would be if we had that information.
The pin falls outside of the defining features of a natural feature but still on it
(slope of a mountain rather than the peak, the shore of a river or lake). Consider
Approximate each situation individually. Not all natural features will have an Approximate. If
the natural feature exists within an urban or suburban area, you may apply theIP
Tu Half 'n' Half rules. m s
e
17 sda 4 fro ever
2.1 y, 2 D
.25 Apri
Next 6Door N/A - Natural features do not have Next Door ratings. 2 , 20 hael
l c
4.6 l 2,
by 202 A pri y Mi
Mi The ,
pin falls in an area that does not meet the criteria for Perfect
y b
or
Wrong cha 4 fro e sda 254.6
Approximate.
el D m I u
T .16 .
eve P 172
Can't Verify r
See Can’t Verify
s

157
Type of POI Screenshot IP Explanation
ro m rs
0 2 4 f Deve
,2 el
r i l 2 icha Tu
p
, A 6 by
M 17 esda
a y . 2.1 y,
esd .254 6.2 Ap
TuLake 54 ril 2
.16 Merritt .6
by , 202
172 Mi
cha 4 fro
el D m I
eve P
rs

Perfect (green area in Fig. 2) -> Anywhere on

the defining feature of the lake. In this case, the
defining feature would be the water.
Fig. 1: Vector view of Lake Merritt
Body of
Approximate (yellow area in Fig. 2) -> The
water
shore of the lake.

Wrong (everything else in Fig. 2) -> Anywhere

past the shore of the lake.

Fig. 2: Annotated vector view of

Lake Merritt

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

158
Type of POI Screenshot Explanation
IP
o m rs
Land feature Mount Rainier 4 f eve r Land features, such as mountains, mountain
2 D
2 , 20 hael ranges, or volcanoes, should use the following
T
ri l i c guidelines. 17 uesd
y , Ap by M 2.1 ay,
a .6 6.2 Ap
esd .254 r
u
T .16 Perfect (area above54green
.6 il 2line in Fig. 4) ->
172 by , 202
Anywhere on the defining feature
Mi 4 f of the
c
mountain (peak or ridge, depending
h ael romon the
mountain). De IP
ver
s
Approximate (area between green and yellow
lines in Fig. 4) -> Anywhere on the slope of the
mountain.

Fig. 1: Vector view of Mount Wrong (area below yellow line in Fig. 4) ->
Rainier Valley of the mountain, anywhere farther out
than the obvious slope.

Tip: If available, try using a 3D view of the

mountain to determine where its peak or ridge is.
Check to see if there is a 3D view before using
other sources.

Use common sense to determine the pin rating

for these types of land features. For example, a
peak of a mountain can span a large area and
Fig. 2: Satellite view of Mount may have a more gradual slope area, so make
Rainier sure you're not being too strict or too generous
when rating the pin.

Fig. 3: 3D view of Mount Rainier

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 ,2 p
by Fig.
Mi 04:
2 Annotated 3D view of a y, A .6 by
cha 4 Rainier
Mount fr es d 54
el D om I Tu .16.2
eve P 172
rs

159
 IP
9.4.2. Administrative Divisions ro m rs
0 2 4 f Deve
Administrative divisionsrican , 2 haelto, but are not limited to:
l 2 refer
c Tu
p y Mi 17 esda
• Countries ay, 6 bA 2.1 y,
. 6.2 Ap
• States uesd .254 54 ril 2
T .16 .6
• Counties 172 by , 202
Mi
• Provinces cha 4 fro
• Cities el D m I
eve P
• Neighborhoods rs

Rating Explanation
Perfect Pin should fall in within the boundaries/polygon of the administrative division.
Approximate N/A
Next Door N/A
Wrong Pin falls in an area that does not meet the criteria for Perfect.
Can’t Verify See Can’t Verify

Type Screenshot Explanation

Perfect – the pin can fall

anywhere within the
neighborhood boundaries
Approximate – not applicable
Neighborhood
Next Door – not applicable
Wrong – everything outside of
Perfect

Tenderloin in San Francisco

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

160
9.4.3. Streets
IP
In this chapter, rating pins for streets f ever be explained.
ro m will
s
2 4 D
Rating 2 , 20 hael ExplanationTu
l
ri Mi c e
p 72 sday
Pin, A can by fall anywhere on the street, including 1medians
Perfect a y
esd street
. 6
54 passes through completely (but not on sidewalks).
. 1 6.2 , and
Ap intersections the
u
T .16 . 2 5 4.6 ril 2,
172 by 202
Mi
Approximate N/A cha 4 fro
el D m I
Next Door N/A eve P
rs
Wrong Pin falls in an area that does not meet the criteria for Perfect.
Can’t Verify See Can’t Verify

Example Explanation
Perfect – The pin can fall anywhere on the street,
including medians and intersections the street
passes through completely, whether seen in
satellite view or on the vector map. If there is a
discrepancy between the satellite view and vector
map of the street boundaries, use the most
favorable layer. Note that sidewalks are not part of
the Perfect area.
Approximate – not applicable
Next Door – not applicable
Wrong – everything outside of Perfect, including
intersections the street does not pass through

Here, only the Jersey St. & Lafayette St.

intersection is a valid intersection for the pin to fall
on, since Jersey St. completely passes through
Jersey St. in New York City Lafayette St. The intersections where Jersey St.
meets Mulberry St. and Crosby St. are not included
because Jersey St. does not pass through these
streets.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

161
 IP
Query: [highway 92] ro m rs
0 2 4 f Deve
User and fresh viewportl 2in, 2San el
r i i chaFrancisco, CA Tu
es
p
, A 6 by
M Perfect – The pin
17 can
2.1 dayfall anywhere on the street,
a y , A part of the street. Both
esd 54
. including bridges that6.2 are
Tu .16.2 5 pril 2
result 1 and result 2 are4.Perfect
6 b , 2since the pin falls
172 on the San Mateo-Hayward M
y 02
Bridge,
ich 4 fwhich
rom is part of
the highway. ael D I
Approximate – not applicable eve P
rs
Next Door – not applicable
Wrong – everything outside of Perfect, including
intersections the street does not pass through

Rate pins falling on physical road dividers (the

middle of a road with lanes in both directions) as
Perfect, even if they fall into water, as in result 3.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

162
9.5. Parking Lots and Structures
IP
Shared parking lots are considered o mApproximate
s even though they do not belong entirely to the
4 f ever
r
feature. Assume that parking20lots 2 belongD to the feature and do not split them. When Sourdough & Co
2 , h ael Tuup to the public road to the north.
(green building) is the result,
pri y Mthe
l i approximate area (yellow) extends
c es
1
a y A
, 6b
.
72.1 day,
esd 54 6.2 Ap
Tu .16.2 54 ril 2
.6
172 by , 202
Mi
cha 4 fro
el D m I
eve P
rs

In cases where the parking structure can be verified in satellite imagery (by either parked cars orIP
Tu
parking
17 esdlot striping), consider the entire structure a parking lot. The assumption is that there fwill rom beverno
s
businessesa
2.1 y, within the structure other than parking-related businesses. 4 e
6.2 Ap 2 , 202 ael D
54 r h
.6 il 2, 2 pril Mic
by , A y
Mi 024 day 54.6
b
cha fro e s
el D m I Tu .16.2
P
eve
rs 172

163
 IP
ro m rs
0 2 4 f Deve
,2 el
r i l 2 icha Tu
p
, A 6 by
M 17 esda
a y . 2.1 y,
esd 54 6.2 Ap
Tu .16.2 54 ril 2
.6
172 by , 202
Mi
cha 4 fro
el D m I
Always consider parking lots and parking structures as belonging to the feature. There’s evenoP need
rs
split them by applying the Half n' Half rule.

In the example below, the result is a shopping mall with both a parking lot and parking structures. Pins
that fall on the building (rooftop) of the mall are Perfect. Apply the Half 'n Half rule to the street and
internal access roads, if any, to determine the area for Approximate, as parking lots and parking
structures are also Approximate.

9.6. Transit POIs

Transit POIs include, but are not limited to, POIs that are transit stops, stations, toll booths, and
terminals. A transit stop is a small, transit location typically designated by a bench or covered bench
Tua posted sign, or street markings. Transit stations, on the other hand, are typically largerostops IP
area, e r m rs
1 sd f ve
that72have
.16 aya, A major structure associated with them, which include, but are not limited to, platforms, 20 24 l De
2, e
ticketing .25offices,
p
4.6 ril 2,enclosed waiting/seating areas, or terminal buildings/structures encompassing ha the
pril Mic
transit area. The by term
Mi 24
20 “station” is primarily used to refer to transit locations thatyare, A larger
b y and
da 54are.6
typically a terminal chhousing
fro multiple routes. All stations are stops, but not all
ael m u e sstops
. 2 stations.
T .16
De IP 2
ver 17
If a transit POI does not meet s the criteria to be rated under the Single Rooftop or Campus/Complex
guidelines, please use the following criteria to rate.
164
 Rating Explanation
IP
The pin falls on fthe rom polygon
ver
s for the transit POI or in the area where you
2 4 De
Perfect would wait, 2for transit
0 el or within the entrance polygon for an
underground i ha
l 2 ictransit station Tu
r
p yM 1 es
a y A
, 6b
.
72.1 day,
6.2 forAtransit
uesThe
d pin
T 6 . 254 falls within 50 meters of where you would wait 54 pril 2 or
Approximate 72within
.1 station parking lots and surrounding property up to.6 where by , 20the
1
Half 'n' Half rule allows. Mi 24
cha fro
el D m I
Next Door Transit POIs do not have Next Door ratings. eve P
rs
The pin is wrong if it falls:
• Farther than 50 meters from the ideal location
Wrong • Within 50 meters on a non-associated rooftop
• Outside of the boundaries as allowed by the Half 'n' Half rule
• Beyond half a city block (applies to bus stops only)

Can't Verify See Can’t Verify

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

165
9.6.1. Bus, Tram, and Streetcar Stops
IP
Bus, tram and streetcar stops arefrooften, m rsbut not always, on the side of the street and have one spot
where users can wait to board 2 4 bus.
the Deve Perfect pins should be placed on the spot where a user would
0 el
wait while Approximate i 2, 2 iccan
lpins ha be placed within 50m of the waiting Tu spot and within the Half 'n' Half
r
p yM 1 es
rule. a y A
, 6b
.
72.1 day,
esd .254 6.2 Ap
POI Tu .1Screenshot
6 54 ril 2
Rating Explanation
.6
172 by , 202
M 4 f would wait for
Perfect (green area in Fig. 2) -> Whereicahauser r
the bus. el D om I
eve P
rs
Approximate (yellow area in Fig. 2) -> 50 m away from
where a user would wait for the bus but no farther out than
the Half 'n' Half rule allows and not on a building rooftop.

Wrong (everything else in Fig. 2) -> Farther than 50 meters,

or beyond half a city block from where user waits for the
Noriega Fig.1: Vector view of bus bus, or farther out than the Half’n’Half rule allows, or on a
St and stop rooftop, or in an agricultural field where a person would not
46th wait for transit.
Ave bus
stop
Can’t Verify – See Can’t Verify

Special Note: A satellite view shows that this pin might

actually fall in the street for this bus stop. Remember, favor
the map view that gives a more generous rating for the pin
these cases. In this case, the vector map is used to rate the
pin.
Fig.2: Annotated satellite
view of bus stop

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

166
9.6.2. Transit POI with Multiple Rooftops/Platforms
IP
If the POI has multiple rooftops/platforms, ro m rs apply similar ideas from the campus/complex pin
guidelines when determining the
2 Devearea for the pin to land on.
4 f valid
,2 0 el
r i l 2 icha Tu
es
p yM 1
For campuses/complexes,
a y , 6 b a polygon was created using the boundaries
A
.
72.1 daof y, Athe campus. Use the same
concept with transitd POIs 4 and create a polygon for the transit POI using6.2 the
e s
Tu .16.2
5 54 pPOI'sril multiple rooftop/
2
. 6
platforms. 172 by , 202
Mi
cha 4 fro
el m I
POI Screenshot Explanation Deve P
rs

Here is the San Jose Diridon train station, so

rate the pin according to the train station
platforms and rooftops.

Perfect -> Polygon of the station or rooftop/

platform of the station or area between
rooftops/platforms of the station (green area).
Fig. 1: Vector view of San Jose
Diridon Station Approximate -> Within transit station parking
San Jose
lots and surrounding property up to where the
Diridon
Half 'n' Half rule allows (yellow area).
Station
Wrong -> Anywhere outside of transit station
boundaries.

Can’t Verify – See Can’t Verify

Fig. 2: Annotated satellite view of Remember, if there is a polygon available in
San Jose Diridon Station vector view for the POI, rate against the
polygon.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

167
 POI Screenshot Explanation
IP
ro m rs
0 2 4 f Deve
,2 el
r i l 2 icha Tu
p
, A 6 by
M 17 esda
a y . 2.1 y,
esd 54 6.2 Ap
Tu .16.2 54 ril 2
.6
172 by , 202
Mi
Some transit stops only havecha 4afplatform
rom where
e
a user can wait for the transit. D
l I
eve P
rs
Perfect (green area in Fig. 2) -> Where a user
would wait for transit or the area between
where a user would wait for transit.

Fig. 1: Vector view of Sunnyvale Approximate (yellow area in Fig. 2) -> Within
Station 50 meters of where you would wait for transit
Sunnyvale
or within transit stop parking lots and
Station
surrounding property up to where the Half 'n'
Half rule allows.

Wrong (everything else in Fig. 2) -> Farther

than 50 meters from where user waits for
transit or farther out than the Half 'n' Half rule
allows.

Can’t Verify – See Can’t Verify

Fig. 2: Annotated satellite view of

Sunnyvale Station

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

168
 POI Screenshot Explanation
IP
ro m rs Some stations have both a building rooftop
4 f Deve
,2 0 2
el and an open platform waiting area. Both of
r i l 2 icha these areas Tare
u considered valid places for
p
, A 6 by
M 17 esda
a y . pins to fall on.
2.1 y,
esd 54 6.2 Ap
Tu .16.2 54 ril 2
.6 , 2 -> Pin falls on
172 Perfect (green area in byFig.
Mi 2) 02
4
the platform(s) where the user c ha fwould
r wait or
el D om I
the area between the platforms or
evetheP rooftop.
rs
Solana
Fig. 1: Vector view of Solana Beach Approximate (yellow area in Fig. 2) -> Pin
Beach
station falls within 50 meters of where you would wait
Amtrak for transit or within transit stop parking lots
Station and surrounding property up to where the Half
'n' Half rule allows.

Wrong (everything else in Fig. 2) -> Farther

Fig. 2: Annotated satellite view of than 50 meters from where user waits for
Solana Beach station transit or farther out than the Half 'n' Half rule
allows.

Can’t Verify – See Can’t Verify

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

169
9.6.3. Transit POIs with a Single Rooftop
IP
If the POI has a single rooftop, apply f ever single rooftop guidelines.
ro m thes
2 4 D
2 , 20 hael Tu
l c
POI pri yScreenshot
Mi 1 es Explanation
a y A
, 6b
.
72.1 day,
esd 54 6.2 Ap
Tu .16.2 54 ril 2
.6
172 by , 202
Mi
cha 4 fro
el D m I
eve P
rs

Perfect -> Rooftop of transit station or stop

Approximate -> Transit POI parking lots and

surrounding property up to where the Half 'n'
Grand Fig. 1: Vector view of Grand Central Half rule allows
Central Terminal station
Terminal Wrong -> Farther out than the Half 'n' Half
rule allows from POI property

Can’t Verify – See Can’t Verify

Fig. 2: Annotated satellite view of

Grand Central Terminal station

9.6.4. Underground Transit Stations

Some transit stations are underground. For stops that do not have polygons available on the tool map,
applyTu similar rules to the satellite campus and use your imagination to draw a polygon using the IP
m rs
entrances
17 sda to the underground station as polygon coordinates. A pin dropped within 50 meters
e f ofvthis
r o e
2.1 should
polygon y, A be rated Approximate. 20 24 l De
6.2 , a e
54 pril 2 r il 2 Mich
.6 p
by , 202 y, A .6 by to the transit
If a pin is placed Mon a4building within the polygon, the building must contain andaentrance
ich fro
stop for the pin to be aelPerfect.
m If the pin falls on any other building within the
T 6 . 254 rate it
uespolygon,
De IP .1
Approximate. ver 172
s

170
Some entrances can be seen via satellite view of the station, while other entrances can only be found
by doing more research, including using IP street imagery of the station area to find entrances or using a
station map from the transit provider m that
s
4 f ever shows entrances to the station.
ro
2 D
2 , 20 hael Tu
9.6.4.1. How to Establish l
i Entrancec
pran Mi Polygon 1 es
a y A
, 6b
.
y 72.1 day,
esd .254 6.2 Ap
1. Find at least
Tu three 6 entrances to the underground transit station, if 54 ril 2
possible.
1 .6
172
. by , 202
Mi
• Use street imagery or an official source to determine where the transit station cha 4 fentrances
r are
el D om I
located. eve P
rs
• Tip: A good place to start looking for transit entrances is near the pin's location. This will
make it easier to determine whether or not the pin falls within the polygon.

2. Connect the entrance points to create an enclosed polygon, where each entrance is a point of the
polygon.
3. Determine whether or not our pin falls within 50 meters of the polygon or within the property
covered by the Half 'n' Half rule.

If the underground transit station only has two entrances, use the following steps to create an
entrance polygon.

POI Steps Satellite Views

1. Imagine property boundaries around

the underground transit station
entrances using the Half ’n’ Half
Rule.

Note: Entrances are designated by stars

and property boundary polygons are
designated by the letters A and B.

2. Connect the closest points of the two

boundaries from step 1 to create an
entrance polygon.

Note: In this case, we have taken points

Tu 1 and 2 from polygon A and connected IP
16th m rs
17 Stesd&
them with points 3 and 4 from polygon f r o ve
2.1 ay, 24 l De
Mission6.2 Ap 2, 20 e
5 riB, respectively. Exclude building ha
BART 4.6 b l 2, 2 p ril Mic
y rooftops
Mi 024 that do not contain an entrance a y, A .6 by
Station cha fro es d 54
to theeunderground
l D m IP station from the Tu .16.2
e
entrance polygon.
ver 172
s

171
 POI Steps Satellite Views
IP
ro m rs
0 2 4 f Deve
,2 el
i l 2 icha Tu
3. Determine
p r Mwhether or not the pin falls 17 esda
a y , A 6 by 2.1 y,
.
esdwithin54 50 meters of the polygon. 6.2 Ap
54 ril 2
Tu .16.2 .6
172 by , 202
Mi
Note: For underground transit POIs that cha 4 fro
el D m I
only have one entrance, create the same eve P
polygon around the entrance as the rs
Perfect pin rating area, then measure
50 meters from that polygon for the
Approximate pin rating area.

9.6.4.2. Examples

POI Screenshot Explanation

If the underground POI already has a
polygon available, rate the pin against
the polygon.

In this case, there is a blue-colored

polygon on the map for the POI.

Perfect (green area in Fig. 2)

Polygon of transit station.
Fig. 1: Vector view of Jingu Marutamachi
Station Approximate (yellow area in Fig. 2)
Jingu Pin lands within 50 meters from the
Marutamachi polygon or on transit station parking
Station lots and surrounding property up to
where the Half'n'Half rule allows. In this
case, the station does not have a
station parking lot, so only look at the
surrounding property within 50 meters
Tu of the polygon. IP
Fig. 2: Annotated vector view of Jingu o m rs
17 esda f r ve
2.1 y, Marutamachi Station 0 24 l De
6.2 A Wrong (everything else2in , Fig.
2
ha 2)
e
54 pril 2 ril Mic rule
.6
by , 202 Farther out than theApHalf'n'Half
by
y, property.
Mi
cha 4 fro allows from station
da 4 . 6
es 5
el D m I Tu .16.2
eve P 2
Can’t Verify17– See Can’t Verify
rs

172
 POI Screenshot Explanation
IP
ro m rs
0 2 4 f Deve
,2 el
r i l 2 icha Tu
p
, A 6 by
M 17 esda
a y . 2.1 y,
esd 54 6.2 Ap
Tu .16.2 54 ril 2
.6
172 by , 202
Mi
cha 4 fro
el D m I
eve P
rs

Fig. 1: Vector view of 16th St Mission BART

station Perfect -> Pin falls within the entrance
polygon and not on a building rooftop
(unless there is an entrance to the
station within the building).

Approximate -> Pin falls within 50

meters of the entrance polygon or
within the property that Half 'n' Half
rule covers.

Wrong -> Pin falls more than 50

meters outside of the entrance polygon
16th St and or outside the Half 'n' Half rule area.
Mission St
BART Station Can’t Verify – See Can’t Verify
Fig. 2: Satellite view of 16th St Mission
BART Station showing station entrances

In this case, there are only two

entrances to the transit station (Fig. 2).
We'll use the Half 'n' Half rule to
determine the points for our entrance
polygon (Fig. 3).

Our pin falls within the entrance

IP
Tu polygon created, so it is a Perfect o m pin.
s
17 esda 4 f ever
r
2.1 y, 2 D
6.2 Ap
54 ril 2 2 , 20 hael
l c
.6
by , 202 A pri y Mi
Mi ,
ay .6 b
cha 4 fro uesd .254
m
el DAnnotated T .16
Fig. 3: I
eve P satellite view of 16th St
172
Mission BART.rs Stars represent the
entrances.
173
 POI Screenshot Explanation
IP
ro m rs
0 2 4 f Deve
,2 el
l 2 icha Tu
Perfect
17 esd-> Pin falls within the entrance
p r i M
a y , A 6 by polygon
2 a
.16 andy , not on a building rooftop
. .25 Apisrian entrance within the
esd 54 (unless there
Tu .16.2 4.6 l 2,
172 building). by 202
Mi
cha 4 fro
el D m I
Approximate -> Pin falls evwithin
P 50
ers
meters of the entrance polygon or
within the property that Half 'n' Half
Fig. 1: Vector view of Tuileries Station
rule covers.
Tuileries
Wrong -> Pin falls more than 50
Station
meters outside of the entrance
polygon or outside the Half 'n' Half rule
area.

Can’t Verify – See Can’t Verify

In this example, the pin falls within the

Half 'n' Half rule area for the entrance
polygon, so it is an Approximate pin.
Fig. 2: Annotated satellite view of Tuileries
Station. Stars represent the entrances.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

174
 POI Screenshot Explanation
IP
ro m rs
0 2 4 f Deve
,2 el
r i l 2 icha Tu
p
, A 6 by
M 17 esda
a y . 2.1 y,
esd 54 6.2 Ap
Tu .16.2 54 ril 2
.6
172 by , 202
Mi 4f
Perfect -> Pin falls chwithin
ael romentrance
polygon and not on a building
De IP rooftop
ver
(unless there is an entrance swithin the
building)

Approximate -> Pin falls within 50

meters of the entrance polygon
Fig. 1: Vector view of Jay St-MetroTech
Wrong -> Pin falls more than 50
station
meters outside of the entrance
polygon

Can’t Verify – See Can’t Verify

With underground transit stations that

Jay
have multiple entrances, you'll need to
Street-
use street imagery or an online
MetroTech
resource to find the transit entrances
then draw a polygon using the
entrances as points of the polygon.
Here, we were able to find 5 entrances
represented by the yellow stars that
Fig. 2: Annotated vector view of Jay
were near our pin (Fig. 2). These
St-MetroTech station with entrance polygon
entrances were found via street
imagery, since satellite view does not
clearly show entrances to this transit
station (Fig. 3). There is also a transit
station map available from the official
transit website that shows the
entrances to this station.

In this example, our pin is placed within

Tu the entrance polygon for this station, IP
o m rs
17 esda so we rate it as Perfect. 024 f Dev
r e
2.1 y, l
6.2 Ap 2, 2 e
54 ril 2 ha
.6 p ril Mic
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el m I Tu .16.2
Fig. 3: DSatellite
eve P view of Jay St-MetroTech 172
station rs

175
10. How to Rate Results
IP
ro m rs
This chapter shows how to rate4 af variety eve of examples.
0 2 D
,2 el
i l 2 icha Tu
For each result, you will p need
r M to answer questions about: 17 esda
a y , A 6 by 2.1 y,
. 6.2 Ap
esd 54 54 ril 2
Tu .16.2
• Relevance .6
172 by , 202
• Name accuracy Mi
cha 4 fro
• Address accuracy el D m I
• Pin accuracy eve P
rs

10.1. Specific Address

When the query is an address, and the user explicitly states their location intent by including the
name of a locality, this is an explicit location query and the user’s viewport and location are irrelevant.
The query refers to a unique location, so a result for this exact location should be rated Navigational.

Query Results Ratings and Explanation

Is there a Navigational Result for this Query? Yes

[12112 Relevance Navigational

sugarloaf key Name Accuracy n/a
st tampa fl
33626] Address Accuracy Correct

Pin Accuracy Perfect

12112 Sugarloaf Key St

12112 Sugarloaf Key St
Tampa, FL 33626
Category: n/a

This address belongs to an apartment complex,

where all buildings have the same address.

The pins falls on one of the rooftops of this

mutiple-rooftop result and is rated Perfect.
Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

176
 Query Results Ratings and Explanation
IP
ro m rs Relevance Navigational
[12112 Camden Westchase 0 2 4 f Deve Park
sugarloaf key Apartments ,2 el
r i l 2 icha Name Accuracy Tu Correct
st tampa fl 12112 p yM
, A 6Sugarloaf
b Key St 17 esda
y 2.1 y,
33626] es 25 d a
Tampa, 4 . FL 33626 Address Accuracy 6.2 ACorrect
Tu .Category: 54 pril 2
16. Apartments .6
by , 202
1 7 2 Pin Accuracy Wrong
Mi
cha 4 fro
el D m I
eve P
The result includes the name of the rbusiness,
s
which is located at this address.

The pin falls outside the boundaries of the

apartment complex.

12112 Sugarloaf Key St Relevance Navigational

12112 Sugarloaf Key St
Tampa, FL Name Accuracy n/a
Category: n/a Address Accuracy Incorrect - Postal Code
Pin Accuracy Perfect

The result is missing a postal code so Address

Accuracy is Incorrect (with Postal Code
specified as the incorrect component). Postal
code is a mandatory component for a
residential address result. The pin falls on one
of the rooftops of this multiple-rooftop POI.

Sugarloaf Key St Acceptable (User Intent

Relevance
Sugarloaf Key St, Tampa, FL Issue)
33626
Category: n/a Name Accuracy n/a
Address Accuracy Correct
Pin Accuracy Perfect

The result is a whole street result instead of a

specific address. As the user query is for a
Tu specific, full address, the information provided IP
o m rs
17 esda by the result is incomplete. The user02would
r
4 f Devbe e
2.1 y, l
6.2 Ap able to find the street, but not the 2
, exact a e
54 ril 2
.6 r il 2 M ich
by , 202 address s/he is looking for., Thep pin is dropped
Mi a y A .6 by
cha 4 fro on the street mentioned es in the
d 5 result and is
4
el D m I Perfect. Tu .16.2
eve P 172
rs

177
 Query Results Ratings and Explanation
IP
ro m rs Relevance Bad (User Intent Issue)
11244 Windsor 2 4f D Pleve
11244 Windsor ,2 0 l Cir
ePl
i l 2 icha Name Accuracy Tu n/a
Tampa, p FLM33626
r 17 esda
y , A 6 by 2.1 y,
a
54. Address Accuracy 6.2 ACorrect
[12112
uesdCategory:
. 2 n/a 54 pril 2
T
sugarloaf key 2.1 6 .6
7 Pin Accuracy by , 202
Perfect
st tampa fl1 Mi
cha 4 fro
33626] e D mI
The result does not satisfy the lqueryeve Pand is not
considered relevant. However, the addressrs and
pin placement are Correct and Perfect.
Remember, the data and relevance of the result
are considered separately. The data can be
correct even when the result’s relevance is
Bad.
[220 yonge st Is there a Navigational Result for this Query? Yes
toronto]
CF Toronto Eaton Centre Relevance Navigational
User in Toronto, 220 Yonge St
Toronto ON M5B 2H1 Name Accuracy Correct
Canada
Category: Shopping Center Address Accuracy Correct
Pin Accuracy Perfect

This query is the address of the best-known

mall in downtown Toronto. Even though many
businesses have this address as their official
address, the mall is rated Navigational due to
its prominence.

The result includes the correct address plus the

name of the mall, which is useful additional
information. The pin is dropped on the mall’s
rooftop.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

178
 Query Results Ratings and Explanation
IP
Indigo ro m rs Relevance Good
2 4 f Deve
220 Yonge 0St l
2, 2 ichae Name Accuracy
Tu Correct
[220 yonge st Toronto, r i l ON M5B 2H1 17 esda
, Ap by M 2.1 y, Correct
toronto] a y
Category:.6 Bookstore Address Accuracy6.2 Ap
u esd .254 54 ril 2
T .16 .6
172
User in Toronto, Pin Accuracy by , 202
Perfect
Mi
Canada cha 4 fro
el D m I
eve P
rs

This large, well-known bookstore is inside the

Eaton Centre and shares the 220 Yonge Street
address. It is demoted to Good because it is
less prominent than the Eaton Centre.

The name and address are Correct. Based on

the best available evidence (including interior
maps of the mall available online) the exact
position of the bookstore under the rooftop can
be found. A pin falling on the green area
(bookstore’s position) is Perfect. The rest of
the mall is Approximate.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

179
 Query Results Ratings and Explanation
IP
Moneysworthfr& omBest
ver
s Acceptable (Distance/
2 4 De Relevance
220 Yonge , 20Sthael Prominence)
2 Tu
[220 yonge st Toronto, ri ONi M5B 2H1
l c
, Ap by M 17 esda Correct
Name Accuracy
toronto] a y
Category:.6 Shoe Repair Service 2.1 y,
esd .254 6.2 Ap
u ril
Address Accuracy54.6Correct
T .16 2
172
User in Toronto,
by , 202
Mi
Canada Pin Accuracy Perfect cha 4 fro
el D m I
eve P
rs

Most people come to the mall to shop, so this

shoe repair service, also at 220 Yonge Street, is
much less prominent and a much less likely
intent than other stores in the mall. Its
relevance is demoted to Acceptable.

The store is very small and located

underground. When comparing the official map
provided by the mall with the satellite, the
store’s location can be established inside the
green area.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

180
 Query Results Ratings and Explanation
IP
Subway o m rs Relevance Bad (User Intent)
[220 yonge st r
4 f Deve
260 Yonge 2
toronto] , 2 Sthael
0
Name Accuracy Correct
Toronto,r i l 2ONicM5B 2H1, CAN Tu
, Ap by M 17 esda
y
User in Toronto, sdCategory:
a 4.6 Sandwich Shop 2.1 y, Correct
Address Accuracy
5 6.2 Ap
Canada Tue 16.2 54 ril 2
.6
172
. Pin Accuracy by , 202
Perfect
Mi
cha 4 fro
el D m I
eve P
rs

This fast-food restaurant is not located at 220

Yonge Street. The name and address in the
result are Correct and the pin placement is
Perfect.

The official venue map shows the precise

location of the restaurant, but finding the
perfect area is a little tricky. Given all evidence,
the Perfect location (green area) can be
estimated generously.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

181
 Query Results Ratings and Explanation
IP
[1141 Swiss Chalet from vers Relevance Excellent
e
Highbury 1141 Highbury , 2 024 Ave
elD
l 2 icN5Yh a Tu
Ave, London, London, pri yON 1A5 CAN 17 esda Correct
A M Name Accuracy
Ontario] a y ,
.6 b 2.1 y,
6.2 Ap
u esd .254 54 ril 2
T .16 Address Accuracy .6Correct
172
User in London, by , 202
Mi
Canada cha 4 fro
Pin Accuracy el D m I
Approximate
eve P
rs
All four of these businesses:

1. Swiss Chalet
2. Wings Kitchen
3. Fast Photo
4. Globally Local

share the 1141 Highbury Ave address and are of

similar prominence. They are all equally likely to
be the intent of a user with this query. This
means that all results can be rated Excellent.

Compare this example to the Eaton Centre

example, above, where there is a single most
prominent POI at the address that is the
dominant user intent.

In the diagram at left, the pin is in the parking

lot and would be rated Approximate for any of
the results.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

182
Address queries can also be just the name of a street, neighborhood, intersection, or city. Results for
streets, neighborhoods, intersection,IPand city queries are eligible for Navigational.
m s
4 fro ever
The expectation is that we ,return
2 202 aethel D requested entity with the same level of broadness that the user
requested, which may pnot l h Tu
ri include
Mi
c all of the elements of a full address.
1 es
a y A
, 6b
.
y 72.1 day,
d 4 6.2 Ap
ues 6.25 54 ril 2
Query T .1 Results Ratings .6& Explanation
by , 202
172 Mi 4
Is there a Navigational Result for this Query? Yes chae from
l D IP
e
Relevance Navigationalvers
Name Accuracy n/a
Address Accuracy Correct
Pin Accuracy Perfect

Stevens Creek Blvd

Stevens Creek Blvd
[stevens Cupertino, CA
creek blvd
Category: n/a
cupertino]

The query is for a street in Cupertino, CA. The

postal code is optional for such results, but if
the postal code is returned, any portion of the
street has to belong to that postal code area.
The pin appears to fall outside the street
boundaries in the vector view. However, in
satellite it is still within the boundaries.
Whenever there is a discrepancy the most
favorable layer should be used to determine
pin accuracy.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

183
 Query Results Ratings & Explanation
IP
ro m rs Relevance Bad (User Intent)
0 2 4 f Deve
,2 el
r i l 2 icha Name Accuracy
Tu n/a
Cupertino,
, A 6 by CA
p M 17 esda
y 2.1 y,
a . Address Accuracy
6.2 ACorrect
esdCupertino,
54 CA 54 pril 2
Tu .16.2 .6
Category: n/a Pin Accuracy by , 202
Perfect
172 Mi
cha 4 fro
el D m I
eve P
rs

This result for an entire city does not satisfy

user intent when the query was for a street in
that city. Pin is dropped within the boundaries
of the city of Cupertino and is rated Perfect.

[stevens
creek blvd
cupertino] Relevance Bad (User Intent)
Name Accuracy n/a
Address Accuracy Correct
Pin Accuracy Perfect

19062 Stevens Creek Blvd

19062 Stevens Creek Blvd
Cupertino, CA, 95014
Category: n/a

The result includes a street number when the

query is just for a street, making this result too
specific for the requested query. The pin is
dropped on the result address.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

184
 Query Results Ratings & Explanation
IP
ro m rs Relevance Bad (User Intent)
f eve
4 Hot
Happy Lamb 0 2
el D Pot
,2
l 2 icha Creek Blvd
19062riStevens Name Accuracy Tu Correct
p
Cupertino,
M
, A 6 by CA, 95014 17 esda
y 2.1 y,
a . Address Accuracy 6.2 ACorrect
esd .254 54 pril 2
Tu .Category:
16 Chinese .6
1 7 2 Pin Accuracy by , 202
Perfect
Mi
cha 4 fro
el D m I
eve P
rs
The result is for a business on the street. When
the query is for an entire street, returning a
business is too specific a result for the
requested query.

[stevens
creek blvd
cupertino]
Stevens Creek and De Anza Relevance Bad (User Intent)
Blvd. Stop
Cupertino CA 95014
Name Accuracy Correct
Category: Bus Stop
Address Accuracy Correct

Pin Accuracy Perfect

The result is for a bus stop on the street. This

random result does not satisfy the user's intent
and lacks prominence compared to the very
long street.
[upper east Is there a Navigational Result for this Query? Yes
side]
Relevance Navigational
Name Accuracy n/a
Upper East Side
Upper East Side Address Accuracy Correct
New York, NY 10021
Pin Accuracy Perfect
Category: n/a

The result is the requested neighborhood IP

Tu o mandrs
17 esda therefore is rated n/a for Name Accuracy. r
f eve
2.1 y,
20 24 l DThe
6.2 Ap postal code is correct and belongs 2, to ae
hthe
54 ril 2 i l i c
.6
by , 202 pr y M pin can
requested neighborhood. A, APerfect
Mi
cha 4 fro drop anywhere within ethe
s a y .6 b
d boundaries
54 of the
el D m I u 6.2
neighborhood. T .1
eve P 172
rs

185
 Query Results Ratings & Explanation
IP
ro m rs Relevance Good (User Intent)
0 2 4 f Deve
,2 el
r i l 2 icha Name Accuracy
Tu Incorrect (Category
p
, A 6 by
M 17 esda Issue)
a y . 2.1 y,
esd 54 6.2 Ap
ril
Tu .16.2 Address Accuracy54.6Correct 2
172 Metropolitan Museum of Art by , 202
Mi
Pin Accuracy Perfect cha 4 fro
1000 5th Ave el D m I
P
New York, NY 10028 Research shows the MetropolitanevMuseum, ers
Category: Art Gallerry one of the most famous museums in the world,
is located on the Upper East Side. Its
extremely high international prominence
qualifies it for a Good rating due to secondary
intent for this query.

The Name Accuracy rating for this result is

Incorrect due to the misspelling of the
category.

Relevance Bad (User Intent)

Boqueria Upper East Side Name Accuracy Correct

1460 2nd Ave
New York, NY 10075 Address Accuracy Correct
Category: Spanish
Pin Accuracy Perfect

Tu The result is for a business within the queried IP

m rs
17 esda neighborhood. Even though the business f r o ve
2.1 y, 0 24 l De
6.2 Ap name contains the query terms, 2this , result
2 a e
54 ril 2
.6 does not satisfy user Intent,Aand
l ich
pri yisMnot
by , 202 y, .6 b to be
Mi
cha 4 fro internationally prominent daenough
e s 54
2query.
el D m I considered relevantTfor
u the
.1 6 .
eve P 172
rs

186
 Query Results Ratings & Explanation
IP
ro m rs Relevance Bad (User Intent)
0 2 4 f Deve
,2 el
r i l 2 icha Name Accuracy
Tu n/a
p
, A 6 by
M 17 esda
a y . 2.1 y,
esd 54 6.2 ACorrect
Address Accuracy
Tu .16.2 54 pril 2
.6
172 1596 2nd Ave by , 202
Mi
Pin Accuracy cha 4 fro
Perfect
1596 2nd Ave el D m I
New York, NY 10028 eve P
rs
Category: n/a

The result is for a specific address within the

neighborhood. This result is too specific for
the broader query. The address is not
internationally prominent enough to satisfy the
intent for the query.

Is there a Navigational Result for this Query? Yes

Relevance Navigational
Name Accuracy n/a
[Cork]
Address Accuracy Correct

Cork Pin Accuracy Perfect

Cork, Ireland
Category: n/a

The result is for the city of Cork in Ireland. A

perfect pin can drop anywhere within the city
boundaries.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

187
 Query Results Ratings & Explanation
IP
ro m rs Relevance Good (User Intent)
0 2 4 f Deve
,2 el
r i l 2 icha Name Accuracy
Tu Correct
p yM
, A Airport
b 17 esda
Cork
y 2.1 y,
s d 54.6
a Address Accuracy
6.2 ACorrect
e
Tu .Kinsale2 Rd 54 pril 2
16. .6
by , 202
2
1 Cork, Ireland
7 Pin Accuracy Perfect
Mi
cha 4 fro
Category: Airport el D m I
eve P
rs

The result is for a transit POI, which satisfies a

secondary query intent. The address and pin
are correct.

Relevance Bad (User Intent)

Name Accuracy Correct
Address Accuracy Correct
Pin Accuracy Perfect

Cork City Library

57-61 Grand Parade
Cork, Ireland
Category: Library

The result is for a POI within the city. This does

not satisfy secondary intent for the query as it
is neither internationally prominent nor a
transit POI.
Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

188
 Query Results Ratings & Explanation
IP
[Stevens Is there a Navigational m s
4 fro ever Result for this Query? Yes
Creek and 0 2 D
,2 el
De Anza] r i l 2 icha Relevance Tu
esd
Navigational
A p yM 1 7
, b 2.1 ay,
s day 54.6 Name Accuracy 6.2 An/a
e
Tu .16.2 54 pril 2
.6
172 by , 202
Address Accuracy Correct Mi
cha 4 fro
el D m I
Pin Accuracy Perfect eve P
rs
Stevens Creek and De Anza
Blvd
Stevens Creek and De Anza Blvd
Cupertino CA 95014
Category: n/a

The query is for an intersection and the

specific intersection is returned.

Good/Acceptable (User
Relevance
Intent)
Stevens Creek and De Anza
Blvd. Stop Name Accuracy Correct
Cupertino CA 95014 Address Accuracy Correct
Category: Bus Stop
Pin Accuracy Perfect

The query is for an intersection and a bus IP

Tu o mstops
17 esda f ever
r
2.1 y, with the same name is returned. In 0some 4
2 lD
6.2 Ap
54 ril 2 countries, bus stops carry the same 2 , 2 nameha
e
as
i l i c
.6
by , 202 the intersection where they A pr located
are y M and
Mi ay, 4.6forb
cha 4 fro can satisfy a secondary e s
u 6.2
dintent
5 the query.
el D m I The pin falls where aT user. 1 would wait for the
eve P 1 72
rs bus.

189
 Query Results Ratings & Explanation
IP
ro m rs Relevance Bad (User Intent)
0 2 4 f Deve
,2 el
r i l 2 icha Name Accuracy
Tu n/a
p
, A 6 by
M 17 esda
y 2.1 y,
a . Address Accuracy
6.2 ACorrect
esd 54 54 pril 2
Tu .16.2 .6
172 Pin Accuracy by , 202
Perfect
Mi
cha 4 fro
el D m I
eve P
Stevens Creek Blvd rs
Stevens Creek Blvd
Cupertino CA 95014
Category: n/a

The query is for an intersection and we return

just one of the streets from the query. This
does not satisfy user intent.

[95051]
Is there a Navigational Result for this Query? Yes

95051 Relevance Navigational

Santa Clara, CA, 95051 Name Accuracy n/a
Category: n/a
Address Accuracy Correct

Pin Accuracy Perfect

The expectation for this result is to include
Tu locality, state and postal code. Other IP
o m rs
17 esda components are optional, but if present r
f eve
2.1 y, 24 lthey
6.2 Ap need to be correct. 2 , 20
a e D
54 ril 2 l c h
.6
by , 202 A pri y Mi
Mi ,
ay 4boundaries
6 b
cha 4 fro The pin must drop withinesd the 5 . of the
el D m I u . 2
locality presented in the
T .1result.
6
eve P 172
rs

190
10.2. Non-Specific Address
IP
For queries where the location intent ro m isrnot
s explicitly stated in the query, you must infer the location
4 f eve
intent from the user’s viewport 2 andDthe user’s location. One difficulty in evaluating address queries
2 , 20 hael Tu
has to do with partial addresses,
pri y Mi which could refer to multiple locations.
l c es
1
Generally, for partial
a y A
,addresses,
. 6 b 72.1 day, to their position or within/
users are looking for the location closest
d 4 6.2 Ap
ues 6.25 Some general considerations:
near the freshTviewport. 54 ril 2
.6
.1 ,2
• Exact location
172 that exists returned very close to the user is eligible for byNavigational,
Mi 024 unless
other addresses that satisfy the user intent are also very close. c f
ha rom
el D I
• Exact location returned within a fresh viewport is eligible for Navigational, unless eve other
P
addresses that satisfy the user intent are also very close. r s
• Results that are farther away from an ideal result but can potentially satisfy the user’s intent
can be rated as high as Good (Distance/Prominence)
• Results are demoted based on distance.
• Results are demoted based on the density of potential results in a given area
• Results that are too far away will be rated Bad (Distance/Prominence)
Consider the query [154 orchard st] in different scenarios:

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

191
Scenario 1: Fresh viewport over Midtown Manhattan in New York City.
IP
ro m rs
0 2 4 f Deve
l
Queryl 2, 2 chae User
Tuand Viewport
r i i
p M 17 esover
y , A 6 by 2.1 day, Midtown Manhattan in
User and fresh viewport
[154 orchard st]es d a 4 . 6.2 Ap
Tu .16.2
5 New York City 54 ril 2
.6
72 query does not specify in which locality the address is expected. by , 202
User Intent: 1The Mi 4Use the
c fro
location intent given by the user and viewport to rate the results. h ael m
De IP
ver
Is there a Navigational Result for this Query? Yes s

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

192
 Results Ratings and Explanation
IP
m rs
① 154 Orchard St 2
ro
4 f Deve
Relevance Navigational
0
, 2 h10002el
154 Orchard St, New York, l 2 NY
r i i c a Name Accuracy Tu n/a
Category: n/a p
, A 6 by
M 17 esda
y 2.1 y,
a . Address Accuracy 6Correct
.25 Apri
esd 54
Tu .16.2 4.6 l 2,
172 Pin Accuracy Perfectby 202
Mi
cha 4 fro
el D m I
eve P
rs

The result is in Lower Manhattan, very close to the user

location.

② 154 Orchard St Relevance Good (Distance/Prominence)

154 Orchard St, Newark, NJ 07102
Category: n/a Name Accuracy n/a
Address Accuracy Correct
Pin Accuracy Perfect

The result is farther away from the viewport, but still

matches the query.
Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

193
 Results Ratings and Explanation
IP
m rs
③ 154 Orchard St 2
ro
4 f Deve Relevance Good (Distance/Prominence)
0
, 2 07026 el
154 Orchard St, Garfield,l 2NJ
r i i cha Tu
Category: n/a p M Name Accuracy 17 en/a
s
a y , A 6 by
. 2.1 day,
esd 54 6.2 Ap
Tu .16.2 Address Accuracy 54 ril 2
Correct
.6
172 by , 202
M 4
Pin Accuracy Perfect icha from
el D I
eve P
rs

The result is farther away from the viewport, but still

matches the query.

④ 154 Orchard Dr Relevance Bad (Distance/Prominence)

154 Orchard Dr, Levittown, Pennsylvania
19054 Name Accuracy n/a
Category: n/a
Address Accuracy Correct

Pin Accuracy Wrong

The result is in a different state and very far away from

the user’s viewport. The street type does also not
match the query.

The pin lands on the house with the street number 114,
which can be verified via street imagery. Since this is
several houses down from the intended address, it is
incorrect.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

194
Scenario 2: Viewport/user’s locationIPis in Maine. There is no address in the vicinity that contains
[154 Orchard St]. All locations fwith rom vthis
ers address are far from the location intent of the query.
2 4 De
2 , 20 hael Tu
l c
Query pri y Mi User esd Viewport
2.1and
A
, 6b 1 7 ay
a y
d 54 . 6.2 , Ap
e s
[154 orchard Tust] 1 6.2 User and viewport in Maine54.6 ril 2
172
. by , 202
Mi 4the
User Intent: Since there is no matching result close to the location intent given chby f user and
ael rom
viewport, the closest address is rated without demotion for user intent or distance/prominence. De IP
ver
s
Is there a Navigational Result for this Query? No

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

195
 Results Ratings and Explanation
IP
m rs Relevance Excellent
① 154 Orchard St 2
ro
4 f Deve
0
, 2 h10002el
154 Orchard St, New York, l 2 NY
r i i c a Name Accuracy Tu n/a
Category: n/a p
, A 6 by
M 17 esda
y 2.1 y,
a . Address Accuracy 6Correct
.25 Apri
esd 54
Tu .16.2 4.6 l 2,
172 Pin Accuracy Perfectby 202
Mi
cha 4 fro
el D m I
eve P
rs

This location is among the closest possible results to

the viewport/user’s location.

② 154 Orchard St Relevance Excellent

154 Orchard St, Newark, NJ 07102
Name Accuracy n/a
Category: n/a
Address Accuracy Correct
Pin Accuracy Perfect

This location is among the closest possible results to

the viewport/user’s location.

③ 154 Orchard St Relevance Excellent

154 Orchard St, Garfield, NJ 07026
Name Accuracy n/a
Category: n/a
Address Accuracy Correct
Pin Accuracy Perfect

Tu IP
o m rs
17 esda f r ve
2.1 y, 0 24 l De
6.2 Ap This location is among the closest possible 2, results
2
ha to
e
54 ril 2 ril Mic
.6
by , 202 the viewport/user’s location. p
Mi a y, A .6 by
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

196
 Results Ratings and Explanation
IP
m rs
④ 154 Orchard Dr 2
ro
4 f Deve Relevance Bad (User Intent)
0
, 2 hael
154 Orchard Dr, Levittown, l 2 Pennsylvania Tu
c Name Accuracy 17 en/a
i
p y Mi
r
19054 s
A
y, 6 b 2.1 day,
Category: n/a uesda .254. Address Accuracy .25 Apri
6Correct
T .16 4.6 l 2,
2
172 Pin Accuracy
b
Wrongy Mi 024 f
cha ro
el D m I
This location is farther from the viewport/usereve Plocation
than the result in New York and therefore demoted rs for
distance. The user is also looking for a Street, but has
been presented with a Drive.

The pin lands on the house with the street number 114
which can be verified via street imagery. Since this is
several houses down from the intended address, it is
Wrong.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

197
Here is another example of an address query with implicit location intent. Although this is a common
address in US cities, it overwhelmingly IP refers to the location of the White House and should be
considered the primary intent offthe rom query
s
ver unless an additional location modifier is provided (i.e.
4
2 lD e
state, city, or postal code) or , 20a hdifferent
e 1600 Pennsylvania Ave that’s not the White House is already
in or very near the location r i l 2 c a
intent.
i Tu
es
p yM 1
a y A
, 6b
.
72.1 day,
esd .254 6.2 Ap
Scenario 1: Fresh
Tu .1viewport
6 on Los Angeles, CA (not near Richmond, CA): 54 ril 2
.6
172 by , 202
Mi
cha 4 fro
Query Results Ratings and Explanation
el D m I
eve P
Is there a Navigational Result for this Query? Yes rs

The White House Relevance Navigational

1600 Pennsylvania Ave,
Washington, DC, 20500 United Name Accuracy Correct
States Address Accuracy Correct
Category: Landmark
Pin Accuracy Perfect

The POI associated with this address is

[1600 overwhelmingly prominent and this is the
pennsylvania most likely intent.
ave]

Fresh viewport
on Los Angeles,
1600 Pennsylvania Ave Acceptable/Bad
CA (not near Relevance
1600 Pennsylvania Ave, (Distance/Prominence)
Richmond, CA)
Richmond, CA 94801
Name Accuracy n/a
Category: n/a
Address Accuracy Correct
Pin Accuracy Perfect

Technically a match, but considering the

user’s viewport it is less likely that the user is
looking for this location.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

198
Scenario 2: The fresh viewport is in San Francisco, CA (near Richmond, CA). The proximity of the
user viewport to the Richmond location IP makes this location just as relevant as the prominent location
in Washington DC. ro m rs
0 2 4 f Deve
Query , 2 ael
r i l 2 ichResults Ratings
Tu
e
& Explanation
p
A by M 17 s d
d Isy, there
a 4 . 6 a Navigational Result for this Query?2.16 ay, ANo
es .25 .25 pri
Tu .1The 6 White House
Relevance
4.6 l 2,
Excellent
1 7 2 by 202
Mi
1600 Pennsylvania Ave, cha 4 fro
Washington, DC, 20500 Name Accuracy Correct el D m I
eve P
Category: Landmark Address Accuracy Correct rs

Pin Accuracy Perfect

[1600 Both results are equally valid, so neither can

pennsylvania get Navigational and should instead be rated
ave] Excellent.

Fresh viewport
on San 1600 Pennsylvania Ave Relevance Excellent
Francisco, CA
1600 Pennsylvania Ave,
(near Richmond, Name Accuracy n/a
CA)
Richmond, CA 94801
Category: n/a Address Accuracy Correct
Pin Accuracy Perfect

Both results are equally valid, so neither can

get Navigational and should instead be rated
Excellent.

10.3. Query Address Does Not Exist

To be useful to the user, address results need to point to either a building with that address or a plot
of land that has been officially assigned the address. Sometimes your research will show that a full
query address does not exist (or no major search engine will be able to determine its exact location).
In cases like this, you will see one of three types of results:
• The closest verified address (on the same street and in the same city and state): Rate
Tu relevance as Excellent. IP
e r o m rs
17 sda f eve
•2.1 The same address as the query address: Rate relevance as Excellent and address 24 las
6.2
y, A
p , 20
a e D
Incorrect
54 r – Address does not exist. The pin will be rated Can’t Verify. l 2 c h
. il 2, 2 pri y Mi
• The 6queriedby 0
Mi 24 street without a street number: Rate relevance as Acceptable.
y, A b
cha fro u e sda 254.6
el D m I T .16.
When a queried address does
P not exist, the answer to the question “Is there a navigational result for
ev 172
this query” will always be eNo. rs

199
 Query Results Ratings and Explanation
IP
[2001 Duncan Is there a Navigational m s Result for this Query? No
4 fro ever
St, San 0 2 D
,2 el
Francisco] l 2 icha St
1099riDuncan Relevance Tu
esd
Excellent
1099
A p Duncan
y M St., San 1 7 a
ay, 4.6 b
dFrancisco,
2
Name Accuracy.16.2 y, An/a
e s 5 94131, CA 54 pril 2
Tu .16.2 .6
172 Category: n/a Address Accuracy by , 202
Correct
Mi
cha 4 fro
Pin Accuracy Perfect el D m IP
eve
rs
If 2001 does not actually exist then selecting
1099, the closest address on the same street in
the same city and state that does exist, is
considered correct.
For a locale that uses the rule of even numbers
on one side of the street and the odd numbers
on the other, we need to return the closest
existing address on the same side of the street
as the query. If the rule of odds and evens does
not apply then the closest numeric number will
be considered correct.
The pin has to be correctly dropped on the
address presented in the result to be rated
Perfect.

2001 Duncan St Relevance Excellent

2001 Duncan St., San Name Accuracy n/a
Francisco, 94131, CA
Category: n/a Incorrect – Address
Address Accuracy
does not exist
Pin Accuracy Can’t Verify
Duncan Street only goes up to number 1099,
but the query requests a non-existent number.
The result returned is the same as the queried
address and should be rated as Excellent.
The pin rating for addresses that do not exist is
Can’t Verify.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

200
 Query Results Ratings and Explanation
IP
Duncan St from vers Relevance Acceptable (User Intent)
4 De
02San
Duncan St, 2 lFrancisco,
2 ichae
, Name Accuracy Tu n/a
94131, p r i l CA
M 17 esda
y , A 6 by 2.1 y,
Category:
a . n/a Address Accuracy 6.2 ACorrect
uesd .254 54 pril 2
T .16 .6
172 Pin Accuracy by , 202
Perfect
Mi
cha 4 fro
m
el Dwith
The result returns only the street eve Pa pin
I
dropped within the boundaries of thersstreet.
This result technically satisfies the user intent,
but this intent is unlikely, so relevance should
be rated Acceptable.

10.4. Point of Interest

A correct location result should be rated Navigational for queries referring to a point of interest.
Consider the query [mount rushmore], the famous US monument. Although the query terms do not
contain an explicit location, the Mount Rushmore monument is so prominent and unambiguous that
its location should be considered the primary location intent. The user viewport and user location are
irrelevant for this query because the user is looking for the place of interest no matter where they
currently are.

Query Results Ratings and Explanation

Is there a Navigational Result for this Query? Yes
[mount
rushmore] Relevance Navigational
Name Accuracy Correct
Address Accuracy Correct
Mount Rushmore National Pin Accuracy Perfect
Memorial
13000 S Dakota 244, Keystone,
SD, United States
Category: Landmark

The pin can drop anywhere within the

Tu IP
boundaries of the park to be rated Perfect. o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

201
 Query Results Ratings and Explanation
IP
Mount Rushmore o m KOAs at
4 f ever
r
Relevance Bad (User Intent)
Palmer Gulch 2 D
2 , 20 hael Tu
12620 ri Highway
l i c 244 17 esda Correct
Ap by M Name Accuracy
aHill City,
y ,
.6 SD 57745 2.1 y,
6.2 Ap
esd .254 r
54 Correct
T .1Category:
u 6 Campground Address Accuracy .6 il 2, 2
172 by
Mi 024
Pin Accuracy Perfect
cha fro
el D m I
eve P
rs

This result is a campground within the park

and is not the park the user asked for.

Mount Rushmore Gift Shop

Relevance Bad (User Intent)
13000 SD-244, Keystone, SD
57751
Name Accuracy Correct
Category: Gift Shop
Address Accuracy Correct
Pin Accuracy Perfect
This result is a gift shop inside Mount
Rushmore National Park and is not the park
the user asked for. Both the Name and
Address Accuracy are verified and rated
Correct. The pin falls on the shop and is
Perfect.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

202
 Query Results Ratings and Explanation
IP
Is there a Navigational m s Result for this Query? Yes
4 fro ever
0 2 l D
Route i 2, 2 ichae
l66 Relevance Tu Navigational
r
p y MAZ 86337 1 esd
Seligman,
A
y, .6 b 72.1 ay,
s daUnited
4 States Name Accuracy 6.2 An/a
e
Tu .16.2
5 54 pril 2
.6
172 Category: n/a Address Accuracy Correct by , 202
Mi
cha 4 fro
Pin Accuracy Perfectel D m IP
eve
rs
This result represents Route 66 and is rated
Navigational regardless of user location,
viewport, or the locality in the address. The
pin can be dropped anywhere along the route.

Route 66 Indian buffet all 7 Relevance Bad (User Intent)

[route 66] days
Fresh viewport 397 Las Colinas Blvd, Partially Correct (Name
Name Accuracy
on Amarillo, TX Irving, TX 75039 Issue)
Category: Indian Incorrect - Unit/Apt,
Address Accuracy
Street Name
Pin Accuracy Perfect
The result is a randomly chosen business far
from the user whose name includes the query
terms. The result name differs from the
official name variations used on the website:
“Route 66 Fine Indian and American
Cuisines” or “Route 66 Indian Cuisine”.
However, the name is still recognizable and is
rated Partially Correct. The address on the
official website is “397 East Las Colinas Blvd”
whereas the result address excludes “East”.
Also, the official site lists a unit number, 180,
which is missing from the address in the
result.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

203
 Query Results Ratings and Explanation
IP
Is there a Navigational m s Result for this Query? Yes
4 fro ever
0 2 D
Machu , 2 hael Relevance Tu Navigational
i l 2Picchuc
Aguas
A
r
y Mi
p Calientes, Peru 1 7
esd
, b 2.1 ay,
s day 54.6 Name Accuracy 6.2 ACorrect
e
Tu .16.2 54 pril 2
.6
172 Address Accuracy Correctby , 202
Mi
cha 4 fro
Pin Accuracy Perfectel D m IP
eve
rs

The result is an internationally known historical

site and the most relevant result, making it the
primary user intent.
[Machu
Picchu]

Fresh viewport
over Relevance Good (User Intent)
Massachusetts,
some distance Machu Picchu Restaurant Name Accuracy Correct
away from 307 Somerville Ave, Somerville, MA
Somerville, MA
Address Accuracy Correct
02143
Pin Accuracy Perfect

Since the result is reasonably close to the

fresh user viewport, it will be considered
secondary intent for this query.

Tu IP
10.5.Understanding
e Multiple Query Interpretations Beyond Viewport and User Location r o m rs
17 sda f ve
2.1 y,
20 24 l De
6.2 A , a e
54 pril 2 r il 2 Mich
.6 p
Many address/POI by , 20queries have multiple interpretations. Understanding whichayinterpretation
, A 6 by is most
Mi 24 d 4 .
likely often requires c haextra
f r research in addition to considering the viewport and
e s user’s location. It is
5
el D om I Tu .16.2
critical to fully understand eve the
P query through research rather than guessing.
17 2
rs

204
 Query Results Ratings and Explanation
IP
Is there a Navigational m s Result for this Query? Yes
4 fro ever
0 2 D
New rYork , 2 hael
i l 2 Cityic Relevance Tu
esd
Navigational
New A pYork y MCity, NY, US 1 7
, b 2.1 ay,
s day 54.6 Name Accuracy 6.2 An/a
Tu .1Category:
e
6.2 n/a 54 pril 2
.6
172 Address Accuracy Correctby , 202
Mi
cha 4 fro
Pin Accuracy Perfectel D m IP
eve
rs

This is a very prominent result that satisfies

the user intent.

Relevance Good (User Intent)

New York State
New York, US Name Accuracy n/a
Category: n/a Address Accuracy Correct
[new york] Pin Accuracy Perfect

User and
viewport This result refers to the state of New York and
somewhere in satisfies a secondary intent of the query.
France

Avenue de New York Relevance Good (User Intent)

Avenue de New York, Paris,
France Name Accuracy n/a
Category: n/a Address Accuracy Correct
Pin Accuracy Perfect

The result is within the fresh viewport, but is

not a very prominent street. Although this IP
Tu o m isrs
17 esda still a possible interpretation, it is not r
24 alperfect
f eve
2.1 y,
6.2 Ap match to the query and is overshadowed
2 , 20
a e D by
54 ril 2 l c h
.6
by , 202 the prominence of New York A priCity.
y Mi
Mi ,
ay .6 b
cha 4 fro uesd .254
el D m I T .16
eve P 172
rs

205
 Query Results Ratings and Explanation
IP
Is there a Navigational m s Result for this Query? Yes
4 fro ever
0 2 D
Amsterdam , 2 ael
r i l 2 ichCafe Relevance Tu
esd
Navigational
481A pAmsterdam
y M Ave 1 7
y, .6 b 2.1 ay,
s daNew 4 York, NY 10024 Name Accuracy 6.2 ACorrect
e
Tu .16.2
5 54 pril 2
.6
172 Category: Cafe Address Accuracy Correctby , 202
Mi
[amsterdam cha 4 fro
cafe] Pin Accuracy Perfectel D m IP
eve
rs
User and fresh
viewport in New The user and fresh viewport are close to New
York, NY York, NY this cafe is an exact match, and can
therefore be considered the main intent.

The pin lands on the edge of the building, so

by applying the tennis rule the pin will be
rated as Perfect.

Is there a Navigational Result for this Query? No

Café de Jaren Relevance Excellent
Nieuwe Doelenstraat 20-22, 1012
CP Amsterdam, Netherlands Name Accuracy Correct
[amsterdam
cafe] Category: Café Address Accuracy Correct

User and Pin Accuracy Perfect

viewport
somewhere in
Europe The user and viewport are in Europe, so cafes
in the city of Amsterdam are the expected
results.

Is there a Navigational Result for this Query? No

Relevance Excellent
Café de Jaren
Nieuwe Doelenstraat 20-22, 1012 Name Accuracy Correct
CP Amsterdam, Netherlands
Address Accuracy Correct
Category: Café
[amsterdam Pin Accuracy Perfect IP
Tucafe] o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap , e
User and54 fresh
r
.6 il 2, 2 l 2 icha
viewport in
The user and viewport areAin pria rural
M area and
by
Mi 024 y , 6 by
Maine, US there is no relevant result
d in
a .the area, so the
cha fro
el D m I strongest matchesTareues cafes
6 . 254 in the city of
.1
eve P Amsterdam. 172
rs

206
 Query Results Ratings and Explanation
IP
Is there a Navigational m s Result for this Query? Yes
4 fro ever
0 2 D
,2 el
r i l 2 icha Relevance Tu
esd
Navigational
A p yM 1 7
, b 2.1 ay,
s day 54.6 Name Accuracy 6.2 An/a
e
Tu .16.2 54 pril 2
.6
172 Address Accuracy Correct by , 202
Mi
cha 4 fro
Europe Pin Accuracy Perfectel D m IP
eve
Europe The query is clearly for the European
rs
[europe]
Category: n/a continent, so returning the continent should
User and be rated Navigational. If the name of a local
viewport business exactly matches the query with no
somewhere in extra words then that business may be a
US reasonable interpretation of the query and
should be rated based on distance from the
user or viewport. All other businesses are
Bad.

Is there a Navigational Result for this Query? Yes

Relevance Navigational
Name Accuracy n/a
Address Accuracy Correct
Pin Accuracy Perfect
Paris
Paris, France
Category: n/a

The query [paris] can mean either the capital

of France or one of the more than 10 towns
across the USA with the same name. Because
[paris] of the small population and lack of tourism in
these small towns, the city in France should IP
Tu be rated Navigational unless the query’s o m rs
User
17 esand
d fresh r
f eve
.16 ay, A location intent is within or very close 24 tol D
e one of
2viewport 0
.25 pri 2 , 2 a
somewhere4.6 inl 2, these small US cities. l c h
by 202 A pri y Mi
San Francisco, Mi ,
ay .6 b
CA cha 4 fro uesd .254
el D m T .16
I
eve P 172
rs

207
 Query Results Ratings and Explanation
IP
Paris ro m rs Acceptable/Bad (User
2 4 f Deve Relevance
Texas, USA ,2 0 el intent)
i l 2 icha Tu
Category:
p r Mn/a 17 esda n/a
y , A 6 by Name Accuracy
2.1 y,
a . 6.2 Ap
esd 54 r
Tu .16.2 Address Accuracy 54 Correct
.6 il 2, 2
172 by
Mi 024
Pin Accuracy Perfect
cha fro
el D m I
eve P
rs

This result is unlikely to satisfy the user intent.

Is there a Navigational Result for this Query? No

Relevance Excellent

Brandy Ho's Hunan Food Name Accuracy Correct

217 Columbus Ave, San Address Accuracy Correct
[hunan] Francisco, CA 94133
Category: Hunan Pin Accuracy Perfect
User and fresh
viewport The query [hunan] represents both the
somewhere in seventh most populous province in China and
San Francisco, a popular type of cuisine. In this case, both
CA user location and viewport are in the San
Francisco Bay area. An online maps search
done by a user in this area shows that the
dominant intent of this query is for the
cuisine. The province is a less likely, but still
viable, intent that can be rated Acceptable.

10.6. Business Queries

Before you rate a business query, consider:

• Multiple interpretations: Are there ways to interpret the query terms other than as a
business name? French Laundry is both a famous restaurant in Napa and a type of
laundromat/cleaner.
• Number of locations: How many locations of this business exist? If there are many of them
Tu (like Starbucks) then the user expects to find locations in or very close to the their location o
IP
m rs
17 intent.
e s f r ve
2.1 day, 0 24 l De
• 6Population
A
.25 pri density: Is the area of the business results urban, suburban, or rural?2, City
2
ha
e
4.6 l are
dwellers ril Mic
2, less willing to travel longer distances than suburban and ruralAusers.
p
by 202 y, .6 by
Mi 4 da
cha fro es 54
el D m I Tu .16.2
eve P 172
rs

208
 IP
10.6.1. Non-Chain Businessesfrom ers
v
2 0 24 l De
Some businesses have only e
il 2 Mone
, a location, so treat and rate them as
Tu navigational queries. The correct
r ich es
location should be rated
, A 6 Navigational
p
by and any other results should
17 receive
2.1 day, Bad (User Intent).
a y . 6.2 Ap
esd 54 54 ril 2
Tu .16.2 .6 ,2
Query 172 Results Ratings and by Explanation
Mi 024
ch fro
Is there a Navigational Result for this Query? Yes ael D m IP
eve
r
Klein High School Relevance Navigationals
16715 Stuebner Airline Rd
Spring, TX 77379 Name Accuracy Correct
Category: High School Address Accuracy Correct
Pin Accuracy Perfect

This is a perfect result for the query. While

the city on the official website is ‘Klein’,
because USPS validates the full address, as
[klein high returned, in the city as ‘Spring’, we can rate
school] the address as correct.

User and Fresh

Viewport in
Spring TX

Relevance Bad (User Intent)

Klein Independent School
District Central Office Name Accuracy Correct
7200 Spring Cypress Road
Klein, TX 77379 Address Accuracy Correct
Category: School District Office Pin Accuracy Perfect

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap , a e
54 ril 2
.6 il 2 relevant
The school district office isprnot M ich for
by , 202 , A 6 by
Mi the query. a y
cha 4 fro esd 54
.
el D m I Tu .16.2
eve P 172
rs

209
 Query Results Ratings and Explanation
IP
Is there a Navigational m s Result for this Query? Yes
4 fro ever
0 2 D
Restaurant , 2 hael Danko
r i l 2 icGary Relevance Tu
esd
Navigational
800 A pNorth y MPoint St, San Francisco, 1 7
ay, 4.6 b 2.1 ay,
s dCalifornia
5 94109 Name Accuracy 6.2 Ap Correct
e 54 ril 2
Tu .16.2 .6 ,2
172 Category: American (New) Address Accuracy byCorrect
Mi 024
cha fro
Pin Accuracy Perfectel D m I
eve P
rs

This is a nationally famous restaurant in San

Francisco with no other possible results.

800 North Point Relevance Bad (User Intent)

800 North Point St, San Francisco,
California 94109 Name Accuracy n/a
Address Accuracy Correct
Pin Accuracy Perfect
[Gary Danko
800 North
Point St, San
Francisco,
When a user types in the name of a business
California
or a POI along with its address, they expect
94109]
to see the business mentioned in the query
as part of the result. If the result is the
address alone and does not mention the
business, the user cannot be certain that the
query and the result refer to the same thing.
This is why the result’s relevance is Bad.

Garry Lee, DDS Relevance Bad (User Intent)

1259 Mason St, San Francisco,
California 94108 Name Accuracy Correct
Category: Dentist Address Accuracy Correct
Pin Accuracy Perfect IP
Tu o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, cha e
54 ril 2 ril Mirestaurant.
Result is unrelated to the queried
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

210
Sometimes there are multiple unrelated businesses with the same name in the same area. In this
case, rate each business independently IP considering its relevance and distance from the location
intent of the query. ro m rs
0 2 4 f Deve
,2 el
r i l 2 icha Tu
esd Viewport
QueryA p yM
, 6b User
1 72.1and ay
a y
d 54 . 6.2 , Ap
e s 2 User inside a fresh viewport 54overr in Dearborn, MI (a
[lighthouse]Tu 2.16. .6 il 2, 2
suburb of Detroit) by
17 Mi 024
fr
chain the
User Intent: When there are multiple unrelated businesses with the same name el D omsame area,
I
rate each business independently considering its relevance and distance from the location eve P intent of
rs
the query.
Is there a Navigational Result for this Query? No

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

211
 Results Ratings and Explanation
IP
m rs Relevance Excellent
① The Lighthouse 2
ro
4 f Deve
0
4474 W Jefferson Ave l 2, 2 hael Name Accuracy Tu Correct
i c
Ecorse, MI 48229 , Apr y Mi 17 esda
y 6b Address Accuracy
2.1 y,
6Correct
Category: Pubuesda .254. .25 Apri
T .16 4.6 l 2,
172 Pin Accuracy Perfectby 202
Mi
cha 4 fro
This is one of the closest results that fits
el Dthem user’s
IP
query. This result should receive a relevance ever rating of
s
Excellent.

Both the Name and Address Accuracy are verified and

rated Correct.

The Pin lands on the correct rooftop.

② Lighthouse Ministries of Free Relevance Good (User Intent)

Methodist Church
2069 Chandler Ave Name Accuracy Correct
Lincoln Park, MI 48146
Category: Church Address Accuracy Correct
Pin Accuracy Perfect
This is one of the closest results and partially fits the
query intent. This result is about the same distance from
the user’s location as the result above (The Lighthouse),
but is less likely to be the user's intent based on the
query. Therefore, this result should be demoted based
on secondary intent to Good.

Both the Name and Address Accuracy are verified and

rated Correct.

The pin lands on the correct rooftop and is Perfect.

10.6.2. Chain Businesses

A query for a chain business is generally not considered an explicit query and is therefore not eligible
a for Navigational rating unless the query contains a location modifier that points to a single unique
location
Tu (see Chain Business with Location Modifier). IP
e r o m rs
17 sda f ve
2.1 y,
20 24 l De
6.2 A
Chain businesses
54 pril 2 are businesses that have more than one location, and include everything , afrom
e
r il 2 Mich
national chains
. 6 by like
, 2 Starbucks, Target, Auchan, Albert Heijn, and Boots down to small p local chains.
Mi 024 d a y, A .6 by
4
Distance evaluations
cha fro ues world,
m be based on chain business locations in the Treal
elshould
5
6.2 not only the
De P I . 1
returned results. ver 172
s

212
 • The more locations the chain business has in the area, the closer the results should be in
order to be considered relevant. IP
• The fewer locations the chain o m business
s has in the area, the more you can widen the distance
4 f ever
r
for relevant results. , 2 ael 0 2 D
l 2 ch Tu
pri y Mi 1 es
Note: Go to the chain
A
, business’ official website and check the
72.1 daof
address 6.2 , Athe specific branch you’re
a y . 6 b y
e s d 54 pri
rating. For each u branch
T .16 . 2 of a chain business, research to verify that it actually
5 4.6 exists
l 2, at the address
listed in the result.
7 2 b y M 24 2 0
1
ich fro
ael m
De IP
ver
s

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

213
 Query IP User and Viewport
ro m rs
f e v e
[whole foods] , 2 024 el D User and fresh viewport in Irvine, California
l 2 ich a Tu
r i
p yM esd
User Intent: Theauser 1
, 6isbclearly looking for the grocery chain Whole
y A 72.1 Foods
ay close to their location
or at least within
e s 4 .
dthe5viewport. 6.2 , Ap
r
Tu .16.2 54
.6 il 2, 2
2 by
1 7
Is there a Navigational Result for this Query? No Mi 024
cha fro
el D m I
eve P
rs

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

214
 Results Ratings and Explanation
IP
Is there a Navigational Resultfrfor om vthis
ers Query? No
2 4 De
,2 0 el
r i l 2 icha Relevance Tu Excellent
es
p yM 1
y A
, 6b 72.1 day,
a . Name Accuracy 6Correct
.25 Apri
esd 54
Tu .16.2 4.6 l 2,
1 7 2 Address Accuracy Correct
by 202
① Whole Foods Mi
cha 4 fro
The District, 2847 Park Ave, Tustin, CA Pin Accuracy Approximateel D m IP
eve
92782 rs
Category: Grocery

This is a Whole Foods store within the user’s viewport

as well as the closest Whole Foods location to Irvine.

The pin is dropped within the shared parking lot of the

result, making it Approximate.

② Whole Foods Relevance Good (Distance/Prominence)

Fashion Island, 415 Newport Center Dr,
Newport Beach, CA 92660 Name Accuracy Correct
Category: Grocery Address Accuracy Correct
Pin Accuracy Perfect

This is a Whole Foods store in the same metro area, but

is outside the user’s viewport.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

215
 Results Ratings and Explanation
IP
m s Acceptable (Distance/
③ Whole Foods 2 4 fro ever
D Relevance
Aliso Village Shopping Center,
0
, 2 ael Prominence)
r i l 2 ich23932 Tu
Aliso Creek Rd, Laguna , A 6Niguel,
p y M CA 92677 Name Accuracy 17 eCorrect
s
a y . b 2.1 day,
Category: Grocery
esd 54 6.2 Ap
Tu .16.2 Address Accuracy 54 ril 2
Correct
.6
172 by , 202
M 4
Pin Accuracy Perfect icha from
el D I
eve P
rs
This is a Whole Foods store in a neighboring city,
outside of the viewport and a considerable distance
away. As such this result is less relevant to the user and
is rated Acceptable.

10.6.3. Chain Business with Location Modifier

If the query for a chain business includes a location modifier that points to a single unique branch of
that business, that specific branch can be eligible for a Navigational rating.

When there are multiple results available for the location modifier, the highest possible rating for all
results will be Excellent. Remember:

• User and viewport location should always be ignored when there is a location modifier
• Ratings must always be based on possible real-world results

There are two types of location modifiers:

• General location modifier (locality or postal code)

• Specific location modifier (street or full address)

#Y"J"N"#"%Z)B)E9C%5A*9@AB%/A,>[)E

Location modifiers in the form of localities or areas are considered to be general location modifiers.

Results inside the requested location

When the location modifier is general, results inside the specified location are not demoted for
distance.
Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

216
 Quantity of results
Location of IP
inside the requested m rs Rating and Explanation
results ro e
location
f e v
, 2 024 el D
l 2 ch a Tu present in the requested
pri y Mi If there is only one result
1 es
A
, 6b location, it should 72.1 daayrating
receive
a y
esd One 54 . 6.2 , Ap of Navigational.
u
T .16 . 2 54 ril 2
.6 ,
172 It is promoted because it is thebonly y M 2result
02 that satisfies
4
the user intent i c ha from
Inside the el D I
requested eve P
When there are multiple results for the chain rbusiness
s in
location the requested location, they should all receive a rating
of Excellent.
More than one
Ignore user and viewport location. The user has already
told you exactly where they are looking for results.

Results outside the requested location

When the location modifier is general, results outside the requested location are demoted based on
how many results there are inside it.

Location of Results inside the

Rating and Explanation
results requested location

If there are no results for the chain business inside the

requested location, results outside the area may be
Outside the demoted less severely depending on how close they are
requested to the named location and how many branches of the
location chain exist in the real world. Ratings may range from
Excellent to Bad.
None
This is because when there are no locations of a chain
business inside the requested area, results that are
outside it can still be relevant. However, it's also
IP
Tu possible for results to be so far away from the location o m rs
17 esda that they have no relevance at all.
f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

217
 Location of Results inside the
IP Rating and Explanation
results requested location m rs
ro
2 4 f Deve
,2 0 el If there are few results for the chain business inside the
l 2 icha Tu
requested location, results
17 esdaoutside the area may be
p r i M
a y , A 6 by demoted less severely2.depending
16 y, A on how close they are
.
esd 54 to the named location and.2how54 pmany 2, branches of the
ril
Tu .16.2 .6
172 b y M 2may
chain exist in the real world. Ratings 02 range from
4
Good to Bad. i c ha from
Few el D I
eve P
This is because when there are fewer locations rs of a
chain business inside the requested area, results that
are outside it can still be relevant. However, it’s also
possible for results to be so far away from the location
that they have no relevance at all.
When there are many results for the chain business
inside the requested location, results outside the area
Many are demoted to Bad. This is because there are multiple
results that would satisfy user intent inside the
requested area, so there’s no need to look outside it.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

218
 Query IP User and Viewport
ro m rs
f e v e
[Starbucks san francisco] , 2 024 el D User and fresh viewport in San Francisco, CA
l 2 ich a Tu
r i
p yM esd
User Intent: The user , 6isbseeking a Starbucks in a specific location.1
a y A
.
72.1The ay,fresh viewport and user
d 54 since the user has an area in mind for results. A
6.2Because
location can bee ignored
s 54 pril 2 there are so many
Tu .16.2 . 6b ,2
Starbucks within the named area, results outside it are rated Bad.
172 y M 024
ich fro
Is there a Navigational Result for this Query? No ael m
De IP
ver
s

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

219
 Results Ratings and Explanation
IP
o m rs Relevance Excellent
① Starbucks 0 2
r
4 f Deve
2165 Polk St, San Francisco, , 2 hael
r i l 2 icCA Name Accuracy Tu Correct
94102 p
, A 6 by
M 17 esda
y 2.1 y,
a . Address Accuracy 6Correct
.25 Apri
esd 54
Category: Coffee
Tu .16.2 4.6 l 2,
172 Pin Accuracy Perfect
by 202
Mi
cha 4 fro
el D m I
eve P
This result is one of many Starbucks in the specified
rs
location, San Francisco, and is rated Excellent. All results
within San Francisco are eligible for the highest possible
initial rating of Excellent.

All the data for the result is correct.

Relevance Excellent
② STARBUCKS
Name Accuracy Correct
1231 Market St, San Francisco, CA
94103 Address Accuracy Correct
Category: Coffee
Pin Accuracy Perfect
This result is one of many Starbucks in the specified
location, San Francisco, and is rated Excellent. All results
within San Francisco are eligible for the highest possible
initial rating of Excellent.

The STARBUCKS name is written in capital letters. Because

this is how the business refers to itself on storefront signs,
it is Correct. The address is Correct and the Perfect pin
lands on the correct rooftop.

③ Starbucks Relevance Bad (Distance/Prominence)

1555 40th St. Emeryville, CA 94608
Category: Coffee Name Accuracy Correct
Address Accuracy Correct
Pin Accuracy Approximate
This Starbucks is outside of the boundaries of the specified
location and should be rated Bad since there are so many IP
Tu Starbucks to choose from in San Francisco. o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, icha e
54 ril 2
.6 The name and address are Correct. Using priltheMbest
by , 202 available evidence — in this case, street y, Aimagery
by — the
Mi a 6
cha 4 fro location of the Starbucks under Tthe s d
u rooftop
e 2 54 .
can be found.
el D m I . 16.
eve P Since the pin falls on the correct1rooftop,
7 2 but not in the
rs correct location, it is rated Approximate.

220
 Results Ratings and Explanation
IP
m s
④ Starbucks 4 fro ever Relevance Bad (Distance/Prominence)
2 02 el D
601 Westlake Center, Daly , City,
l 2 ch a CA Tu
94015 pri y Mi Name Accuracy 1 esd
y A
, 6b 72.1 Correct
ay
Category: Coffee
e s a
d 54 . 6.2 , Ap
Tu .16.2 Address Accuracy 54 ril 2
Correct
.6
172 by , 202
M 4
Pin Accuracy Perfect icha from
el D I
eve P
rs
This Starbucks is outside of the boundaries of the specified
location and should be rated Bad since there are so many
Starbucks to choose from in San Francisco.

All the data for the result is correct.

⑤ Starbucks Relevance Bad (Distance/Prominence)

12 Manor Plaza, Pacifica, CA 94044
Category: Coffee Name Accuracy Correct
Address Accuracy Correct
Pin Accuracy Approximate

This Starbucks is outside of the boundaries of the specified

location and should be rated Bad since there are so many
Starbucks to choose from in San Francisco.

The pin drops within the Half n' Half rule boundaries of the
shared parking lot.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

221
 Query User and Viewport
IP
[Aldi waco tx] m s User and fresh viewport in Houston, TX
4 fro ever
0 2 D
User Intent: The user rasked , 2 haela specific chain business in a specific
i l 2 icfor Tu
esd
location. The fresh viewport
can be ignored since A p user
the y M has a specific area in mind for results.
1 7 Because there are very few
a y, .6 b 2.1 ay,
stores within the d 6 A
es specified
5 4 area, results outside it are gradually demoted. .25 pri
Tu .16.2 4.6 l 2,
2 b 2
7
Is there a Navigational
1 Result for this Query? Yes y Mi 024
cha fro
el D m I
eve P
rs

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

222
 Results Ratings and Explanation
IP
ro m rs Relevance Navigational
0 2 4 f Deve
,2 el
r i l 2 icha Name Accuracy Tu Correct
p
, A 6 by
M 17 esda
y 2.1 y,
d a 4 . Address Accuracy 6Correct
.25 Apri
ues 6.25
① ALDI T
72.
1
Pin Accuracy
4.6 l 2,
Approximate
by 202
1
1220 N Valley Mills Dr, Waco, TX Mi
cha 4 fro
76710 el D m I
eve P
Category: Grocery rs

ALDI is a well-known chain business. Research confirms

that the location modifier in the query narrows possible
results to a single unique location. This is the only location
eligible for a Navigational rating.

The pin drops within the shared parking lot.

② ALDI Relevance Good (Distance/Prominence)

3310 S 31st St, Temple, TX 76502
Category: Grocery Name Accuracy Correct
Address Accuracy Correct
Pin Accuracy Perfect
Although this result is not in Waco, research shows that,
unlike the many Starbucks in San Francisco, there are very
few Aldi stores in the Waco area. That is why this nearby
result should be demoted -2 for distance from the highest
possible initial rating of Navigational and rated Good.

The pin drops on the edge of the appropriate rooftop and

can be rated Perfect.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

223
 Results Ratings and Explanation
IP
m s Acceptable (Distance/
4 fro ever Relevance
0 2 D Prominence)
③ ALDI ,2 el
r i l 2 icha Tu
3623 W State Highway p y MCorsicana, Name Accuracy
, A 631, 17 esCorrect
a y . b 2.1 day,
TX es d 5 4 6.2 Ap
Tu .16.2 Address Accuracy 54 ril 2 – Postal Code
Incorrect
.6
Category: Grocery
172 by , 202
M 4
Pin Accuracy Perfect icha from
el D I
eve P that,
Although this result is not in Waco, research shows rs
unlike the many Starbucks in the San Francisco example
above, there are very few Aldi stores in the Waco area. This
result has been demoted -3 from the highest possible
initial rating of Navigational to Acceptable because it is
significantly farther from the area of expected results.

The postal code, which is a mandatory address

component, is missing from the result address.

#Y"J"N"G"%7()*>[*%5A*9@AB%/A,>[)E

Location modifiers in the form of streets or full addresses are referred to as specific location
modifiers.

A specific location modifier might also be the name of a POI, as seen here: [university of kentucky
starbucks] in a query about the location of the coffee chain at a particular university.

When the a query includes a specific location modifier, results that satisfy the location intent should
not be demoted for distance:

Number of results
Location of
inside the requested Rating and Explanation
results
location

Consider the location modifier a general one and

None demote results based on distance to the specified
location.

If there is a only a single result present in the specified

Tu IP
location it should receive a rating of Navigational. o m rs
17 esda f r ve
2.1 y, One 20 24 l De
Inside6.the
25 April It is promoted because it is the only result a e
2, ichsatisfies
requested 4.6 2 p ril that
M
by , 202 the user intent y, A .6 by
location M ich 4 fro da
es 54
ael m Tu .16.2
De IP
ver 172
s

224
 Number of results
Location of IP
inside the requested m rs Rating and Explanation
results ro e
location
f e v
, 2 024 el D
l 2 ch a Tu
pri y Mi When there are multiple esd
2.1 results
ay, in the location, they
A
, 6b 1 7
a y .
d
es .25 4 should all receive a rating 6 .25 Excellent.
of Ap
ril
Tu .16More than one 4 . 6 2
172 by , 202
Ignore user and viewport location.MThe ich 4user
fro has already
told you exactly where they are lookingelfor a m
De results.
IP
ver
s

Query Results Ratings and Explanation

Is there a Navigational Result for this Query? Yes

Kate Spade New York Relevance Navigational

[kate spade 789 Madison Ave, New York, NY Name Accuracy Correct
789 Madison 10065
Ave, New York] Category: Accessories Address Accuracy Correct

User and large, Pin Accuracy Perfect

fresh viewport in
This chain business query includes a specific
New York, NY
location modifier in the form of a full address.
Research confirms that this is the address of
queried business, so this result is eligible for
a Navigational rating.

All the data for the result is correct and the

pin is Perfect.

Kate Spade New York Relevance Bad (User Intent)

205 Columbus Ave, New York, Name Accuracy Correct
NY 10023
Category: Accessories Address Accuracy Correct
Pin Accuracy Perfect

This is a very specific query and the result

does not satisfy the specific location
Tu IP
modifier and would not be useful to the o musers
17 esda 4 f ever
r
2.1 y, searching only for the location at20the 2 lD
6.2 Ap , rated e
ha Bad.
54 ril 2 specified address. This result i l is
2 i c
.6
by , 202 pr M
Mi a y, A 6 by
cha 4 fro esd is
All the data for the uresult 54.correct.
el D m I T .16.2
eve P 172
rs

225
 Query IP User and Viewport
ro m rs
f e v e
[tacodeli burnet rd] , 2 024 el D User and fresh Viewport in Austin, TX
l 2 c h a Tu
pri y Mi 1 esd
User Intent: Sincey,there
A b are two Tacodelis located on the named2street,
7
. ay both are primary intent.
Any other location
e s a . 6
d is5rated
4 Bad.
1 6.2 , Ap
Tu .16.2 54 ril 2
.6
7 2 by , 202
Is there a Navigational Result for this Query?
1 No Mi
cha 4 fro
el D m I
eve P
rs

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

226
 Results Ratings and Explanation
IP
ro m rs Relevance Excellent
① Tacodeli 0 2 4 f Deve
12001 Burnet Rd, Austin, , 2 hael Name Accuracy Tu Correct
r i l 2TX i78757
c
A p yM 17 esda
Category: Mexican , b 2.1 y,
e s day 54.6 Address Accuracy 6Correct
.25 Apri
Tu .16.2 4.6 l 2,
172 Pin Accuracy Approximate
by 202
Mi
cha 4 fro
At first glance, this chain business query m a specific
el Dwith IP
location modifier may suggest the user is lookingever for a
s
unique location. However, research indicates that there
are two branches of this restaurant on the same road.
Both are therefore eligible for a rating of Excellent.

The pin drops off the edge of the appropriate rooftop

and should be rated Approximate.
Relevance Excellent
② Tacodeli
7301 Burnet Rd, Austin, TX 78758 Name Accuracy Correct
Category: Mexican
Address Accuracy Correct
Pin Accuracy Perfect
At first glance, this chain business query with a specific
location modifier may suggest the user is looking for a
unique location. However, research indicates that there
are two branches of this restaurant on the same road.
Both are eligible for a rating of Excellent.

All the data for the result is correct.

Relevance Bad (User Intent Issue)
Name Accuracy Correct
③ Tacodeli
4200 N. Lamar Blvd, Austin, TX 78756 Address Accuracy Correct
Category: Mexican Pin Accuracy Perfect

This result does not satisfy the specific location

modifier and would not be useful to the user searching
only for locations along Burnet Road and is therefore
Tu rated Bad. IP
o m rs
17 esda r
f eve
2.1 y,
6.2 Ap However, if there are no results present on, 2this 024 road,
el D
54 ril 2 2
l one h a
.6 consider the location modifier as a general pri y M ic and
by , 202 , A b
Mi demote results based on distance ayto the.6 road
cha 4 fro uesd .254
el D m I T .16
eve P 172
All the data for the result is correct.
rs

227
 IP
ro m rs
f eve
4named
When a query is for a POI on 0 2a D street, results for this POI that are on the named street but
2 , 2 hael Tu
have an official address pri on
l
Manother
i c street can also be rated Excellent.
es
1
a y A
, 6b
.
y 72.1 day,
esd 54 6.2 Ap
Tu .16.2 54 ril 2
.6
172 by , 202
10.6.4. Back Offices and Businesses with No Physical Location Mi
cha 4 fro
el D m I
eve P
These type of results are most often rated Bad because they are either not useful to the user rs or have
no maps intent at all.

Business Type Example Rating and Explanation

Businesses with no physical location, like mobile
Mobile
No Physical location locksmiths or mobile dog groomers, have no relevance for
locksmith
maps and are rated Bad.
Back offices are usually not open to the public. Rate them
Administrative
with a lower prominence. In most cases the relevance
Back Office offices of a
rating will be Bad unless these offices match the specific
company
user intent.
Unless your Country Specific guidelines state otherwise,
give businesses running out of a home very low
prominence.

These businesses see customers by appointment only

and have no regular opening hours or brick and mortar
Home based
Home Business businesses (like a store with regular hours where
calligrapher
customers can drop by and choose from a large selection
of merchandise).

The most likely relevance rating is Bad, unless there is a

likely user intent or the suggestion is similar to a bed and
breakfast or other business that a user may want to visit.

For these types of results, rate the address accuracy according to the official website or consensus
of three sources, otherwise rate Can’t Verify. If the entire address is missing, rate Can’t Verify. If an
address
Tu is present, rate the pin according to the address in the result. If no address is present,omrate IP
s
the e
17pinsCan’t
d a Verify. 4 f ever
r
2.1 y,
6.2 Ap 2 , 202 ael D
54 r h
.6 il 2, 2 pril Mic
by , A y
Mi 024 day 54.6
b
cha fro e s
el D m I Tu .16.2
P
eve
rs 172

228
 Query Results Ratings and Explanation
IP
Is there a Navigational m s Result for this Query? No
4 fro ever
0 2 D
,2 el
r i l 2 icha Relevance Tu
esd
Bad (User Intent)
A p yM 1 7
, b 2.1 ay,
s day 54.6 Name Accuracy 6.2 ACorrect
e
Tu .1Wendy's
6.2 Flower Affair 54 pril 2
.6
172 1175 E 930 N, Provo, UT 84604 Address Accuracy Correct by , 202
Mi
cha 4 fro
Category: Wedding Planning Pin Accuracy Perfectel D m IP
[flower shop] eve
rs
Research shows that this is a business run
User and fresh out of a residential home, not a showroom full
viewport in of flowers. The relevance rating for this
Provo, UT location is Bad. We have been able to confirm
the address and pin for this business and they
will be rated Correct.

This business will not be rated Business/POI

is closed/does not exist because we want
to reserve that option for businesses and
POIs that truly do not exist.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

229
10.6.5. Business Does Not Exist
IP
There are situations where a result o mreturned
f ever
r s is for a business that does not exist. You must still rate
relevance as if the business2were 4
2 open. D
2 , 0 hael Tu
l c
pri y Mi 1 es
Query a y A
, 6b
. Results
72.1 day, and Explanation
Ratings
esd 54 6.2 Ap
Tu .16.2 54 ril 2
.6
172 Is there a Navigational Result for this Query? by , 202
No
Mi
cha 4 fro
Ocean Blue Sushi Club
1010 E El Camino Real,
Business/POI is closed/doesel D m IP
not exist eve !
rs
Sunnyvale, CA 94087
Relevance Excellent
Category: Sushi
[sushi]
Research shows that this business is closed.
User and fresh
The checkbox for Business/POI is closed/
viewport in
Sunnyvale, CA
does not exist should be selected. Name,
address and pin accuracy questions will not
appear. The relevance rating for this location
is Excellent because if this business were
open, it would be a very good result for the
query.

Is there a Navigational Result for this Query? No

North Shore Hotel
99300 Sea View Drive, Hwy 11
Business/POI is closed/does
not exist
!
North Shore, CA
Relevance Excellent
[hotel] Category: Hotel

Fresh viewport
over North
Shore, CA The North Shore hotel no longer exists at this
address, but its relevance is judged as if it
were still in business.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

230
10.7. Category Queries
IP
Category queries are the broadest m
f ever type because they can return the greatest variety of results.
query
ro s
Give prominence more weight 4
2thanDdistance when rating them.
2 , 20 hael Tu
l c
A pri y Mi 1 7
esd
The highest relevance y , rating b most category query results will receive 2.1 is aExcellent.
y
e s a
d 54 . 6 6.2 , Ap
Tu .16.2 54 ril 2
.6 ,2
Category queries
172 with a location modifier are the only category queries eligible by for
Mi 02a4 Navigational
rating (see Navigational Results for Category Queries). cha fro
el D m I
eve P
You’ll need to determine the user’s intent based on the query: rs

• Primary Intent refers to the businesses or POI the user is expecting to see for the given
category.
• Secondary Intent refers to businesses that fit the category intent but would not be the
user's first choice. Secondary intent results will receive a demotion of -1 or an initial rating of
Good.
• Unlikely Intent refers to results that technically match the query terms or category intent,
but woud not be an obvious, or even secondary, intent for most users. They receive a
demotion of -2 or an initial rating of Acceptable.

Significant Increase in Distance

Given how many results are often within close proximity to the location intent, results for category
queries are not demoted for distance simply because there is something closer (in the result set or in
real life). Instead, use significant increases in distance to group possible results for the appropriate
demotions.

It is important to understand the real-world distribution of all

possible results when assessing a significant increase in
distance.

The image on the left shows possible results around the user
as purple dots. In this example, demotion for distance starts
approximately 500m away from the user (around 3 to 6 blocks
away) due to the high number of possible results. This distance
will vary depending on how many or few results are available in
a given area.

Please note that no results inside the fresh Viewport should IP

Tu o m be s
17 esda demoted to Bad for distance alone. 4 f ever
r
2.1 y, 2 D
6.2 Ap
54 ril 2 2 , 20 hael
l c
.6
by , 202 A pri y Mi
Mi ,
ay .6 b
cha 4 fro uesd .254
el D m I T .16
eve P 172
rs

231
10.7.1. Demotion for Distance withIPUser Inside Viewport
m s
4 fro ever
2 D
2 , 20 hael Tu
l c
Query pri y Mi User
1 eand
s Viewport
a y A
, 6b
.
72.1 day,
6.2 Ap
[pizza]uesd 6.254 User and fresh viewport in 5Campbell,
4.6 ril 2, CA
T .1
72 by 202
User Intent: 1The user is looking for a pizza place. Mi
cha 4 fro
el D m I
Is there a Navigational Result for this Query? No eve P
rs

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

232
 Results Ratings and Explanation
IP
ro m rs Relevance Excellent
2 4 f Deve
① Domino’s Pizza il 2, 2 ichael 0
At about 1 km away, thisTu pizza place is among the
930 W Hamilton Ave pr y M
ACampbell, CA es
closest results to the17user,
a y ,
. 6 b 2.1 dawhoy, A is in an area with many
Category: Pizza
es d 5 4 pizza options. Other results 6 .25 in the
p same general range
Tu .16.2 4 ril
would also receive this rating..6 by 2, 20
172 Mi 24
c a fro
Relevance Good (SignificanthDistance)
el D m I
② Luigi's Pizza and Pasta eve P
rs is and
2495 S Winchester Blvd, Campbell Luigi’s is significantly further away from the user
is demoted for distance, as are all other results in this
Category: Pizza
general range.

Relevance Acceptable (Significant Distance)

③ Pizza My Dear
2590 S Bascom Ave, San Jose, CA Pizza My Dear is over 4km away from the user, which is
significantly further than many other results. It is
Category: Pizza
demoted -2 for distance.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

233
10.7.2. Demotion for Distance with User Outside Viewport
IP
ro m rs
0 2 4 f Deve
Query 2, 2 ael User and Viewport
r i l i ch Tu
esd
A p yM 1
y , 6b Fresh viewport in New2.Braunfels,
7 ay TX, with user north of
[guns] sd 54a . 1 6.2 , Ap
e San Antonio r
Tu .16.2 54
.6 il 2, 2
2 by
7
User Intent: 1The user is looking for guns. Mi 024
cha fro
el D m I
Is there a Navigational Result for this Query? No eve P
rs

Results Ratings and Explanation

Relevance Excellent
① EDC TX
964 N Walnut Ave, New Braunfels, Tx This result is inside the very specific viewport and
Category:
Tu Gun Store carries weapons and other accessories. IP
o m rs
17 esda f r ve
2.1 y, Relevance Excellent 20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
② Freddy’s .6 Pawn
by , 202& Jewelry p
y, A .6 by
Mi New a
671 S Seguin Ave, cha 4 froBraunfels, TX The pawn shop is very close to d
ethe
s fresh54 Viewport and
el D m I Tu .16.2
Category: Pawn Store eve P sells guns and related items. 72
rs 1

234
 Results Ratings and Explanation
IP
ro m rs Relevance Good (Significant Distance)
③ Guntrap 0 2 4 f Deve
,2 el
850 Schneider, Cibolo, r TX
i l 2 icha This weapons store satisfies
Tu
e
the user intent but is
p M 72 sdfrom
significantly further 1away
Category: Gun Store
a y , A 6 by
. .16 ay, A the fresh viewport in a
esd 54 more rural area, with fewer .25suchp stores close by.
4.6 ril 2,
Tu .16.2
172 by 202
Relevance Good (Significant
Mi Distance)
④ River City Pawn & Jewelry cha 4 fro
el D I m
417 Main St, Scherz, TX The pawn shop sells guns and other related eve equipment
P
but is also significantly further away from thesfresh r
Category: Pawn Store
viewport.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

235
10.7.3. Demotion for Distance with Fewer Possible Results
IP
ro m rs
0 2 4 f Deve
Query 2, 2 ael User and Viewport
r i l i ch Tu
es
p yM 1
[bicycle path] y A
, 6b 72.1 indaKennesaw,
User and fresh viewport y GA
e s a
d 54 . 6.2 , Ap
u 6.2 54 r il 2
User Intent:TThe .1 user is looking for places to ride a bike. These could .6 include
, trails, parks,
7 2
1 that are frequented by bicyclists. b y M 2024
and other paths ich fro
ael m
Is there a Navigational Result for this Query? No De IP
ver
s

Results Ratings and Explanation

Relevance Excellent
① Deerfield Park Deerfield Park is among the closest results to the user.
2401 Deerfield Dr, Kennesaw, GA There are other results that are within an acceptable
Category: Park range given the number of other possible results that IP
Tu m rs
17 esda are within 13km. f r o ve
2.1 y,
20 24 l De
6.2 Ap Relevance Good (Significant ha
e
2, Distance)
54 ril 2 ril Mic
.6 ,2 p
② Allatoona by Creek
Mi 024 These mountain bike trails are aboutd a y, A25km
4 . 6 by
away from
cha fro
Pitner Rd NW, Acworth, GA 30101 es .25
el D m Tu distant
the user and significantly more 6 than the closest
e
IP
7 2.1
Category: MTB Trails ver group of results. The result, and others in the same
1
s
general range, is demoted by -1 for distance.

236
 Results Ratings and Explanation
IP
ro m rs Acceptable (Significant
2 4 f Deve Relevance
,2 0 el Distance)
l 2 icha Tu
③ Iron Hill Trail Head p r i
, A 6 by
M es
Iron Hill Trail Head is17about
2.1 da30km
y, A away. It is still within
a y
Cartersville, GAes30121
d 4 . the Acceptable group in terms 6 .25 pof distance to the
T u 6.25 4.6 ril 2,
Category: Hiking .1Area location intent given the smaller by 202 of possible
number
172 Mi
results in the area, and gets a demotion cha 4 of
fr -2 for
distance. el D om I
eve P
rs

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

237
10.7.4. Category Queries and User Intent
IP
ro m rs
0 2 4 f Deve
Query ,2 el Suggestion Ratings & Explanation
r i l 2 icha Tu
p
, A 6 by
M
① The Art Institute 17 esda
Relevance Excellent
a y . 2.1 y,
[art]
s d 54 6.2 Ap
e of Chicago r
Tu .16.2 54
This result is .an
il 2
6 b internationally
, famous
172 111 S Michigan Ave, y M 2024
User in Chicago, IL Chicago art museum in Chicago ich very
f close to the
(Viewport is stale) user's location. ael rom
Category: Museum De IP
ver
s
Good
(User Intent &
Relevance
② Arts & Artisans Distance/
321 N Michigan Ave Prominence)
#1, Chicago This art gallery should be demoted due
Category: Art Gallery to distance to user as there are many
other possible art-related matches in
the user’s area.
③ The Art of Pizza Relevance Bad (User Intent)
727 S State St,
Chicago
Category: Pizza

Even though it has the word “art” in its

name, this pizzeria does not meet the
user’s intent and should be rated Bad.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

238
10.7.5. Category Queries and Prominence IP
ro m rs
0 2 4 f Deve
,2 el
r i l 2 icha Tu
p
, A 6 by
M 17 esda
Query Suggestion 2.1Ratings
y
a y
esd .254
. 6.2 , Ap & Explanation
u
T .16 54 ril 2
172 ① Solomon R. .
Relevance 6 by , 20Excellent
Mi 24
[museum] Guggenheim cha fro
Museum This result is a highly prominent
el D m I
P
No user location (viewport is fresh) 1071 5th Ave museum likely to fulfill theeuser’s
ver primary
s
New York intent.
Category: Museum

Relevance Excellent
② 9/11 Memorial &
Museum This is another highly prominent result
180 Greenwich St likely to meet the user’s the primary
New York intent.
Category: Museum

③ Houdini Museum Good/Acceptable

421 7th Ave Relevance (Distance/
New York Prominence)
Category: Museum
This result is a small museum that’s
much less prominent than other
museums in this location, like the
Guggenheim.
④ Museum of the Bad (Distance/
Moving Image Relevance
Prominence)
36-1 35th Ave
Astoria
This result is also much less prominent
Type: BUSINESS than other possible results in the area. It
Category: Museum is located outside of the viewport while
there are multiple other options available
inside of the viewport.

10.7.6. Category Query with Location Modifier

If the query contains a location modifier, all results within the specified location should receive the
highest
Tu possible initial rating of Excellent. Results outside the expected location should be demoted IP
e r o m rs
based
17 on
2.1 daytheir
s distance from the location modifier and the number of possible real-world 2results
0 4 f Deve
,
within 6it..2 Userprand viewport location should be disregarded. Further demotions can be2,applied el
ha based
A 2
54 i l i l i c
on how well.6the by result
2,
2 fits the intent of the category. pr M
Mi 024 a y, A 6 by
.
cha fro esd .254
Note that location modifiers Tu the
el D m I for category queries can take many forms, from 6 names of cities,
e P 7 2.1
neighborhoods, and streets ver to the names of POIs, like [Aeropuerto barcelona gasolinera], a query
s
1
about gas stations at or near Barcelona’s airport.

239
 Query User and Viewport
IP
[Food montgomery tx] m s User and viewport outside Montgomery, TX
4 fro ever
0 2 D
,2 el
User Intent: Any foodrprovideri l 2 icha or restaurant within the named locality
Tu
esd
is considered primary
intent. Given the large pnumber M of possible results within the explicit
1
a
A
y, .6 b y 72.1 ay, results outside it are
area,
rated Bad. ues .25 d 4 6.2 Ap
T .16 54 ril 2
.6
7 2 by , 202
Is there a Navigational Result for this Query?
1 No Mi
cha 4 fro
el D m I
eve P
rs

Results Ratings and Explanation

Relevance Excellent
① Pizza Shack
20821 Eva St, Montgomery, TX Name Accuracy Correct
Category: Pizza
Address Accuracy Incorrect – Postal Code
Pin Accuracy Approximate
Tu IP
17 esda All results that satisfy the ‘Food’ intent located fin rom vers
e
2.1 y,
6.2 Ap Montgomery are eligible for an initial rating , 2024 el D
of
54 ril 2 l 2 ch a
.6 Excellent. pri y Mi
by , 202 , A b
Mi
cha 4 fro s day 54.6
el D m I The postal code, which is a mandatory
Tu .16.2 address
e
eve P component, is missing from the 172result address.
rs The pin drops into the shared parking lot.

240
 Results Ratings and Explanation
IP
o m rs Relevance Bad (Distance/Prominence)
② Taco Bell 0 2
r
4 f Deve
3207 W Davis St, Conroe, , 2 ael
r i l 2 TXich77304 Name Accuracy Tu Correct
Category: Fast Food p
, A 6 by
M 17 esda
y 2.1 y,
a . Address Accuracy 6Correct
.25 Apri
esd 54
Tu .16.2 4.6 l 2,
172 Pin Accuracy Perfectby 202
Mi
cha 4 fro
el D m I
eve P
Given the large number of places to get foodrsin
Montgomery, results outside of it are rated Bad.

All the data for the result is correct.

10.7.7. Navigational Results for Category Queries

Sometimes it’s not clear whether a query is for a category or a specific business/POI. What first
appears to be a category query with a location modifier may lead to a single prominent result which
can be rated Navigational.

Due to the ambiguity of these queries, even if there is a Navigational result, the query should still be
treated as a potential category query and other results considered relevant.

When deciding if a category query could have a Navigational result, consider:

• The actual wording of the query

• Possible results in the real world
• Local knowledge
• Prominence

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

241
 Query Results Ratings and Explanation
IP
Is there a Navigational m s Result for this Query? Yes
4 fro ever
0 2 D
,2 el
r i l 2 icha Relevance Tu
esd
Navigational
A p yM 1 7
y, .6 Kilkenny
b 2.1 ay,
e s daHotel
5 4 Name Accuracy 6.2 ApCorrect
6.2
Tu .1College Road, Kilkenny R95 54 ril 2
.6
172 KP08 Address Accuracy Correctby , 202
Mi
cha 4 fro
Ireland Pin Accuracy Perfectel D m IP
Category: Hotel eve
rs
This result is an exact match to the query. The
wording of the query leads to a single result,
so it’s likely the user intent is this specific
hotel.

The address is correct without a street

number because it matches what's found on
the official website. The pin landing in the
hotel's roof is Perfect.
[hotel
kilkenny]
Relevance Excellent
Name Accuracy Correct
Newpark Hotel
Castlecomer Road, Kilkenny R95 Address Accuracy Correct
KP63, Ireland Pin Accuracy Perfect
Category: Hotel
Although the wording of the query suggests a
single result, there is still a possibility that the
intent is for any hotel in Kilkenny. Since this
could be a category query with a location
modifier, all hotels in this locality should be
rated as Excellent.

The address is correct without a street

number because it matches the address
shown on the official website. The pin is
Perfect because it lands on the hotel’s
rooftop.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

242
 Query Results Ratings and Explanation
IP
Is there a Navigational m s Result for this Query? No
4 fro ever
0 2 D
,2 el
r i l 2 icha Relevance Tu
esd
Excellent
A p yM 1 7
y, .6 b 2.1 ay,
s daHotel
5 4 Kilkenny Name Accuracy 6.2 ApCorrect
e 54 ril 2
6.2
Tu .1College Road, Kilkenny R95 .6
172 KP08 Address Accuracy Correct by , 202
Mi
cha 4 fro
Ireland Pin Accuracy Perfectel D m IP
eve
Category: Hotel rs
There is no result that matches the exact
wording of the query, so this is more likely to
be a category query with a location modifier.
Any hotel result returned in the locality of
Kilkenny would be rated Excellent.

The address is correct without a street

number because it matches what appears on
the official website. The pin landing the hotel's
roof is Perfect.

Relevance Excellent
Name Accuracy Correct
[Kilkenny
hotel] Address Accuracy Correct
Pin Accuracy Perfect

Newpark Hotel
Castlecomer Road, Kilkenny R95
KP63, Ireland
Category: Hotel

Any hotel result returned in the locality of

Kilkenny would be rated Excellent,
completely satisfying the ‘Category with
Location Modifier’ query

The address is correct without a street

number because it matches the address
Tu shown on the official website. The pin is IP
m s
17 esda Perfect because it lands on the hotel’s 4 fro ever
2.1 y, 2 D
6.2 Ap
54 ril 2
rooftop. 2 , 20 hael
l c
.6
by , 202 A pri y Mi
Mi ,
ay .6 b
cha 4 fro uesd .254
el D m I T .16
eve P 172
rs

243
 Query Results Ratings and Explanation
IP
Is there a Navigational m s Result for this Query? No
4 fro ever
0 2 D
,2 el
r i l 2 icha Relevance Tu
esd
Excellent
A p yM 1 7
, b 2.1 ay,
e s day 54.6 Name Accuracy 6.2 ApCorrect
Tu .16.2 54 ril 2
.6
172 Address Accuracy Correctby , 202
Mi
Berlin Tegel Airport cha 4 fro
Pin Accuracy Perfectel D m IP
13405 Berlin, Germany eve
rs
Category: Airport
There are two equally prominent airports in
Berlin. Since there is more than one possible
result for this query in the real world, it is likely
to be a category query with a location
modifier. All airports within the queried locality
should be rated as Excellent.

The address is correct without a street

number and street name because this is a POI
without an expected address so a locality and
postal code are appropriate. The pin is
Perfect because it lands on the airport’s
rooftop.

[airport
berlin] Relevance Excellent
Name Accuracy Correct
Address Accuracy Correct
Pin Accuracy Perfect
Berlin Schönefeld Airport
12521 Berlin, Germany
Category: Airport
There are two equally prominent airports in
Berlin. Since there is more than one possible
result for this query in the real world, it is likely
to be a category query with a location
modifier. All airports within the queried locality
should be rated as Excellent.

Tu The address is correct without a street m IP s

17 esda o ver
fris
number and street name because this a POI
2.1 y, 0 2 4
l De
6.2 Ap without an expected address so2, a locality
2 a e and
54 ril 2 il Mich
rThe
.6
by , 202 postal code are appropriate. p
A by pin is
Perfect because it lands y,on
es .254 the airport’s
Mi a .6
cha 4 fro u
d
el D m I rooftop. T .16
eve P 172
rs

244
10.7.8. Clear Categories
IP
When a query is clearly for a straightforward
ro m rs
f eve category, results must also belong to that category
2 4 D
2 , 20 hael Tu
l c
Query pri y Mi Results Ratings
1 es and Explanation
a y A
, 6b
.
72.1 day,
54 a Navigational Result for this Query? 6.25 ApNo
esdIs there
Tu .16.2 4.6 ril 2,
172 by 202
Relevance BadMi (User
cha 4 frIntent)
el D om I
Name Accuracy Correct ev P
ers
Sephora
2855 Stevens Creek Blvd, Address Accuracy Correct
Santa Clara, CA 95050 Pin Accuracy Approximate
Category: Beauty Supplies
[mall] The query intent is for a mall. The result is a
store inside Westfield Valley Fair mall and is
User and fresh within the viewport. Since the query is a
viewport in category and the result is a specific store,
Santa Clara, CA which the user did not ask for, rate Bad due to
user intent. If the result had been the entire
mall, the result would be rated Excellent.

The name and address can be confirmed on

the official website. The pin is Approximate
because it does not land on Sephora's location
(shown in green) according to the mall’s official
map.
Is there a Navigational Result for this Query? No
Relevance Bad (User Intent)
Name Accuracy Correct
Terminal 8 Address Accuracy Correct
JFK International Airport
Queens, NY 11430 Pin Accuracy Perfect
Category: Airport
[airports]
The result is a terminal that's part of JFK
User and fresh
International Airport. Since the query is a
viewport in
category and the result is a specific terminal
New York, NY
and not the airport itself, rate Bad due to user
Tu intent. IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap The name and address can be iconfirmed2, e
ha on
54 ril 2 r l Mic
.6 p
the official website. The pin, Ais Perfect because
by , 202 y .6 by
Mi a
cha 4 fro it lands on one of the rooftops
es .25 of Terminal 8
d 4
el D m I Tu .1airport
according to the official 6 map.
eve P 172
rs

245
10.7.9. Soft Categories
IP
Some category queries are straightforward ro m rs and may have results that satisfy an intent exactly, like
f eve
[italian restaurant]. However, 0 2 4 sometimes
D categories are very small or have multiple interpretations,
so several different types l of
2 , 2results
c h ael could satisfy the user’s intent.TThese are called “soft categories.”
ri i u
, Ap by M 17 esda
y 2 .16 y, A
sda 254.6will produce a variety of results, each of which
These categoryuequeries .2could
54 prisatisfy the query intent
T .16. . 6 l2
to a greater or 1lesser
72 degree. How well a result satisfies a category query will by vary
, 2 depending on the
Mi 024
services typically offered by the result entities in that market and the customs of chthe fspecific market.
ael rom
De IP
ver
It’s often difficult to define which businesses or chains belong in any one soft category, so s you’ll have
to research the individual results provided to make your rating decisions. For instance, the query [ski
shop] is very specific and is associated with the more general Sporting Goods category.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

246
 Query User and Viewport
IP
[ski shop] m s User and fresh viewport in Denver, Co
4 fro ever
0 2 D
User Intent: The user ris , 2 haelfor places that sell ski clothing and
i l 2looking
ic Tu equipment. Any store that
es
carries such items yis p M 1
a , consider
A
6 b y primary intent. 72.1 day,
. 6.2 Ap
esd 54 54 ril 2
Tu .16.2
Is there a Navigational Result for this Query? No .6
172 by , 202
Mi
cha 4 fro
el D m I
eve P
rs

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

247
 Results Ratings and Explanation
IP
ro m rs Relevance Excellent
① Meier Skis 0 2 4 f Deve
,2 el
970 Yuma St, Suite 190ril 2 icha Name Accuracy Tu Correct
Denver, CO 80204
p
, A 6 by
M 17 esda
y 2.1 y,
a . Address Accuracy 6Correct
.25 Apri
esd .254
Category: SkiTuEquipment 4.6 l 2,
.16 Pin Accuracy Perfect
by 202
172 Mi
cha 4 fro
el D m I
eve P
rs

Business is a shop dedicated to skiing, which would

satisfy the primary intent of this category.

Relevance Good (User Intent)

② Patagonia
1431 15th St Name Accuracy Correct
Denver, CO 80202
Address Accuracy Correct
Category: Sports Wear
Pin Accuracy Perfect

Stores that sell ski clothing would be considered

secondary intent for the category query [ski shop].

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

248
 Query Results Ratings and Explanation
IP
Is there a Navigational m s Result for this Query? No
4 fro ever
0 2 D
,2 el
r i l 2 icha Relevance Tu
esd
Excellent
A p yM 1 7
, b 2.1 ay,
e s day 54.6 Name Accuracy 6.2 ApCorrect
6.2
Tu .1Riva's 54 ril 2
Italian Restaurant .6
172 1117 Missouri St by , 202
Address Accuracy Correct Mi
cha 4 fro
Houston, TX 77006 el D m I
P
Category: Italian Pin Accuracy Perfect evers

The most likely user intent for this query is

Italian restaurants. This result satisfies the
user’s intent.

Cafe Dolce Gelato Relevance Good (User Intent)

5135 W Alabama St, Ste 7315
Houston, Texas 77056 Correct
Category: Ice Cream Name Accuracy

Address Accuracy Correct

[italian] Pin Accuracy Approximate

User and fresh

viewport in
Houston, TX
An Italian ice cream café is mostly likely a
secondary intent for this query.
IP
Tu The official mall map shows the exact location o m rs
17 esda r
f eve
2.1 y, of the cafe. The pin lands on another 24part of
6.2 Ap , 20
a el D
54 ril 2 the mall and is rated Approximate. l 2 c h
.6
by , 202 A pri y Mi
Mi ,
ay .6 b
cha 4 fro uesd .254
el D m I T .16
eve P 172
rs

249
 Query Results Ratings and Explanation
IP
Prada Houston o mGalleria
s
4 f ever
r
Relevance Bad (User Intent)
5015 Westheimer, 2 D
2 , 20 hael Ste 2285A Tu
Houston,ri Texas
l i c 77057 17 esda
y , Ap by M Name Accuracy
2.1 y, Correct
Category:
a .6 Accessories 6.2 Ap
uesd .254 54 ril 2
T .16 .
172 Address Accuracy 6 bIncorrect
,
y M 2024 – Postal Code
ich fro
ae m
Pin Accuracy Perfect l Dev IP
ers

An Italian clothing store is an unlikely intent for

this query.

The name is Correct, but the postal code

should be 77056.

The official mall map shows the exact location

of the store. The pin lands on this location and
is rated Perfect.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

250
10.7.10 Category Query: Parking
IP
"Parking" generally refers to: ro m rs
0 2 4 f Deve
,2 el
• Parking lots r i l 2 icha Tu
• Parking garages
p
, A 6 by
M 17 esda
a y . 2.1 y,
• esd 54
Parking udecks 6.2 Ap
T .16.2 54 ril 2
.6
172 by , 202
Mi
cha 4 fro
el D m I
Example eve P
Query Results Ratings and Explanation rs
Type
Is there a Navigational Result for this Query? No
Relevance Excellent
Parking
123 O’Farrell St, San Francisco, CA Name Accuracy Partially Correct
94102 (Name Issue)
[parking] Category: Parking Garage Address Accuracy Correct
Specific User and Pin Accuracy Perfect
Parking viewport in
San
Francisco, Research reveals that the official name
CA for this parking location is Ellis-
O'Farrell Garage. Since an official
name exists, the generic name
“Parking” is demoted to Partially
Correct.

Is there a Navigational Result for this Query? No

Parking Relevance Excellent
121 Spear St, San Francisco, CA
Name Accuracy Correct
[parking] 94105
Category: Parking Garage Address Accuracy Correct
User and
Generic fresh Pin Accuracy Perfect
Parking viewport in
San
Francisco, This result is the parking garage for
CA the Rincon Center, which does not
have a specific name according to
Tu official resources. Accept the generic IP
o m rs
17 esda name “Parking” as Correct.24 f Deve
r
2.1 y, 0 l
6.2 Ap
54 ril 2 i l 2, 2 ichae
.6
by , 202 pr M
Mi a y, A 6 by
cha 4 fro esd 54
.
el D m I Tu .16.2
eve P 172
rs

251
Example
Query IPResults Ratings and Explanation
Type m s
ro r
2 4 f Deve
Is, there
2 0 ela Navigational Result for this Query? No
r i l 2 icha Tu
p
, A 6 by
M 17 esda
Relevance Excellent
a y . 2.1 y,
d 4 6 A
es 5 Rincon Center .25 pri
Tu .16.2 Name Accuracy4.6 l 2, Correct
1 7 2 121 Spear St, San Francisco, CA by 202
M 4f
94105 Address AccuracyichaCorrectr
el D om I
[parking] Category: Parking Garage eve P
Pin Accuracy Perfect rs
User and
Paid vs. fresh
free viewport in This result is the parking garage for
San the Rincon Center. It’s a parking
Francisco, garage accessible to the public for a
CA fee. Free and paid parking are equally
relevant. There should be no relevance
demotion if the parking lot/garage
requires payment and the query does
not specifically ask for free parking.

Is there a Navigational Result for this Query? No

Relevance Excellent
Name Accuracy Correct
Parking
3705 El Camino Real, Santa Clara, Address Accuracy Correct
[parking CA 95051 Pin Accuracy Perfect
free] Category: Parking

User and
The query specifically requests free
Paid vs. fresh
parking, so the results should reflect
free viewport in
Santa the user’s request. This parking lot is
Clara, CA free and should be rated as Excellent.

If the result were a parking lot that

requires payment, then the correct
relevance rating would be Bad, as it
does not satisfy the user’s intent.
Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

252
Example
Query IPResults Ratings and Explanation
Type m s
ro r
2 4 f Deve
Is, there
2 0 ela Navigational Result for this Query? No
r i l 2 icha Tu
p yM
, A 6 Stevens
b 17 esda
Creek Parking Garage Relevance Excellent
a y . 2.1 y,
d 5 2899 Stevens Creek Blvd, San
4 6 A
es .25 pri
Tu .16.2 Jose, CA 95050 Name Accuracy4.6 l 2, Correct
1 7 2 by 202
M 4f
Category: Parking Address AccuracyichaCorrectr
[parking] el D om I
Affiliate Pin Accuracy eve P
Perfect rs
parking User and
that has a Fresh
specific Viewport
name in San
Jose, CA The name of the parking garage can
be confirmed on the official site of the
POI to which it belongs, therefore the
name is Correct.

Is there a Navigational Result for this Query? No

Relevance Excellent
Hamilton/Waverly Lot Name Accuracy Correct
375 Hamilton Ave, Palo Alto, CA
94301 Address Accuracy Correct
[parking] Category: Parking
Pin Accuracy Perfect
Generic User and
fresh
Parking
viewport in
Palo Alto,
CA The name of the parking lot can be
confirmed on the official site of the
city of Palo Alto.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

253
Example
Query IPResults Ratings and Explanation
Type m s
ro r
2 4 f Deve
Is, there
2 0 ela Navigational Result for this Query? No
r i l 2 icha Tu
p yM
, A 6 bParking 17 esda
Relevance Excellent
a y . 2.1 y,
d 5 San Francisco, CA United States
4 6 A
es .25 pri
Tu .16.2 Name Accuracy4.6 l 2, Correct
1 7 2 Category: Parking by 202
M 4f
Address AccuracyichaCorrectr
el D om I
[parking] Pin Accuracy eve P
Perfect rs
User and
fresh
Airport This result refers to the parking lot of
viewport in
Parking San Francisco International Airport.
San
Francisco, The generic name “Parking” is
CA considered Correct. Pin must be
dropped on the SFO parking lot. This is
a POI without an expected address so
just a locality is appropriate and rated
Correct without a street number and
street name.

Is there a Navigational Result for this Query? No

Parking Relevance Bad (User Intent)
3600 Flora Vista Ave, Santa Clara,
CA 95051 Name Accuracy Correct
[parking] Category: Parking Address Accuracy Correct
Private vs. Pin Accuracy Perfect
User and
public
viewport in
parking
Santa
Clara, CA The result in this example is a
residents-only parking lot. This should
be rated Bad because the lot is not
useful for the general public.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

254
10.8. Rating Results with PERMANENT_CLOSURE Status
IP
When rating results whose status o m PERMANENT_CLOSURE,
is s be sure to understand whether the
4 f ever
r
results are expected or unexpected. 0 2 D For more information on the differences between expected and
2 , 2 hael Tu Status is
unexpected results, see prisection
l
Mi 5.19. Rating Relevance When Result
c es
1
PERMANENT_CLOSURE. a y A
, 6b
.
y 72.1 day,
esd 54 6.2 Ap
Tu .16.2 54 ril 2
.6
10.8.1. Expected.
172 PERMANENT_CLOSURE Status by , 202
Mi
cha 4 fro
When a result with PERMANENT_CLOSURE status is expected, choose the Business/POI el D m I is closed
eve P
or does not exist checkbox and rate as if the location were open. rs

Query Results Ratings and Explanation

Is there a Navigational Result for this Query? Yes
Relevance Navigational
Business Closed/does not
Yes
Gaslight Grill exist
PERMANENT_CLOSURE Name Accuracy no ratings needed
[gaslight
5020 W 137th St, Overland
grill]
Park, KS 66224 Address Accuracy no ratings needed
Fresh Pin Accuracy no ratings needed
viewport in
Kansas City, Research shows that the result for this navigational
KS query is permanently closed, and it displays the
status PERMANENT_CLOSURE. Showing this closed
result is expected since no other result can be
returned in the area of location intent.

Select Business is closed or does not exist and

rate the business as if it did exist. No further POI
data rating will be needed.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs
10.8.2. Unexpected PERMANENT_CLOSURE Status
IP
When many branches of a chainfare rom available
s in the area of intent, we would not expect to see any
4 e ver
locations with a status of PERMANENT_CLOSURE,
2 D whether that status is correct or not.
2 , 20 hael Tu
l c
pri y Mi 1 es
A
, Query b 72.1 dand
User
ay
e s a y
d 54 . 6 6.2 , ApViewport
Tu .16.2 54 ril 2
.6 ,2
172 [mcdonalds] User and fresh viewportbin y MSunnyvale,
02 CA
ich 4 fro
ael m
De IP
ver
s

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

256
 Suggestion Rating and Explanation
IP
om vers
frRelevance Acceptable
2 4 De
,2 0 el
r i l 2 icha Business/POI closed/ T
Yes 1 uesd
① McDonald's A p yM does not exist 7
, b 2.1 ay,
PERMANENT_CLOSURE
e s day 54.6 6.2 Ap
Tu .16.2 54 ril 2 by research) has
This permanently closed restaurant (confirmed
615 N Mathilda7Ave, .6
1 2 b , 202
its status set to PERMANENT_CLOSURE. ItyisMconsidered
Sunnyvale, CA 94085 ich 4 fro
unexpected because there are many other locations ael m of this chain
I
in the area. This means the highest rating it can getDis
eve P
r
Acceptable. Name, address, and pin will not be rated. s
Relevance Excellent
Business/POI closed/
No
does not exist
② McDonald's Name Accuracy Correct
550 Lawrence Expy,
Sunnyvale, CA 94086 Address Accuracy Correct
Pin Accuracy Perfect
This open chain location is among the closest to the user and
rated Excellent.
Relevance Acceptable
Business/POI closed/
No
does not exist
Name Accuracy Correct
Address Accuracy Correct
Pin Accuracy Perfect

⓷ McDonald's
PERMANENT_CLOSURE
556 E El Camino Real, This chain location is showing a status of
Sunnyvale, CA 94086 PERMANENT_CLOSURE. Research shows that it is, in fact, open.
Its relevance is rated independent of whether it is really open or
closed in the real world. The result is considered unexpected and
rated Acceptable.
Tu IP
17 esda Do not mark this result as Business/POI closed/does not f r exist,
o m rs
ve
2.1 y, 24 l De
and continue rating the result for relevance plus name,20address,
6.2 Ap 2, ha
e
54 ril 2
.6 and pin details. p ril Mic
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs
257
 Suggestion Rating and Explanation
IP
om vers
frRelevance Good (Distance)
2 4 De
,2 0 el
r i l 2 icha Business/POI closed/ T
Yes 1 uesd
A p yM does not exist 7
④ McDonald's day, 4.6 b 2.1 ay,
e s 5 6.2 Ap
6.2
Tu .1Real,
1082 E El Camino 54 rilto
The chain location does not exist according 2 official resources
.6
72 b , 202
Sunnyvale, CA194087 and should be rated as Business is closedy M or does not exist.
ich 4 fro
The result does not show the status as PERMANENT_CLOSURE,
ael m
IP
De given
so it should be rated as if it were open, which is Good ver the
distance. s

10.9. Other Query Types

Queries can sometimes be less obvious or even ambiguous.

10.9.1. Routing Queries

When a query mentions two distinct locations that are not near each other, the user was likely looking
for driving directions, so returning either of the two distinct locations used for the route is the best
experience Search can offer. Each location should be rated Excellent for Relevance.

Query Results Ratings and Explanation

Is there a Navigational Result for this Query? No
Relevance Excellent
Name Accuracy n/a
Oxford Address
Oxford, United Kingdom Correct
Accuracy
Category: n/a
Pin Accuracy Perfect

The query includes two separate locations,

which are very far away from each other, so
the user was likely looking for routing
Tu directions. Returning either of the individual IP
o m rs
17 esda locations is expected and should be r
24 rated
f eve
2.1 y,
6.2 Ap Excellent. 2 , 20
a el D
54 ril 2 l c h
[66 Chandos
.6
by , 20 A pri y Mi
,
ay .within b
Pl, London Mic 24 f The pin should be dropped 6 the
ha rom u esd .254
WC2N 4HG el D I boundaries of theTresult
.1 6 locality.
Oxford] eve P 172
rs

258
 Query Results Ratings and Explanation
IP
ro m rs Relevance Excellent
66 Chandos 0 2 4 fPlDeve
,2 el
66 Chandos
r i l 2 ichaPl Name Accuracy
Tu n/a
p M
, A 6 byWC2N 4HG 17 esda
aLondon
y . 2
Address .16.2 y, Ap
esd .254 54 Correct
r
Tu .16Category: n/a Accuracy .6 il 2, 2
2 by
1 7 Mi 024
Pin Accuracy Perfectcha fro
el D m I
P
eve locations,
The query includes two separate rs
so the user was likely looking for routing
directions. Returning either of the individual
locations is expected and should be rated
Excellent.

The pin should be dropped on the address

provided in the result.

Is there a Navigational Result for this Query? Yes

Oxford Relevance Navigational

Oxford, United Kingdom
Name Accuracy n/a
Category: n/a
Address
Correct
Accuracy
[route to
Oxford] Pin Accuracy Perfect

This routing query contains only one

location.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs
259
10.9.2. Coordinate and “My Location” IP Queries
ro m rs
0 2 4 f Deve
,2 el
i l 2 icha Tu
Note: Results for coordinate
p y M and ‘’my location” queries (or any variation
r 1 es of these, like “current
location,” “where I y A
, 6b
am,” and so on) are rated differently from the
72.1 daresults
other y, A
a
esd .254
. 6.2
5 pri described in these
guidelines. Please
T .16read this section carefully.
u 4.6 l 2,
1 7 2 by 202
Mi
cha 4 fro
el D m I
Pin and Relevance are rated separately using a 50m radius around the queried coordinates eve P or the
user location (for “my location” queries): rs
• Relevance:
• A result that exists and is within the 50m radius is rated Excellent.
• A result that does not exist or is outside of the 50m radius is rated Bad.
• There will be no Navigational results.
• Pin Accuracy:
• A pin that falls within 50m radius is rated Perfect.
• A pin that falls outside the 50m radius is rated Wrong.
• Name and Address Accuracy:
• Rate the name and address accuracy according the regular guidelines.

The graphic below gives an overview. These concepts are explained further on the following pages.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

260
 IP
ro m rs
If no result can be found 0within ve
4 f De50m, then the closest address or street up to 100m away
2 2 l
will be accepted. Ifilno e
address or street can be found within
2 , h a Tu 100m, depending on the
r Mic esd
,market,
A by a locality or sub-locality will also17be 2.1 accepted.
p ay
a y
d 54 . 6 6.2 , Ap
e s 54 ril 2
Tu .16.2 .6
172 by , 202
Mi
cha 4 fro
Query Pin Rating and Explanation el D m I
eve P
rs

Draw an imaginary circle with a 50m radius around the

user’s location. Rate any pin inside the circle Perfect and
any pin outside the circle Wrong.

Draw an imaginary circle with a 50m radius around the

queried coordinates. Rate any pin inside the circle Perfect
and any pin outside the circle Wrong.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs
261
 Results Relevance Rating and Explanation
IP
m s
4 fro ever
2 D
2 , 20 hael Tu
l c
A pri y Mi 1 7
esd
y , 6b Use an imaginary circle with2a.1 50m ay radius around the queried
s a
d 54 . 6.2 , Ap
e
Tu .16.2 location to rate relevance. A result 54thatrilhas any part of its
.6 2,
1 7 2 Perfect area within the circle is rated Excellent.
b y M 24 If a result
2 0
does not have any Perfect area inside theiccircle, ha frorate Bad.
el D m I
eve P
The Perfect area usually refers to the rooftop or section rs of the
rooftop, but can include the parcel for parks and other
features rated perfect for the parcel.

Result Relevance Rating and Explanation

1: 3495 El Camino Real Part of the POI is inside the

Excellent
Santa Clara, CA 95051 50m radius

2: 3530 El Camino Real

Part of the POI is inside the
Santa Clara, CA 95051 Excellent
50m radius

The street is inside the 50m

3: El Camino Real (street name) Excellent
radius
4: United Furniture Club
No part of the POI is within
3503 El Camino Real Bad
the 50m radius
Santa Clara, CA 95051
5: 3482 El Camino Real Unit B Research shows this address
Bad
Santa Clara, CA 95051 does not exist

Note that the pin and result title do not need to match. For example, if a result for United Furniture
Club is returned, but the pin is placed at the queried coordinates or user location, the Relevance
Rating will still be Bad, but the pin rating will be Perfect even though it is far from United Furniture’s
location.

10.10. Unclear Results

ThereTu may be times when it is difficult to determine exactly what the result is because the business IP
e r o m rs
name
17 can’t f eve
2.1 day, be identified with certainty or the business does not correspond with the given 24location
s
and it cannot
6.2 A pbe confirmed as closed. When this happens, use all provided information 2 , 2 0
(including
a el D
54 r il 2 l ic h
information .6that
by is , 2not rated, such as URL and phone number – never call a business) A pri toy Mreach a
Mi 24 0 ,
y .6 b
conclusion. cha fro es da
54
el D m I Tu .16.2
If there is a tie in the evidence eve P or you are rating Search Relevance only, rate 2
17Business/POI is closed/
rs
does not exist, then rate relevance as if the entity did exist.

262
 IP
ro m rs
0 2 4 f Deve
Query , 2 ael
r i l 2 ichResults Ratings
Tu
e
and Explanation
p
A by M 17 s d
dIs
a y,there
4 . 6 a Navigational Result for this Query?2.16 ay, ANo
es 5 .25 pri
Tu .16.2 4.6 l 2,
7 2 Caribou Coffee Relevance Excellent
by 202
1 Mi
227 West Market cha 4 fro
Bloomington, NM 55425 Name Accuracy Correct el D m I
eve P
Category: Coffee Shop rs
Incorrect – Street
Address Accuracy Number and Street
Additional info: Name
URL: cariboucoffee.com
Phone: 1-952-854-7828 Pin Accuracy Perfect
[caribou]
The result name and URL are pointing to a
User and fresh
Caribou location. The address listed belongs
viewport in
to the Nike store located in the same
Bloomington,
shopping center. There are multiple Caribou
NM
Coffee locations inside the Mall of America
but the phone number belongs to the store on
60 East Broadway S-380 per official
website or 380 South Ave per mall website.
The pin is located in the same area as shown
on the mall website. Because a business with
the same name and phone number is found in
the immediate surrounding area, we will
consider the address incorrect for this result.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs
263
 Query Results Ratings and Explanation
IP
Is there a Navigational m s Result for this Query? No
4 fro ever
0 2 D
,2 el
r i l 2 icha Relevance Tu
esd
Excellent
A p yM 1 7
ay, 4.6 b 2.1 ay,
dPottery Name Accuracy 6.2 ACorrect
e s 5 Barn 54 pril 2
Tu .16.2 .6
1350 Fashion Valley Rd, San by , 202 – Street
Incorrect
172 Mi
Diego, CA 92108 Address Accuracy Number cha 4and
fro Street
e m
Category: Furniture Store l
Name Dev IP
ers
[furniture Additional info: Pin Accuracy Approximate
store] URL: www.potterybarn.com
The result name and URL point to a Pottery
Phone: 1-619-296-8014
User and Fresh
Barn location. The address listed is
San Diego, CA associated with a nearby business, Wells
Fargo Bank. After researching the nearby
area, a Pottery Barn with the same phone
number as our result is found at 7007 Friars
Road, San Diego, CA 92108, within the
Fashion Valley Mall. The pin lands on the
Fashion Valley Mall. Because a business with
the same name and phone number is found in
the immediate surrounding area, consider the
address incorrect for this result.
Is there a Navigational Result for this Query? No
The Lot Bar Relevance Excellent
2333 S St
Sacramento, CA 95816 Name Accuracy Incorrect (Name Issue)
Category: Dive Bar Address Accuracy Correct

[bar] Additional info: Pin Accuracy Perfect

Phone: 1-916-451-4682
User and Fresh Research on the result information shows that
Viewport in the address belongs to Round Corner Tavern.
Sacramento, CA The result phone number also belongs to the
Round Corner Tavern and the pin is located at
the result address. Finally, there is no ‘Lot Bar’
located in the immediate area. Because all
result information except for the name listed
points to the Round Corner Tavern, we will
consider the name incorrect for this result.IP
Tu m s
17 esda 4 fro ever
2.1 y, 2 D
6.2 Ap
54 ril 2 2 , 20 hael
l c
.6
by , 202 A pri y Mi
Mi ,
ay .6 b
cha 4 fro uesd .254
el D m I T .16
eve P 172
rs

264
 Query Results Ratings and Explanation
IP
Is there a Navigational m s Result for this Query? No
4 fro ever
0 2 D
Holiday , 2 hael
i l 2 Inn c Business/POI Tu is closed/does not
!
300 A
r
pN Harbor
y Mi Drive exist 1 7
esd
a
y ,
a 4.6 b 2 .16 , A y
u esdRedondo
. 2 5 Beach, CA 90277 .25 pri
6
T .1Category: Hotels and Events Relevance 4.6 Excellent
l2
,
1 7 2 b y M 2024
Use all the information provided ich fro, even
Additional Info: ael m
information that's not rated, like DeURL
v
IP and
URL: http://www.ihg.com/ phone number, to research the result. e rs
holidayinn
Phone: 1-310-750-1149 In this case, research shows that the address
belongs to a Crowne Plaza Hotel, not a
Holiday Inn. Street imagery also shows that
[holiday inn] this building is a Crowne Plaza.

User and fresh The result phone number does not belong to
viewport in Santa any business and the given URL does not
Ana, CA point to any particular Holiday Inn.

Investigation of the surrounding area shows

that there is no Holiday Inn in Redondo Beach,
so this is not a case where the business has
been misplaced and the result contains an
incorrect street name or number.

Because the result information does not

overwhelmingly point to a Holiday Inn at this
location, rate the result Closed/Does not
exist.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs
265
 Query Results Ratings and Explanation
IP
m s
4 fro ever
Is there a 0Navigational Result for this Query? No
2 2 lD
, a e
l 2 ch Tu
pri y Mi 1 es
Santa’s
a y , 6 b Professional Dog
A
. Relevance
72.1 day, Excellent
esdGrooming
54 6.2 Ap
Tu .16.2 54 ril 2
603 Manley St, North Pole .6
172 by , 202
Mi
AK, 99705 Name Accuracy cha 4 fr(Name
Incorrect Issue)
Category: Pet Services el D om I
eve P
rs
Additional info: Address Accuracy Correct
Phone: (907) 480-9701
URL: http:// Pin Accuracy Perfect
www.paulasprofessionaldoggroo
ming.com/
Use all the information provided , even
information that's not rated, like URL and
phone number, to research the result.
[santa's dog
grooming] Here, research shows that the address, url,
and phone number belong to Paula’s
User and fresh Professional Dog Grooming. Since the
viewport in North evidence points to Paula’s business actually
Pole, AK existing at this location, the name Santa’s
Professional Dog Grooming is considered
Incorrect.

When rating relevance, ignore all data issues

and rate the result as if the name and
category were correct. Because of the match
between the query and the incorrect name,
and how near the user is to the result in the
fresh viewport, this result is rated Excellent.

When rating other results, treat this one as

closed/does not exist and don’t demote the
relevance of other, more distant, results. This
is so that a valid result that’s farther away
won’t be demoted solely due to this naming
error.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

266
 Query Results Ratings and Explanation
IP
Is there a Navigational m s Result for this Query? No
4 fro ever
0 2 D
,2 el
r i l 2 icha Business/POITu is closed/does not
es !
p yM exist 1
a y A
, 6b
.
72.1 day,
esd .254 6.2 Ap
ril
54 Excellent
Tu .1Shell
6 Relevance . 6 2
172 1221 S Main St, Wildwood, FL by , 202
Mi
cha 4 fro
34785 el D m I
Category: Gas Station eve P
rs
Additional info:
URL: www.shell.com
Phone: 1-352-748-6199 There are two gas stations in the immediate
area:

Mobil (purple pin)

1221 S Main St
Wildwood, FL 34785
Phone: 1-352-748-6199

Shell (red pin)

1001 S Main St
[gas station] Wildwood, FL 34785
User and fresh Phone: 1-352-748-8903
viewport in
Wildwood, FL
The result contains conflicting information
from two nearby businesses. The result name
and URL point to a Shell gas station a little
north of the result address listed, while the
result address and phone number point to a
Mobil gas station. If, after researching all of
the given information for a result no clear
consensus of what the result is pointing to
can be made, the result should be rated as
Closed/Does not exist.

You will still need to rate relevance as if the

business were open. The result matches the
query intent and is within the fresh viewport.
The result should receive a rating of
Excellent. IP
Tu o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs
267
 Query Results IP Ratings and Explanation
ro m rs
f e v e
Is there a , 2 024 el D
Navigational Result for this Query? No
l 2 ich a Tu
r i
Dinosaur
p
, A 6 by Inc
M 17 esisdaclosed/does not
Business/POI
a y
d8655 4 . 2.1 y,
6.2 Ap !
u e s
. 2 5 Jones Rd exist 5 4.6 r i l
T .16 2
Houston,TX77065 by , 202
172 Relevance Excellent
Mi
cha 4 fro
Additional info: el D m I
Research on the result information eve Pshows
Phone: 1-281-531-6500 that the address belongs to Trailsrat s
Category: n/a Corinthian Creek Apartments. The result
[dinosaur]
phone number belongs to a different
User and large apartment complex, Domain West
fresh viewport in Apartments. Finally, there is no evidence that
Texas the business Dinosaur Inc exists. Based on
the information listed, rate the result as
Closed/Does not exist.

You will still need to rate relevance as if the

business did exist. The result matches the
query intent and is within the large, fresh
viewport. The result should receive a rating
of Excellent.
Is there a Navigational Result for this Query? No
Business/POI is closed/does not
Lowongan Guru Kimia SMA SMU !
exist
Di Jakarta
[Salon di jalan Jalan Danau Sunter Utara No. 1 Relevance Bad (User Intent)
tebet timur Tanjung Priok
dalam raya DKI Jakarta 14350 The query is for a category with a specific
jakarta Indonesia location modifier. The result is for a job
selatan] Category: Education opening which does not satisfy the intent and
is not indicative of a POI. There is a
Translation: Result Title Translation: possibility the result is for a particular high
[Salons in [Job Opening for High School school, however, the result address is not
Jalan Tebet Chemistry Teacher in Jakarta] tied to any high school and no specific
Timur Dalam Additional info: school is named in the result title. Since the
Raya, Jakarta Lat/long: -6.13799,106.86598 result data is ambiguous and does not
Selatan] or represent a single POI this entity should be
[Category, rated Closed/Does not exist.
Street
Tu Name, IP
o m rs
1City
72 sName]
ed You will still need to rate relevance 4asf if the
r ve
.16 ay, A business were open. The user's, 2intent 02 el isDefor a
.25 pri 2 icha
4.6 l 2, Salon on a specific street. The pril result does
by 202 , Ashould
b yM
Mi not match this intent and a y 6 be rated as
cha 4 fro e sd 254.
el D m I Bad. u
T .16 .
eve P 172
rs

268
11. Top Rating Tips
IP
ro m rs
Solutions to the most common4rating f evdilemmas.
e
0 2 D
,2 el
r i l 2 icha Tu
esd
11.1. What’s the relevance p y Mwhen query is business/POI name
2and aaddress and the result is
A
, 6b 1 7
a y . . 1 y, A
only the address?
es d 5 4 6 .25 pri
Tu .16.2 4.6 l 2,
1 7 2 by 202
When a user types in the name of a business or a POI along with its address, they Mi expect
cha 4 fro to see the
business mentioned in the query as part of the result. If the result is the address alone m does not
el D and IP
mention the business, the user cannot be certain that the query and the result refer to the ever same thing.
s
This is why the result’s relevance is Bad.

Address and pin accuracy can be rated as usual.

Query Results Ratings and Explanation

800 North Point Relevance Bad (User Intent)
800 North Point St, San Francisco,
California 94109 Name Accuracy n/a
[Gary Danko Category: New American Cuisine Address Accuracy Correct
800 North
Point St, San Pin Accuracy Perfect
Francisco, Result is for the address and not the
California business stated in the query, so the user
94109] cannot know whether or not the query and
result refer to the same thing. This is why the
result’s relevance is Bad.

11.2. What’s the relevance when the query is a street name and the result is a single
business on that street?

A query for an entire street is very broad. When the result is just one business or one address on that
street, it is too specific to satisfy the broad intent of the query.

Name, address, and pin accuracy can be rated as usual.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs
269
 Query Results Ratings and Explanation
IP
Happy Lamb fHot rom Pot
ver
s Relevance Bad (User Intent)
2 4 De
19062 Stevens , 20 haelCreek Blvd
Cupertino,
ri l 2
CA,
i c 95014 Name Accuracy
Tu Correct
, Ap by M 17 esda
y
Category: Hot Pot 2.1 y,
a .6 Address Accuracy
6.2 Ap Correct
uesd .254 54 ril 2
T .16 .6 ,2
172 Pin Accuracy byPerfect
Mi 024
[Stevens cha fro
Creek Blvd] el D m I
P
eve street.
The result is for a business on the rs
When the query is for a street, returning a
single business is too specific a result for the
broad query.

11.3. How do I know what the location intent is when user is outside/inside a fresh viewport?

When a viewport is fresh, the location intent for results depends on whether the user is inside or
outside the viewport:

• When a user is inside the viewport, that user’s location is the location intent

• When a user is outside the viewport, results are expected in or near the viewport, no matter
how near or far the user is from that viewport.

Viewport User Location Intent

When the user is within a fresh viewport, take the user
location as location intent. Results are generally expected in
Inside Viewport
or near the viewport, and results inside the area cannot be
rated Bad because of distance alone.

Fresh Results are expected in or near the viewport area. If no results

Outside
can be found in or near the viewport, use the user location as
Viewport
a secondary location intent.

When the user is missing, the viewport remains the location

Missing
intent. IP
Tu o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

270
11.4. How do I know what the location intent is when user is outside/inside a stale viewport?
IP
ro m rs
ve
4 f Delocation
When a viewport is stale, the 0 user’s
2 is considered the location intent for the results whether
2 , 2 hael Tu
the user is inside or outside l
pri y M the
i viewport
c es
1
a y A
, 6b
.
72.1 day,
esd 54 6.2 Ap
ViewportTu .16.2 User 4.6 ril 2,
Location 5Intent
172 by 202
Mi
Inside Viewport cha 4 fro
m
When the viewport is stale, consider only theel user De location
IP as
Outside v e
location intent. rs
Stale Viewport
Use the stale viewport as location intent when the user
Missing
location is missing.

11.5. This full address result does not exist. How do I rate it?

An address type result needs to be associated with a building or officially assigned to a plot of land in
order to be useful to a user. Sometimes your research will show that a queried address simply does
not exist. In cases like, this you’ll see one of three types of results:

• The closest verified address (on the same street, in the same city and state): Rate
relevance as Excellent.
• The same address as the query address: Rate relevance as Excellent and address as
Incorrect – Address does not exist. The pin will be rated Can’t Verify.
• The queried street without a street number: Rate relevance as Acceptable.

When a queried address does not exist, the answer to the question “Is there a navigational result for
this query” will always be No.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs
271
 Query Results Ratings and Explanation
IP
Is there a Navigational m s Result for this Query? No
4 fro ever
0 2 D
,2 el
[2001 Duncan 1099 r l 2 icha St
Duncan
i Relevance Tu
esd
Excellent
1099A p Duncan
y M St., San 1 7 a
St, San ay, 4.6 b
dFrancisco,
2
Name Accuracy.16.2 y, An/a
e s
Francisco]Tu 16.2 5 94131, CA 54 pril 2
.6
.
172 Category: n/a Address Accuracy by , 202
Correct
Mi
cha 4 fro
Pin Accuracy Perfect el D m IP
eve
rs
If 2001 does not actually exist then selecting
1099, the closest number that does exist, is
considered correct. For a locale that uses the
rule of even numbers on one side of the street
and the odd numbers on the other, we need to
return the closest existing address on the same
side of the street as the query. If the rule of
odds and evens does not apply then the
closest numeric number will be considered
correct.
The pin has to be correctly dropped on the
address presented in the result.

2001 Duncan St Relevance Excellent

2001 Duncan St., San Name Accuracy n/a
Francisco, 94131, CA
Category: n/a Incorrect – Address
Address Accuracy
does not exist
Pin Accuracy Can’t Verify
Duncan Street only goes up to number 1099,
but the query requests a non-existent number.
The result returned is the same as the queried
address and should be rated as Excellent.
The pin rating for addresses that do not exist is
Can’t Verify.

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

272
 Query Results Ratings and Explanation
IP
Duncan St from vers Relevance Acceptable (User Intent)
4 De
02San
Duncan St, Francisco,
2 , 2
h ael Name Accuracy Tu n/a
94131, ri CA i
l c
, Ap by M 17 esda
Category:
y n/a 2.1 y,
a .6 Address Accuracy 6.2 ACorrect
uesd .254 54 pril 2
T .16 .6
172 Pin Accuracy by , 202
Perfect
Mi
cha 4 fro
m
el Dwith
The result returns only the street eve Pa pin
I
dropped within the boundaries of thersstreet.
This result technically satisfies the user intent,
but this intent is unlikely, so relevance should
be rated Acceptable.

Appendix: Release Survey

You may occasionally be unable to rate a survey. To skip it, click Release Survey at the top right of
the tool.

A pop-up window with a list of reasons for release will appear. You must choose one before you can
release the survey.

Note: If you change your mind and decide to rate the survey, click Cancel at the bottom left of the
pop-up window.

Reasons to Release

1. Adult Content

You are not comfortable rating queries and/or results that include businesses offering adult services
or entertainment, like strip clubs.

2. Technical Issue

Technical issues that prevent rating include:

• Map or map features not loading.

• Query field is empty.
• Tool is not interactive. You cannot zoom in and out or move the map at all.
• Cannot submit ratings. IP
Tu m rs
• e
17 sdaMore than 5 pins in a row are missing or pins do not stay in place. r o
f eve
•2.16Receiving 5 consecutive surveys with all results in China, if China, or Hong Kong, 24 not
are
y, A
.25 pri 2 , 20
a el D the
markets
4.6 lyou h
2 are rating. l
pri y Mi
c
by , 202 , A b
Mi 4 ay 4.6
ha fromleave a comment describing the issue before releasing
If you choose thiscoption, uesd .25the survey.
el D I T .16
P 2
eve
rs 17

273
3. Not Enough Time Allocated IP
ro m rs
2 4 f Deve
Select this option if the Estimated 0 l Rating Time is not sufficient to complete the task. Remember, the
2, 2 ichae
Estimated Rating Timepis riltheMaverage time over multiple tasks. 1 Tues
A
y, .6 b y 72 day
d a 4 .16 , A
4. Other u es .25 .25 pri
4.6 l 2,
T .16
1 7 2 by 202
Mi
Issues not mentioned above that prevent you from rating. cha 4 fro
el D m I
eve P
If you choose this option, you must leave a comment before you can release the rs
survey.

Do Not Release

These issues will not prevent rating and are not reasons to release surveys:

• Poor satellite image, including clouds over target area or lack of image detail
• You can zoom in and out on map, but not as much as you'd prefer
• Rating is too difficult
• Query does not appear to be related to maps
• Query or results are from outside your market
• A query has no results
• If you see a query with no results, answer the query-level “Navigational Result”
Question and submit.
• Query or results in unexpected languages and scripts:
• If you see a query in an unexpected language or script, research it or use an online
translation tool to find out what it means, then rate it as usual.
• For results in an unexpected language or script see Result Name/Title in Unexpected
Language or Script and Language/Script Issues in Address

Tu IP
o m rs
17 esda f r ve
2.1 y,
20 24 l De
6.2 Ap 2, ha
e
54 ril 2 ril Mic
.6 p
by , 202 y, A .6 by
Mi a
cha 4 fro es d 54
el D m I Tu .16.2
eve P 172
rs

274