A vast amount of spatial data exists in non-spatial databases in the form of addresses, often in local languages. Geocoding is the process of creating spatial locations from these addresses. This session will introduce the basic geocoding functionality in ArcGIS and help you with a quick-start experience in learning the basic techniques for creating address locators and geocoding with ArcGIS 10.
00:01 Let me introduce myself. My name is Agatha Wong.
00:04 I work in the geocoding development and products group...
00:09 ...that we've been developing geocoding, start from Arc... ArcView and then ArcGIS and now we go to ArcGIS 10.
00:19 And I'll let Miriam introduce herself.
00:22 This presentation is covering the basics, geocoding parcels...
00:28 ...and then we have another workshop right after this one.
00:30 We'll go dive in to the geocoding engines.
00:33 So this one is basically showing you how to use ArcGIS 10 to process your address and to find locations.
00:46 And then at the end, I will answer some questions...
00:49 ...and if you have more questions, yes, we... we will have plenty of time for you...
00:53 ...to answer your question or to help you out with your geocoding issues.
00:59 You see the assistants is passing out the evaluation forms, and we will appreciate you to fill out the form at the end...
01:06 ...and you can drop it off at the box next to the escalator and outside maybe in the reception areas.
01:14 So I could pass the time to Miriam.
01:18 All right, thank you, Agatha.
01:20 Can you hear me also in the back very well? Okay.
01:26 All right. My name is Miriam Schmidts.
01:28 I'm an instructor at Esri Educational Services which means we teach classes there.
01:34 We teach... We offer classes to our customers to client sides, and I teach most of the desktop classes that we have...
01:43 ...the foundation series, Desktop 1, 2, 3; Data Production and Editing Techniques; Performing Analysis...
01:50 ...and recently also got started with ArcGIS Server, so that's another whole different, exciting field...
01:58 ...also when it comes to geocoding.
02:00 But what we want to do today here is talk about geocoding with ArcGIS Desktop.
02:05 That's the foundation for all our address processing...
02:10 ...and give everybody a very solid foundation of the basics of geocoding.
02:15 So this is the geocoding introduction workshop.
02:19 Following, after this, Agatha will get, will give the advanced geocoding workshop right in this same room. Okay?
02:29 So let's get started.
02:31 Here's our agenda for today.
02:34 First of all, I want to give everybody the basics.
02:37 I want to cover what is geocoding and what are the components that we need for geocoding.
02:43 And then we also go into the geocoding workflow...
02:47 ...what tools we use in which situations...
02:50 ...and what are the parameters that we use in these tools that we fill in so everything runs smoothly.
02:58 In the end, I will cover, for a few minutes, I will cover automating techniques for geocoding...
03:05 ...because we have a couple of tools in our soft that... software that can help you save a lot of time...
03:12 ...and maybe run your geocoding overnight.
03:15 So that's something that might be interesting for some of you...
03:18 ...especially when it comes to geocoding thousands or even millions of addresses.
03:24 You don't want to wait for that anymore.
03:27 All right. So let's get started right away.
03:31 Let's get started with a map.
03:33 That's what it's all about, right?
03:35 We have this fictitious town here, ArcTown USA, USA with Lake Esri.
03:42 And you see here in ArcTown we have streets and the lines on our map.
03:49 They are labeled with a name, with the street names and then you also see they are labeled on each side of the street...
03:57 ...with the house number range, with a starting and the end house number.
04:03 These are separate attribute fields in the attribute table, right?
04:07 We all know that the labels must come from the attribute table.
04:10 These are fields that we use for labeling in the attribute table.
04:15 Now the goal is to take some addresses and put them as points on the map.
04:21 And if you look at this first address here, 150 Main Street West.
04:27 If you look at the map, you're probably now trying to find Main Street West.
04:35 And now you probably look at the house number ranges.
04:40 You're trying to find 150, right?
04:42 So if you place the point about here, where the green dot is, then you've done nothing else than geocoding...
04:50 ...geocoding in your mind.
04:52 And that's exactly what the computer does when we start our geocoding process.
04:58 It finds the right street segment.
05:00 In fact, all these streets, they are broken up into separate features for each block...
05:07 ...so we have separate features in our data layer to find the right street feature, to find the right house number range...
05:16 ...and then along the house number range, the software interpolates where along the line about the plot point would be...
05:25 ...in this case, about halfway along the line.
05:29 That's geocoding, placing addresses on the street, on a street map or on a map in general...
05:38 ...by comparing them against some kind of reference data.
05:42 In our case here, our street centerlines are our reference data.
05:47 Now most of the time, that turns out very well, but sometimes, well, the computer has difficulties.
05:54 So for example, if you look at the second address here, 205 Main Street...
06:01 ...we just learned that there's a Main Street West and a Main Street East, right?
06:05 So which of the two Main Streets is this address on?
06:06 ...we had the house number ranges on both sides of the street centerlines...
06:10 We don't know, and the computer doesn't know, either.
06:12 So what it does, it gives us candidates.
06:15 It gives us a candidate here, it gives us a candidate for West Main Street and one for East Main Street...
06:22 ...and it's up to us to make the decision, well, which of the two candidates is the right one?
06:29 It's a tied situa-... situation here.
06:33 And then, well, hopefully, that doesn't happen too often.
06:36 Sometimes, the geocoder, the geocoding doesn't work because, well, the information is just not there in the reference data.
06:47 If you look here at 105 Grand Avenue, you might be finding Grand Avenue here right on the right edge of the map...
06:57 ...well, there are no house number ranges in the reference data.
07:02 Cities, they grow very rapidly these days, right?
07:04 So it might be that whole subdivision have, subdivisions have not been entered yet into your reference data...
07:11 ... and then, of course, the software cannot compare correctly against the reference data...
07:18 ...and we end up with some unmatched addresses.
07:22 In fact, we do have techniques to handle these kinds of situations.
07:25 We can go back and manually match these unmatched addresses. And there are also automated... automated ways to do that.
07:34 We will cover that at, later on in this presentation, as well.
07:39 All right. So here we have the out-of-the-box definition of geocoding, straight from our ArcGIS Desktop Help.
07:49 What is geocoding?
07:50 It's an... it's a GIS operation to transform a description of a location...
07:58 ...such as a pair of coordinates, an address, a name of a place.
08:06 You see, it's not always addresses.
08:08 It can be an x,y location or it can be a, just a place-name description.
08:14 We take that location description and place it as a location on the map as a point.
08:23 So geocoding, while most of the time we will geocode addresses, but we will see, we have also techniques...
08:29 ...how we can take place-names and geocode them, x,y locations, ZIP Codes...
08:35 ...all this, any description of a location we can geocode.
08:40 There are three common ways to do geocoding.
08:43 What people most of the time think of when it comes to geocoding, it's interactive geocoding.
08:49 We just type in an address, we get a point in return, and this is all we want.
08:54 The interactive way, everybody, I think, has done that before.
08:59 But that doesn't work so well if we have hundreds or thousands of addresses.
09:04 In this case, we might want to feed an entire table of addresses...
09:08 ... into some sort of geocoding engine and get a layer or a feature class back of points back in return.
09:18 That's what we call batch geocoding, and I'm going to show you that one in the first software demonstration right away. Okay?
09:26 And the third one, that's a very interesting technique.
09:29 That's called reverse geocoding where we click on the map, we click on the map and get an address in return...
09:39 ...the closest street address to the location where we just clicked.
09:44 There's a tool for it on our geocoding toolbar that I'm going to show you, and I'll show you how that works, as well.
09:50 It's very interesting when it comes to, when it comes to fixing unmatched addresses.
09:59 You had a question?
10:00 [Audience question] If I have a series of points, can I get, is there a batch reverse geocoding?
10:04 Is there a batch reverse geocode?
10:17 Sorry about that!
10:21 Okay. Yes, ArcGIS 10 introduce a new geocoding tool called Reverse Geocode.
10:27 It's the geoprocessing tool, so and we will show you a little bit later in the second workshop.
10:33 That's for the advanced one.
10:35 Thank you, Agatha.
10:40 How about that?
10:41 Let me, let's hold your questions in a little later so that we don't get to switch the mike and hurt your ears.
10:47 Yeah, let's keep the questions to the end, all right?
10:51 Well, without further ado, let me show you how all this works.
10:55 Let's go back here into ArcMap and see how all this, all these techniques work.
11:05 You see I have a map document set up here for San Diego.
11:09 Here we are in beautiful San Diego.
11:13 And you see I've added a couple of basemaps from ArcGIS Online.
11:18 I just want to have some good ref-, some good background data to show here.
11:25 And I also have a streets layer, a street centerline layer, but I'm not going to use it for now.
11:30 I'm going to use that only in the second demonstration later on.
11:34 What I want to show you for now is how we can quick and easy, first of all, interactively do some geocoding...
11:42 ... and also, also how we can do some batch geocoding.
11:47 So here we are on our Geocoding toolbar, and you see here on the Geocoding toolbar...
11:53 ...I have a field, I have a field where I can just type in my address.
11:59 And I don't know how many of you know the street address here of the convention center.
12:04 It's known as the convention center but the street address is triple-1 West Harbor Drive...
12:13 ...and we're in San Diego, we're in California.
12:16 You see, I'm not separating the address elements by any commas or any other separators, and it's also not case sensitive.
12:25 When I press Enter on my keyboard here, you see, it flashes the location in the map.
12:33 It gives me a nice visual feedback in form of a ToolTip here.
12:37 And if I right-click on it, you see a context menu comes up where I get different options.
12:45 For example, I can take a closer look, I can zoom to the location, I can right-click again here...
12:53 ...and maybe add a labeled callout, so different ways how we can mark the location that we interactively geocoded here.
13:03 And this technique is really meant for quick and straightforward, quick and easy geocoding of one single address.
13:12 But what if we have a whole table of addresses?
13:16 So if I switch over here to my List by Source view, this is new in ArcGIS 10...
13:21 ...we have the different buttons here on the top of the table of contents.
13:25 If I list by source, you see, I have a table of San Diego restaurants.
13:32 I don't know how many of you can think of lunch already, but...
13:36 ...we are all, most of us, we are geographers, we're well prepared.
13:38 We want to see things on the map, right?
13:42 So we have this table of addresses, different options for lunch, and we have a separate field.
13:50 Here you see for the address information, the city, the state, and the ZIP.
13:55 So I'm going to take this table and geocode it.
14:00 The easiest way to do that is, is just right-clicking on the table, in the table of contents and say geocode addresses.
14:11 You see it asks me to choose an address locator.
14:15 We will talk about address locators later on.
14:18 For now, I am just going to use one of the automatically referenced ones here.
14:23 You see the software automatically references a North America geocode service from ArcGIS Online...
14:30 ...and I'm going to use that one.
14:33 Click OK. It will come up with a dialog here, and you see, there's some field matching going on now.
14:42 The geocoding service now looks at the address table and tries to find some crucial information in this table.
14:51 It wants to find the street information, which is, you see, in the address field.
14:55 It automatically picks that up because I used some... some standard field names here...
15:02 ...and it also automatically finds the city, the state, and the ZIP fields.
15:07 Sometimes you have to go in and rematch that manually, but most of the time it really picks it up.
15:14 Further down here in the dialog, you see the output shapefile or feature class.
15:19 It defaults to the default geodatabase that I've set for this map document.
15:25 This is a new concept in ArcGIS 10 that can, that you can set a default geodatabase for every map document that you create.
15:33 This is the database that you work most of the time with, where most of your data are, and this is where all of the outputs default to.
15:42 So you see right now, I have a San Diego geodatabase at, set as a default, and I'm just going to call my output Restaurants. Okay?
15:53 We're not going into the options here.
15:55 We take care of that later on.
15:58 I just want to show you quickly how it works.
16:00 I click OK and you see the geocoding runs.
16:04 Hundred percent of the addresses were matched.
16:07 That's really the ideal case.
16:09 I can close this dialog and you see here, I have my geocoding results.
16:17 A new point layer has been added to the table of contents...
16:21 ...and you see if I zoom to it, here are all my restaurants in the San Diego Gaslamp Quarter.
16:29 I took, only took the ones that are walking distance from here.
16:32 And if I symbolize them nicely, I can see them a little better, I could do anything I wanted to with this layer now.
16:41 I can label it, anything I wanted to.
16:44 So that's batch geocoding, taking a table of addresses and geocode it.
16:50 Now last but not least, what I want to show you also is that reverse geocoding.
16:56 Remember, reverse geocoding, clicking a map and getting an address in return.
17:02 So there's one button here on the Geocoding toolbar, it's called the Address Inspector.
17:08 And if I activate that and click the map, you see if I keep my mouse button down...
17:14 ...I get the closest address to the location where my mouse pointer is just placed.
17:22 And this is really great for exploring an area, if you want to find out maybe what's wrong with an unmatched address.
17:29 What's the address range in a particular block?
17:33 Very handy when it comes to exploring your data.
17:36 So address locator, Address Inspector button on the Geocoding toolbar.
17:44 All right. So let's go back, let's go back to the presentation and...
17:51 ...talk a little bit more about the components that we need for geocoding.
17:55 In fact, we have identified already quite a few of them.
17:58 Definitely, we want to end up with features on the map.
18:02 These are our points.
18:04 And you've also seen already the table of addresses that we feed into our geocoding...
18:09 ...so that we can get a whole point layer in return.
18:14 Now in the center of all of this is the address locator.
18:18 The address locator is the main tool that we use to do our geocoding...
18:24 ...and we will see in quite, in a little bit what exactly an address locator is.
18:29 You see, we have several address locator styles that are built into the software.
18:36 There are different...
18:37 We can build address locators in different ways, depending on what kind of addresses we want to geocode.
18:44 For example, there are different address formats in the U.S., right?
18:48 We have the standard format with address, city, state and ZIP.
18:56 But then we have, like, in other areas in the U.S., we have alphanumeric addresses, we have hyphenated addresses...
19:04 ... and not to mention at all the situation where we want to geocode place-names...
19:09 ...or if we want to geocode x,y locations or ZIP Codes.
19:14 So we do need different types of address locators for all these kinds of different location descriptions that we want to geocode.
19:24 And that's what the address locator styles are for.
19:27 They come with the software.
19:28 We don't have to build them ourselves.
19:33 All right. And, oh, one more thing.
19:35 Depending on what kind, what kind of reference data I want to use, what kind of address data I have...
19:44 ...the different types of address or location data will require different types of reference data.
19:51 So for example, if I have addresses, I might want to use street centerlines or some cities even have address points.
20:00 For each individual house, they have an address point.
20:04 You can use that as reference data.
20:06 Or if you think of another situation, maybe I'm... I'm a store owner and I want to know where all my customers are.
20:14 When they check out, I ask them for my, for their ZIP Code.
20:17 Well, in that situation, maybe I just want to, want to geocode by ZIP Code...
20:23 ...and then of course I need a ZIP Code layer as my reference data.
20:28 So depending on what kind of reference data I use, I build different address locators...
20:34 ...and the first step in my geocoding workflow is then, well, I need to build or obtain the right kind of reference data.
20:47 Reference data can come from many different sources.
20:50 Maybe the most common source is our software itself.
20:54 I don't know if you know that, but the software ArcGIS Desktop comes with a media kit.
21:02 It's a set of DVDs, Esri Data & Map DVDs, where on one of these DVDs, you have a street map dataset, StreetMap USA.
21:14 It's a dataset of street centerlines of the entire USA, ready-made for geocoding.
21:22 And even more, it comes with a ready-made address locator.
21:25 You don't even have to worry about the address locator anymore.
21:28 You can use it right away for geocoding.
21:31 Just a warning. It's massive.
21:32 Don't try to copy it to your hard drive.
21:35 If you try to copy it, just take a subset of it.
21:38 It's very big.
21:41 Or another possibility, you might be going to the census bureau Web site and download some TIGER data.
21:48 TIGER data, there are street centerlines that you can use for geocoding, as well, and use as reference data.
21:58 Well, reference data, that's, we can take them from other sources, but I saw from the survey earlier.
22:06 ...a lot of you are from city governments, right? County governments.
22:12 You might be cleaning your reference data in-house.
22:14 Maybe you have field crews going to the field...
22:17 ...and they, of course, always have the most up-to-date information to put into your reference data.
22:23 Maybe you just create those reference data in-house or purchase them.
22:28 There's Tele Atlas, there's StreetMap.
22:31 A lot of companies, well, that's what they make their money with.
22:34 They work, they invest a lot of time and effort to always offer you the, the most up-to-date kind of reference data for geocoding.
22:47 Last but not least, I want to mention ArcGIS.com.
22:51 You will hear a lot about ArcGIS.com at this User Conference.
22:56 It's our new data sharing Web site, and of course, it's a great place to go...
23:00 ...go for any kind of data including reference data for geocoding.
23:08 Might be finding even some geocoding services there that you can use without even doing the geocoding on your own machine.
23:16 So check out ArcGIS.com, what used to be ArcGIS Online.
23:20 You will be rerouted to this ArcGIS.com Web site.
23:28 So no matter what you do, if you obtain reference data or if you built them yourselves...
23:34 ...there are a couple of things you have to ask yourself when you do that...
23:38 ...and first and foremost it's, What level of detail do I need in my reference data?
23:46 Do I need them at the city level?
23:50 Do I need, do I want to geocode addresses within a city?
23:54 Maybe I work for the city government and I want to build my address database...
23:59 ... or maybe I'm a store owner, want to see where my customers are.
24:04 But then, well, maybe once, every once in a while, a customer comes from another state or another county.
24:11 So do I want to also be able to geocode countrywide or even worldwide?
24:19 What's my spatial extent for the geocoding?
24:23 And depending on... on that spatial extent, what kind of address attributes do I need in my reference data?
24:31 We will see different address locator styles require different types of information in the reference data.
24:39 And this is stored as the address attributes.
24:44 Speaking of the address locator style here, the next step after we build it, build or obtain our reference data...
24:53 ...well, we have to decide what kind of reference, what kind of address locator do we want to make?
24:59 What kind of style do we use to do our geocoding?
25:06 So what's an address locator style?
25:10 Well, basically it's a template for making an address locator.
25:15 It contains all the parameters and properties to build an address locator in our software.
25:22 Let's say you work for a city government, you have the most up-to-date reference data...
25:29 ...and now you want to use that reference data and make your own address locator.
25:35 So definitely, the address information and the reference data determine which style of address locator you will build.
25:46 And you see here in the graphic, these are the new address locator styles available in ArcGIS 10...
25:53 ...and what we have highlighted in blue here is probably the one that you will most commonly use.
26:00 It's called US Address Dual Ranges.
26:04 The dual ranges stands for house number ranges on both sides of the street.
26:09 Remember, you've maybe, maybe you remember from the first map that I've shown you...
26:21 ...and that's attribute information that we have in the reference data.
26:24 That's what you use the Dual Ranges address locator style for.
26:30 But then there are others.
26:31 There's, for example, one range single house.
26:34 And I'm going to show you a few examples of these address locator styles that we offer here.
26:41 So definitely, there's dual ranges.
26:44 Dual Ranges is meant for house numbers on both sides of the street...
26:50 ...and when you look at the corresponding attribute table...
26:52 ...whenever you see these attribute fields in the attribute table of the reference data like LFADD...
27:00 ...Left from Address, Right...Left to Address, Right from Address, Right to Address...
27:10 ...these are house number ranges, the starting and the ending house number for each street feature.
27:18 This is when you would use the Dual Ranges address locator style.
27:25 Another example here.
27:27 Well, maybe you have address points for your reference data.
27:31 Maybe your city government has an address point for each and every individual address in your city.
27:38 There's another address locator style called Single House, U.S. Address Single House...
27:43 ...which uses points or polygons as reference data.
27:47 So for example, address points.
27:50 And you see right here the house number is in a different field and the street name is in a different field.
28:03 Now we talk about addresses a lot here.
28:06 We talk about street addresses a lot but we don't want to forget that geocoding is not only about addresses.
28:15 What if you have a list of place-names?
28:19 Like in this example here, you have a list of place-names like Manzanita School, Brickyard Park, you name it.
28:29 We have a table of place-names that we want to geocode against some sort of...
28:37 ...well, not some sort of but against the right reference data.
28:42 The address locator style that allows us to do that is a general address locator called gazetteer.
28:50 That's also a new one.
28:51 And basically, it works with points or with polygons as reference data.
28:59 And it's the... it works as a big lookup table, basically.
29:02 We've built the lookup table in the reference data and the address locator...
29:06 ...would match the place-names that we find, that we type in with the right record in the reference data.
29:19 So back to our work, geocoding workflow.
29:23 We built our reference data, we determined what style do we want to use.
29:28 Now it's time to actually build the address locator.
29:33 And while building an address locator, it's a very straightforward process.
29:37 You can build it either as a file-based address locator and store it in a folder...
29:44 ... or, well, you can store it in a geodatabase as well.
29:48 No matter what storage method you choose, you right-click the folder or the geodatabase...
29:55 ...point to New, and then there's an entry New Address Locator...
30:00 ...that you will, that will open a wizard where you can type in all the information.
30:07 Now an address locator, it definitely, it defines the process of geocoding, and we call it a tool.
30:14 It's the main tool that you use for your, for your geocoding, but if you take a closer look, in fact it is a dataset.
30:23 It's a dataset of all the attributes, the indices, queries, that the address locator uses to match the addresses.
30:34 But first and foremost, it's also a snapshot of the reference data.
30:44 When you build your address locator...
30:47 ...it looks back to the reference data and takes a snapshot of it so it becomes independent from the reference data later on.
30:55 You can share it with other people.
30:57 You don't have to worry about the reference data so much anymore.
31:01 That's really great.
31:02 That's why address locators can sometimes be fairly big.
31:06 Well, they contain a snapshot of the, of the reference data.
31:10 And I know you might be thinking now, well, what if something changes in the reference data?
31:15 Definitely we can update address locators, and maybe Agatha will talk about that later. Okay?
31:23 Now building an address locator, here's the process.
31:26 First of all, of course, we have to take a look at our address and our reference data...
31:31 ...to determine what kind of address locator style we want to use and what address locator we want to build.
31:37 Then there's a tool that we open just by right-clicking on either the folder or the geodatabase.
31:43 That's one way to open them.
31:45 We will see later, there are other ways.
31:48 We select an address locator style, specify which kind of reference data we want or specify the dataset...
31:56 ...where is our reference data.
31:59 And then optionally, while most of the time it will pick up all the required fields automatically in the reference data...
32:07 ...and match them to the required field in the address locator...
32:12 ...but sometimes we have to go in and do a little bit of manual rematching here.
32:17 Also, if you work in an ArcSDE type of geodatabase, you might be specifying your configuration keyword...
32:25 ...and then definitely in the end, we specify where is the address locator stored and how do we call, what's the name of it.
32:34 All right, it's time to show you all this.
32:37 How do we build our own address locator.
32:40 So back to ArcMap, back to San Diego here.
32:48 Here we are in ArcGIS 10, and you've probably heard about, many times, you heard about our built-in Catalog window now.
32:57 You see, it's one of these dockable windows.
33:00 I can autohide it or I can push the pushpin here to dock it.
33:06 Now, I'm here in my San Diego geodatabase.
33:11 It's my default geodatabase for this map document and this is where I want to build my address locator.
33:18 To do that, I just right-click on the San Diego geodatabase, point to New Address Locator...
33:28 ...and you can see here's the Create Address Locator tool.
33:33 The first thing it will ask me, well, what kind of address locator style do you want to use?
33:41 So I actually point, I...
33:48 ...I point to the Dual Ranges address locator here.
33:52 This is the most commonly used one because...
33:58 ...I have actually a street centerline dataset that, with house number ranges on two...
34:04 ...on both sides of the street that I want to use as my reference data.
34:09 I should have showed you that, shown you that earlier.
34:12 This is actually the... this... the reference dataset that I'm going to use...
34:18 ...here, my street layer in my table of contents.
34:23 And we have the address information here.
34:28 We have house number ranges on both sides.
34:35 All right. So my reference data, it's my streets from the table of contents...
34:41 ...and you see, as soon as I specify the reference data...
34:45 ...you see it automatically matches the required information with the fields in the reference data.
34:52 Again I used some standard names here.
34:56 So let's call the output address locator San Diego.
35:05 All right. And I don't need a configuration keyword because I work in a file geodatabase...
35:12 ...so I can just click OK and you see it's processing in the background now.
35:17 At the bottom, I see there's a banner going on here that tells me, okay, the tool is running.
35:25 And as soon as it finishes, it will give me a visual feedback for my address locator.
35:35 It's a little slow this morning.
35:36 My computer's still waking up.
35:46 All right. So here it is.
35:49 So as soon as I built my address locator in ArcMap, you see it's actually added to the list of available address locators...
35:57 ...here on the Geocoding toolbar.
36:00 So I'm ready to use it now.
36:03 I could do my geocoding but that will be my next demonstration.
36:07 If I would have done this from within the ArcCatalog application...
36:12 ...I would have needed to manually add this address locator to ArcMap, but since I've built it in ArcMap...
36:19 ...I don't need to do that. All right?
36:24 Let's go back to the slide show.
36:27 All right. So, you've seen me creating an address locator in the geodatabase.
36:34 You can create it in a folder as a file-based address locator, but no matter what format you choose...
36:44 ...we would like you to always use ArcCatalog to manage your address locators.
36:50 And I'm not saying that because I work for Esri. No.
36:53 It really saves you a lot of trouble.
36:56 Address locators, especially with file-based address locators, they have many associated files.
37:04 And for example, let's say you rename one of the locator files, forget to rename the other associated locator files...
37:12 ...you can easily corrupt your data.
37:14 ArcCatalog is smart enough to know about all these file associations and it will rename them all together...
37:22 ...copy and paste them all together, so there's less risk of corrupting your data, your file-based address locators.
37:30 And, well, if you store them in the geodatabase, you would use ArcCatalog anyway to, to access them.
37:36 Address locators, they come with this house icon.
37:42 I want everybody to remember this house icon here.
37:46 This one, this is how an address locator looks like, okay?
37:53 And you can copy and paste them, you can rename them, whatever you'd like to do with them.
37:58 And, of course, use them for your geocoding.
38:02 Now so far, we've always talked about one single address loca-... building one single address locator to geocode...
38:10 ...using one single reference dataset, and for most of the cases, that's just fine, that's all we need.
38:18 But there are these situations, well, when things fail.
38:23 For example, you have a citywide address locator here, you want to see where your customers are.
38:31 But every once in a while, you have a customer from out of town.
38:35 So in cases like this, you can use or build what we call a composite address locator...
38:43 ...where we combine multiple, individual address locators into one single address locator and build kind of a fallback scenario.
38:55 So the addresses that fail in your city address locator...
38:58 ...you might want to feed them into your nationwide address locator that uses a different reference dataset.
39:05 And maybe as a catch-it-all solution in the end, if everything fails...
39:09 ...you could have a postal code address locator to at least put the address into the right ZIP Code area.
39:17 This is what we call composite address locators.
39:21 We geocode against multiple reference datasets and build this kind of cascading, fallback scenario.
39:28 This way, we can really catch and geocode quite disjointed address datasets and use different reference data.
39:40 Now how do we build such a thing, a composite address locator?
39:43 You see, there's another tool for it; it's another geoprocessing tool.
39:48 And you see here at the top in the red box, this is where we specify which address locators we want to combine.
39:56 So if we zoom in here, you'll see I have in this case combined a city of Atlanta geo-... address locator...
40:07 ...which I use for my city addresses, with an, with an address locator of postal codes for the entire U.S.
40:14 So I built my individual address locators first, and then combine them...
40:19 ...reference them here in this Built Composite Address Locator tool.
40:27 There needs to be some field mapping because the composite address locator requires, again, certain types of information...
40:33 ...and this...this information may be stored in different fields in the individual address locators.
40:41 Again, most of the time, it picks up the fields automatically, and you'll see in this case, it does.
40:47 If not, we could go in and, and, and rematch that information.
40:53 So in this case, the street information, it's call, it's in a street field in the Atlanta address locator...
40:59 ...the city, the state, and the ZIP, as well, and also the ZIP information, of course, is in the postal code address locator.
41:10 All right. So we've done our field matching.
41:12 All that is left to do is give the address locator a meaningful name...
41:17 ...and then click OK to build your composite address locator.
41:21 It will just be another item in your geodatabase or in your folder that you can then use for geocoding.
41:31 And last but not least, after we've done all this, we determined what address locator style we need...
41:37 ...built our address locator, individual or composite one.
41:42 Now we're finally ready to do our geocoding and locate our addresses.
41:50 Now I've showed you the Geocoding toolbar already in the demo.
41:55 Here we have kind of a nice and labeled picture of it.
42:00 You see the drop-down menu gives you all the available address locators in this particular map document...
42:08 ...and if you'd like to add an address locator to this list, you would go to this Manage Address Locator entry here, click it...
42:18 ...which would take you to that list of default address locators but also you can, you can...
42:25 ... you can navigate to wherever address locator style, wherever your address locator is saved.
42:35 On the right side of the Geocoding toolbar, you see there's the address inspector.
42:39 We used that one already.
42:40 We can type in addresses here.
42:42 We've done that.
42:44 Now for batch geocoding there's another button here, Geocode Addresses.
42:49 It basically, it's another way.
42:51 We can either right-click on a table, do our batch geocoding that way, or click this Geocode Addresses button...
42:58 ...and then later on, when it comes to going back and rematch some unmatched addresses...
43:04 ...this is when we use this Review and Rematch button here. Okay?
43:11 Now there's one tool, I want to mention that here because it's not on the Geocoding toolbar.
43:18 It's a great tool for finding addresses.
43:23 In basically interactive geocoding, it's a Find tool on the Tools toolbar, this binocular button...
43:30 ...and you see we have a Locations tab here in the Find tool, which brings up a panel where we specify an address locator.
43:40 We can type in an address and any address that we want to find...
43:45 ...you see 380 New York Street, that's the address of our headquarter in Redlands...
43:52 ...and then as soon as we click Find, it gives us a list of possible candidates for this address.
44:00 And this is the difference between typing the address into our field on the Geocoding toolbar and using this Find tool.
44:08 Well, you get a little more information here.
44:11 You get all the possible candidates, you get the score for each of the candidates...
44:17 ...how well the candidate has been matched to the address, which side of the street it is, and you see some additional information.
44:25 You can right-click again, zoom to it, add a point or a callout, all these different things that we can, that we have seen before. Okay?
44:35 Save it to My Places, different options here.
44:43 All right. So geocoding an address in ArcMap, and I'm talking about batch geocoding here, works in a way that...
44:52 ...we add the address locator style to ArcMap if we created it outside of ArcMap.
44:58 We specify which table we want to geocode.
45:03 We go in and specify what output type do we want to save our point data in, as a shapefile or maybe as a geodatabase feature class.
45:15 Where do we want to save it.
45:17 And then optionally, well, sometimes we go back into the geocoding options and tweak some of the parameters there.
45:26 I'm going to show you that in the next demo.
45:29 There are some things that we can play with, for example, the spelling sensitivity...
45:33 ...how picky the address locator is, if there are any typos.
45:38 We can add additional fields to the output table, for example, the x,y locations.
45:44 These are all options, and we can play with that before we then geocode our addresses and...
45:50 ...hopefully we don't have to go back and review and rematch too many of the addresses.
45:58 Hopefully, most of, hopefully it works fairly well.
46:03 All right. So let's go back, do another demonstration here and see how geocoding works.
46:13 Now, remember I showed you the Find tool earlier?
46:17 That's another thing I want to demonstrate here.
46:20 Just make sure that everybody recognizes the Find tool.
46:24 It's on the Tools toolbar.
46:26 It's this binocular button on the Tools toolbar.
46:31 And you see, if I click the Location tab, this is where I can choose an address locator...
46:37 ...and you see it automatically picks up the address locator that I created earlier, the San Diego address locator...
46:44 ...but I could use any of the built-in address locators as well.
46:49 As long as I have an Internet connection, I can use any of the ArcGIS Online address locators, and they are actually services.
46:58 They are actually geocoding services.
47:01 Okay. Let's type in an address again.
47:05 Triple-1 West Harbor Drive.
47:12 Press Enter, and you'll see in this case, we get two candidates.
47:17 We get with a score of a hundred, we get the location of our convention center here...
47:24 ...but apparently there's also a Harbor Drive without the West...
47:28 ...so that has a slightly lower score, you see, because one of the components is not a perfect match.
47:34 Then we can go there, zoom to it, we know the location already, see, it puts it into the right location...
47:41 ...and we, if we wanted to, we could add another label here.
47:45 That's the Find tool. That's the Find tool.
47:48 Gives me a bit more information, a little bit more information than the Geocoding toolbar.
47:56 It's just the, the Find tool has been there before, ArcGIS 10, it's just historically grown that it's not on the Geocoding toolbar.
48:06 It's good for finding any kinds of things, not only addresses.
48:11 All right. So let's do our batch geocoding.
48:14 And you see for our geocoding, I built the San Diego address locator.
48:19 This time I'm going to use the street centerlines layer that I have here in my map document as reference data.
48:29 So to start the batch geocoding, I'm going to show you here, I want to show you this Geocode Addresses button.
48:37 It's another way to open this wizard environment.
48:42 I use the San Diego address locator that I just built, click OK.
48:48 And you see again, it... it automatically remembers the last time, the last address table that I've geocoded...
48:59 ...but I want to geocode a different table now.
49:02 Well, we're all here in beautiful San Diego.
49:05 We have a week of conferencing in front of us, but maybe next weekend...
49:10 ...you want to take the family to some tourists' attraction, maybe want to go to the zoo, go to Sea World.
49:17 And, well, we're well-prepared, right?
49:21 One of our colleagues before has been to San Diego before and gave us an Excel spreadsheet of San Diego tourist places.
49:31 That's what I want to geocode now.
49:33 I will navigate to my Geocoding folder.
49:41 Let's see, there we are.
49:48 Here we have our San Diego tourist places Excel spreadsheet that we want to geocode.
49:58 So we add that.
50:01 And you see the individual spreadsheets in an Excel file, they come up as tables.
50:07 And we'll geocode the tourist places here and specify that as an address table.
50:16 The output will be called Tourist Places.
50:25 And this time I'm going to take a closer look at the geocoding options.
50:29 You see here, if I click Geocoding Options, I get different parameters that I can play with.
50:37 For example, I could play with the spelling sensitivity.
50:41 If I would require that, well, the, all of my addresses must be perfectly spelled right, I could set it to a hundred.
50:48 It's set to 80 by default to be a little bit more forgiving.
50:53 Sometimes when you go back and rematch unmatched addresses, you could lower the spelling sensitivity...
51:00 ...but then you run the risk that you get actually mismatched addresses.
51:04 Of course, that would impact the quality of your geocoding, so I just, I'm just going to leave it.
51:10 Also we have different scores here.
51:12 The minimum candidate score, how well a candidate must be matched to an address so that, that it comes up as a possible candidate.
51:21 And the minimum match score is something that we use later for rematching.
51:26 How well must a candidate match so that we can actually rematch it, maybe if we have two tied candidates.
51:37 Down here in the Intersections field, you see, we can specify connectors for street intersections.
51:44 So not only can we geocode street addresses, we can also geocode street intersections.
51:50 For example, I might want to call, add the forward slash here to this list of default connectors so that I can say, maybe...
51:59 ...Main Stre-... Main Street/Broadway, Main Street at Broadway, that's my street intersection that I want to geocode.
52:07 Offsets, I can set side offsets, end offsets, usually a street address is not right on the street centerline, right?
52:15 So we usually have some kind of offset to each side.
52:19 And down at the bottom here, this is where you add additional fields...
52:24 ...additional fields to the output table of your point feature class.
52:29 So I recommend that you add, always add the x,y location.
52:33 Why? Well, you can, once you have the x,y location on your point data...
52:38 ...it's really easy to use that point feature class later on for further analysis.
52:44 You don't have to go back and manually add the x,y locations.
52:49 It's handy to have it.
52:51 So, this is a quick and easy way to just get x,y coordinates on your points, so why not check it.
52:58 I could also add the percent along the street, but I'm not going to do it now.
53:03 All right. So these are our geocoding options, and later on, I don't know...
53:08 ...Agatha will probably also talk here about the place-name table.
53:13 That's another option where you can specify a lookup table for place-names.
53:20 But, again, this is, I don't have it set up for that.
53:24 I'm just going to click OK.
53:26 And you see this time, well, 98 percent of our addresses have been matched.
53:31 This is very well, very darn good.
53:34 Only two addresses, two addresses, two percent have been, have been unmatched, are unmatched...
53:41 ...could not be matched, so we will go back later and see what's going on with these addresses and possibly rematch those addresses. Okay?
54:03 All right. So we have seen when we do our batch geocoding, this, first of all, we, as the user...
54:11 ...have the opportunity to add additional fields to our output feature class...
54:17 ...but also the software, also the software adds additional fields to the original address table that we fed... that we feed in.
54:26 Definitely, there's a status field here, M for matched and U for unmatched, that the software adds...
54:34 ...once the... so that we can easily see later on where are our unmatched candidates.
54:39 And there's also a possibility for a T.
54:42 T would be tied if there's multiple candidates for the same address with the same score.
54:50 Speaking of the score, the match score, that's another attribute that will be added.
54:55 The match type, if it's A, automatically matched, or M, manually matched.
55:02 And you'll see later, we also have the opportunity to pick the address on, from the map, that would be PP, picked.
55:14 All right. And last but not least, I want to talk a little bit about the Match Address field.
55:19 The Match Address field will be added to the output table, and the address in the Match Address field...
55:25 ...it could be possibly be slightly different from the individual, from the original address.
55:33 Why is that?
55:35 Well, not every match score is a hundred.
55:38 It's not always a perfect match.
55:40 So it finds the closest address to match to the original address...
55:46 ...and that's what you see in the Match Address field, the address that has been found.
55:51 It's good to have this information so that you can go back later on maybe and compare, how good...
55:57 ...how well has my address been matched.
56:05 Why won't some addresses not match?
56:08 That's always the big question.
56:10 Well, definitely, the reason could be in the reference data.
56:15 Reference data can become out-of-date very easily.
56:18 If reference data is not current, maybe the address information is plain just not there, or...
56:25 ...it could easily be that you have entire address ranges that are missing.
56:31 In the address table, in the original address table that you fill in, well, not too surprising, typos happen, right?
56:38 Everybody knows that.
56:41 Typos are really the most, the number one reason for mismatched addresses or unmatched addresses...
56:48 ...and sometimes, even people put either wrong or additional information into their address, into their addresses.
56:58 I know of an example where, in one city, we had a fairly low income neighborhood.
57:05 But then there was some blocks with some very nice houses.
57:10 These people, they didn't want to have that particular street in their or in that particular city name in their address.
57:20 So they just put a different, different city information there.
57:24 So this is, this is the case where you have just incorrect information for one or other, one or the other reason in your addresses.
57:32 Or maybe you have too much information, like the house num-, the apartment number and, and a P.O. box.
57:40 This could, this could possibly be a problem with your address data...
57:46 ...although we have, have developed ways to handle these kinds of situations.
57:54 All right. So, with unmatched addresses or if an address has two candidates with the same, tied score...
58:03 ...we have to go back, we have to see what's going on there.
58:06 We want to rematch those addresses.
58:11 We have different ways to do that.
58:13 You see that here in the slide, there's an automatic way where we could go back into the geocoding options...
58:21 ...and maybe play with the spelling sensitivity or play with the match score.
58:26 These are all things that we can automatically, that we can change and then automatically geocode again.
58:34 See if that helps with our results.
58:37 If we have a lot of unmatched addresses, we might not have a different choice.
58:44 But I really recommend, if you have the resources and the time to do it, go in and interactively rematch.
58:54 Interactively means manual.
58:56 Well, it does take some time to go into the unmatched addresses.
59:00 See what's going on.
59:02 Find out what's wrong with the address and then fix it and manually rematch again.
59:11 Also, and you will see that in the next demo, there is a...
59:14 ...the possibility to match the address just by picking it interactively with your mouse pointer.
59:21 Click the map and pick it, pick the address and match it to the location from the map. Okay?
59:31 Here's how the dialog looks like.
59:33 I don't want to spend too much time on it because I'm going to show it to you in the demo.
59:37 We have the output table, so we can go back and find our unmatched candidates, for example.
59:44 The area here on the left, this is where you fix your addresses...
59:49 ...and at the bottom here, we have the Pick Addresses From Map tool.
59:55 That allows us to pick an address from the map and match it to an unmatched candidate.
1:00:02 So let's go back, let's go into our next software demonstration.
1:00:16 And you remember, you might remember here with our tourist places, we had two unmatched addresses.
1:00:24 So I want to go back and re-... review and rematch those addresses. All right.
1:00:31 So here we are, here we are in our output table.
1:00:35 The first thing I'm going to do, I sort descending based on the Status field so that...
1:00:41 ...that I get my unmatched addresses right at the top of the table here.
1:00:46 And you see if I highlight the first one, if I select it, the address will be displayed here...in this address field.
1:00:58 And you'll see there's 3701 N North Harbor Drive.
1:01:06 N and North, that's redundant, right?
1:01:10 We have either one or the other, so let me delete the N. Okay.
1:01:15 So let's see what happens.
1:01:17 I deleted the N and I'm going to click Search again.
1:01:22 Wow. Not bad.
1:01:24 I got another candidate here of a hundred.
1:01:27 Once I fix, fixed the address, I got a pretty good match.
1:01:31 I'm going to use this candidate and match it to the unmatched address.
1:01:36 All I need to do is click the Match button here and you'll see then the Status field changes from U for unmatched to M for matched.
1:01:46 Pretty good. All right.
1:01:49 So the next candidate here.
1:01:51 Let's take a look at the next candidate.
1:01:53 Let's take a look at this address here, 201 Fourth Avenue.
1:02:03 Can you see anything wrong with this address?
1:02:07 Doesn't look like it, right?
1:02:09 Looks pretty darned good.
1:02:12 Well, that happens actually oftentimes that an address looks okay but for one or the other reason it doesn't match.
1:02:20 This is where your work starts, this is where the detective work starts, and you have to find out what's going on there.
1:02:27 Now, in this case, I want to show you how to pick an address from a map.
1:02:33 If we scroll through the record here, you see this unmatched address actually belongs to a hotel, the Hilton, Hilton Gaslamp.
1:02:42 When you walked this morning to the convention center, you might have seen this hotel.
1:02:46 It's right across the street from here.
1:02:48 And this is maybe a situation that you encounter also with your own data.
1:02:52 You have an idea where this address will be, so you can just go to that area in your map...
1:03:00 ...and interactively match this address and pick it from the map.
1:03:05 This is what we use this Pick Address button for here at the bottom.
1:03:10 So let me zoom in a little closer here.
1:03:13 Let me zoom in to the convention center.
1:03:19 And here, there's the address, there's the Hilton Gaslamp Hotel.
1:03:24 It's here right between the Hyatt Hotel.
1:03:27 Here's where we go to lunch later on.
1:03:30 So I will use my Pick Address tool from the dialog here and click the map.
1:03:40 You see, it interactively retrieves the closest street address where I click.
1:03:47 And if I move along Fourth Street, you see it's actually a 300 house number range instead of a 200.
1:03:55 Maybe it should be 304 or 301 instead of 201; 306, I get here.
1:04:04 So why not pick this address and you see it automatically matches the address.
1:04:17 You actually right-click and pick the address from the map, and then you see the, the Status field updates.
1:04:25 [Inaudible audience question]
1:04:28 How come it didn't put the address in the Match Address field?
1:04:31 [Inaudible audience question]
1:04:33 Because it's not a matched address, it's a matched location, okay?
1:04:40 All right. So that's rematching. Fixing what's unmatched.
1:04:46 So that's often the detective work that happens after you've done your geocoding.
1:04:57 Last but not least, I want to spend a few minutes and talk about automating geocoding.
1:05:04 Now building an address locator, reminding you of batch geocoding with a table of addresses is one, it's one thing.
1:05:13 But, well, if you have thousands or even millions of addresses to geocode...
1:05:18 ...like maybe each week you get a new set of addresses that you want to process, that can take quite a bit of time.
1:05:26 So in our software, we have ways to automate this process.
1:05:32 First of all, you see here, we have a picture of ArcCatalog and in the geocoding tools, tool, of our toolbox, I'm sorry.
1:05:42 In the Geocoding Tools toolbox, we find all the, a lot of the tools that we have used for our geocoding, right?
1:05:51 You see, there's a Create Address Locator, there's a Geocode Addresses, there's a Rematch Addresses tool.
1:05:57 All these are geoprocessing tools that, well, we can access in many different ways.
1:06:04 We know that, right?
1:06:05 We can access them from the tool dialog but we can also use them in a tool called ModelBuilder.
1:06:14 ModelBuilder is a way to concatenate, to string tools together and, well, run an entire workflow that we have saved before.
1:06:26 It's very straightforward to build our own little geocode, -coding model...
1:06:33 ...and maybe run it over and over again when we get a new batch of addresses in.
1:06:38 So you want to maybe build your model, you build it from within a custom toolbox, you build your own user-defined toolbox.
1:06:47 Add your tools to the, to your new model, you can just drag and drop your tools from ArcToolbox into your model canvas...
1:06:56 ...and also drag and drop your data that you're going to use for geocoding from the Catalog window...
1:07:03 ...again, same way, into your model canvas.
1:07:06 You save your model and you can run it over and over again.
1:07:13 Now you might be thinking, ModelBuilder, that's nice, but what if I want to do a little more?
1:07:19 What if I, for example, want to run my model automatically every Friday night?
1:07:27 Or maybe what if I wanted to build some additional logic into my workflow...
1:07:32 ...maybe pick a different address locator based on some conditions that I have in my address table.
1:07:38 Automatically pick the right address locator from my address data.
1:07:43 I can do that with scripting, but...
1:07:45 ...I don't know about you, but most of us are probably not programmers who know scripting very well.
1:07:53 Now, in these cases, in these cases I can take my model...
1:07:59 ...build it nice and interactively with all my graphical user interface tools, and export it.
1:08:06 Export it to a script, for example, to a Python script that would then...
1:08:13 ...allow me to maybe add in some additional logic or attach it to Windows Scheduler and run it overnight.
1:08:23 Windows Scheduler works with any kind of script that you feed into it.
1:08:29 So these are all ways how we can, different ways how we can access and use our geocoding tools...
1:08:35 ...to make us a little more productive with our geocoding and save us the time and patience to wait for it.
1:08:43 Also, if you are a programmer, if you are an ArcObjects programmer...
1:08:47 ...definitely you can access those geocoding tools with ArcObjects as well.
1:08:53 All right, so in summary, let's wrap it up.
1:08:58 We've talked about what is geocoding, right?
1:09:01 It's the process of taking a location, location information, a text information...
1:09:07 ... a description, a place-name, an address, an x,y coordinate, anything like that and turn it into an address point.
1:09:17 We talked about the geocoding components.
1:09:20 First and foremost, the address locator is the most important component, the most important tool that we need for geocoding.
1:09:28 We also need reference data.
1:09:30 We build our, we obtain our reference data, built it, use it to build an address locator, and then do our geocoding.
1:09:39 And last but not least, we also saw that geocoding tools, they are nothing else than geoprocessing tools. Okay?
1:09:48 May I say, before you all leave, could you please fill out the evaluation forms, as well?
1:09:54 We're not done yet with, I still have one more slide to show you, okay?
1:10:01 I want to show you some additional resources because this is the intro and you will have questions.
1:10:07 There's the resource center Web site at ArcGIS.com...
1:10:11 ...and also some additional technical support articles you can access from this resource center Web site, especially the Web help.
1:10:20 There's an entire geocoding tutorial in the Web help with exercises.
1:10:26 You can install the tutorial data, run geocoding at ArcGIS 10.
1:10:32 And also we have some additional presentations here at this conference.
1:10:36 Agatha will talk about advanced geocoding right after this, and down in the Software Showcase Island...
1:10:42 ...we have the product engineers, we have people that you can talk to, talk about geocoding.
1:10:49 On Wednesday morning at 10:00, our geocoding experts will be there.
1:10:54 Actually, will that be you, Agatha, probably right?
1:10:57 And my team.
1:10:58 Here we are!
1:11:03 Thank you so much, thank you so much for attending.
© Esri 2013 http://www.esri.com