What Is Geographic Data and Where Can I Find It?

Paul Trevillion and Eric Bowman help you find sources of geographic data that meet your mapping and analysis needs. Local and online sources of existing data as well as methods to create new data, will be examined.

 

Jul 12th, 2011

Embed
Download
Transcript
480x270
960x540
Custom
Width:
Height:
Start From:
Player Color:

Right-click on these links to download and save this video.

Transcript

00:01My name is Paul Trevillion and I have my colleague here, Eric Bowman, and as you can see from the title, what we're presenting.

00:07Thinking of an agenda, we didn't think too hard about this. The first part will be, What Is Geographic Data, and…

00:12…we'll follow up that with Where Can I Find It.

00:16A little more detail, we're going to hit the basics of, well of data and information and then some basic GIS data types.

00:24We'll just look a little, brief look at a couple of notches above basic just so you get an idea of the other types of…

00:30…data that are available out there.

00:33Our general thought here is that most of you would be reasonably new to GIS and that's why we come here.

00:41Do we have some first-time users here? First-time attendees at the conference?

00:46And how many of you would consider yourself new to GIS?

00:52Okay, great. Intermediate users then? How about some advanced users?

00:58Okay, well, don't pick on us then if this is too entry level for you.

01:04We will talk about online sources. How can I acquire data? You know, a lot of the data that is, you're going to…

01:10…need in order to make your organization successful and to carry out your business needs or exploratory or research.

01:17The data that you need in order to use GIS effectively is not going to come with the software. You have to acquire it.

01:23Back when I was learning about GIS, so probably in the last dozen, 15 years ago, we used to talk about data as being…

01:29…probably the most expensive part of the whole enterprise, the whole operation of using GIS data.

01:36Acquiring it was very difficult and time consuming.

01:39So a lot better now, there's a lot more sources available to us easily and freely. It's really great.

01:47Okay, so we'll look at some of those sources such as online and not only those that we can use directly from online sources…

01:53…but those that we can download and have a local copy of.

01:56We'll talk about some other sources - GPS - data. And how about data that you just have to make yourself?

02:04We'll look at a few examples of that.

02:07Okay, so just briefly about data itself, you know, I guess in any traditional information system there's ways of organizing…

02:15…data itself and making it into information, right. If we just took a simple list, for example, here's some…

02:21…movie titles here and well, for some of you it might make some sense, but just at this point it's just a list…

02:27…but just by adding in a useful column name, we get a better idea of what we're talking about here.

02:33So these are summer films this year. A little bit more information might be available.

02:38Its gross box office receipts, for example, and we can again, make some little bit more sense of this tabular data…

02:44…just by organizing it in some way. We could group it. We could rank it. We could order it.

02:50So I could sort it by a column and already we're getting a lot more information about this tabular data, just by organizing it.

02:58Now there's additional ways of which we can visualize this data. For example, in a pie chart or some kind of graph, and…

03:04…immediately, just because it's visual, we do get a better sense of the distribution of these films, their…

03:09…share of the box-office take this summer.

03:13Now I scratched this data from Wikipedia, like a lot of other information I get these days, and I think on there…

03:20…they also had columns for UK and Australia and North American receipts.

03:24So in a way, tabular data has a geographic context to it, right. Organized by a column for a particular area.

03:34And I could actually kind of cobble that information, that tabular data together and combine it with some geographic data.

03:40Just some basic continents or countries, or you know, areas, regions of the world, and end up displaying it as a map.

03:50Now maps with raw data almost inherently have a way of organizing itself and presenting to you that information, sorry…

03:59…presenting you that data in an organized manner, right. We're seeing features on a map then organize spatially.

04:08So I could take that movie data, for example, and display the distribution of box-office receipts.

04:15That's not Antarctica that's got all the box-office, that's my idea of trying to show you the global box-office receipts…

04:22but you do get an idea of the distribution between different parts of the world.

04:26Now I would contend that this is a fairly weak, still a fairly weak example of visualizing geographic data, but there's another…

04:35…web, well, it's a map that was available on a website of the New York Times about a year and a half ago…

04:41…their cartographic and graphic design wizes put together this site, which I came upon. I was just fascinated by it.

04:48I probably blew a couple or two hours of Esri time just exploring it and enjoying it, which is nice when you get to enjoy a map.

04:57Let me just show you a little closer what I mean here. Let's see if I can kick this off and have it show up on this display.

05:04Here we go. So what the New York Times acquired was Netflix data about their most popular rentals for the year 2010…

05:17…and that information was organized spatially. It was organized by ZIP Code. Well, the data itself I imagine…

05:23…was probably tabular data, but as I say, the people at New York Times were able to take that and organize it spatially…

05:29…into ZIP Codes and present it in this very interesting way. Here we're seeing the top 10, no, what we're looking at…

05:35…in fact, is the, a particular movie here, and you can organize this by going to different movies, and you see the…

05:43…distribution within New York City and several other metropolitan areas around the country.

05:48There's variation within the local area and as we look on these smaller thumbnails here, which I can also use to navigate…

05:56…to those areas, there's variation across the country as well. Pretty interesting.

06:02Let's go to some other films here. Let's go back to New York.

06:07Clearly some differentiation here from place to place. Not only do they show all these films represented in this way…

06:15…but I can click, or not even click, I just have to hover my mouse over any of these ZIP Codes and it tells me the top 10…

06:22…rentals for that location, as well as the location, or the rank of the particular film I'm looking at.

06:29So let's see, down in Manhattan here, Righteous Kill didn't even fit into the top 10, or even in the top 50, so it's…

06:38…some interesting variations for some of you that are involved in marketing and analysis of market demographics.

06:44You know, that can be very informative, just movie information.

06:48Alright, well, it's kind of, I think that's a really kind of cool and interesting way of displaying geographic data.

06:54Now I didn't come here to talk about film so much, but I do want, again get back to this idea of getting information out…

07:04…of raw data and one of the powerful things about GIS is the way it integrates data. If I were just talking about tabular…

07:11…data, I could integrate data, or rather enrich it by potentially just joining it up with other tables that can relate…

07:18…to each other in a what we would consider, a relational manner.

07:22Most of you, many of you are probably familiar with relational databases where you have one table and another table…

07:27…or actually, perhaps, more than one table, more than two tables, and with common columns, and you could essentially…

07:34…multiply the information that's contained in each of them and because there's additional information to organize this way…

07:40…you can ask more complex questions of that data. You can do more comprehensive queries.

07:48That's one way of doing it in a tabular world. We could also do it in another way where I fetch some information from one…

07:53…table and I perform a query into some other table altogether. I don't have to do a join, I could just query another database…

08:01…somewhere and I could find out, for example, all the other films directed by Michel Gondry, alright?

08:07Anyone that's used the IMDb database is probably familiar with the ease in which you can fetch all sorts of information.

08:14Well, over to ArcGIS, again it has a natural way of integrating data, and that's this idea of layers.

08:24We look at map data in form of layers. And I can immediately get more information about a location because…

08:35…I can organize in these coincident layers.

08:38For example, I can click on the map with an Identify tool and find out a street, not only the information about that street…

08:43…but the underlying data as well. It will drill down through to the land use, to the administrative areas.

08:48What's the zoning district, for example. What's the hydrography, or am I within a certain distance of fish-bearing stream?

08:58What's the elevation? What's its slope? What's its aspect, and what does it look like underneath, for some aerial imagery.

09:07Let's put it another way, I can interrogate this data to look for a site that meets certain criteria.

09:14Let's take it from the bottom up. I'm interested in, perhaps, relatively flat land of a certain size so the slope does not vary…

09:21…too much. I'm looking for an area, well, let me back up a second.

09:26That flatland area I can isolate then as some kind of data representing that area that's flat and then I can go to my…

09:34…hydrography dataset and I can find data that is within, say, away a distance 100 meters from a fish-bearing stream.

09:42I'm looking to locate this, say, as a warehouse, so I want to be in a zoning district that supports that usage.

09:49You know, a commercial or industrial manufacturing-type usage. And what else?

09:55Oh, I need to be, say, within a mile of a freeway onramp.

09:59All of these data layers could be interrogated to come up with a portion of it that satisfies the individual criteria and…

10:09…then when we collapse it all together, we're left over hopefully with a few patches that satisfy all that criteria.

10:17So data naturally integrates in a GIS. Now, what are we talking about when I talk about GIS data?

10:26There are really two primary models we're talking about, vector data and raster data.

10:32By vector, this is where we were describing phenomena and things, real-world things, administrative things, by points…

10:41…lines and polygons. Raster, then, is where we're…we've organized information about the world, about the area that we're…

10:49…interested in, in the form of images such as aerial photography or satellite imageries.

10:56It could be other types of scanned information from airplanes or from satellites, not just the visual spectrum that we…

11:03…interpret as a photograph, but infrared and ultraviolet and any other width…sections of the electromagnetic spectrum…

11:12…that could be picked up from a scanner. For example, this is used often in vegetation and other types of analysis…

11:20…from satellite imagery where they can determine from the wavelength what particular plant or crop or other type…

11:25…of vegetation is growing below. Each different type of vegetation gives perhaps a unique wavelength when it's…

11:34…picked up from the…which is picked up by the scanner; so multispectral imagery.

11:40Raster's also used for things like elevation. I might want to map and understand the elevation of an area…

11:47…so I can see that variation through the raster.

11:50I can color the pixels of that raster in different colors representing different elevations.

11:54You get the nice continuous variation across an area.

11:59Rasters can also be used to describe specific categories of phenomena. So I'm looking at land cover or zoning again.

12:09I'm going to have portions of my raster indicating the commercial zone, other portions representing industrial…

12:14…commercial, residential, and so on.

12:17Mostly, however, we use vector for things like that, where we have very discreet, hard boundaries between the…

12:24…commercial district and the industrial district and the residential district, or between the boundary of San Diego County…

12:32…and the next county up and, or between the boundary of the side of the road and the property next to it.

12:41Vector data gives us a way to describe those very precise distinctions in some quality or some phenomena that we're mapping.

12:51Raster, on the other hand, we use that model primarily when we're talking about phenomena that varies in a…

12:58…more continuous manner. Elevation is a great example because anywhere I go around here, anywhere I can walk to…

13:05I'm standing on something that has an elevation. And if I go far enough, I'm going to be changing that elevation.

13:12The raster data can nicely show me that variation.

13:20So vector data, examples of that. We could be talking about fire hydrants, describe them as points.

13:25We can attach some information, some descriptive information about those points, which we would call the attribute table…

13:31…and we now have a working dataset for understanding fire hydrant locations.

13:36Streets we would represent by lines. And again, we could have some information behind those lines.

13:43Each record, each row in these tables then would correspond with a segment of each street.

13:51And then finally we've got something that represents areas like property, parcels.

13:56Alright, so in our data, our data would look something like that and if we were looking at the attribute table of it, then…

14:01…again, we could have some kind of descriptive information about it with each row representing each parcel in that data.

14:14Raster data, on the other hand, as I say, gives us this continuous variation of phenomena.

14:20It could be something like the change in elevation as we go across the land, or the change in light reflectent value picked up…

14:28…by a camera or a satellite scanner. Or the item, the example on the right there is an example of categorical data…

14:36…where we've taken each pixel and coded it in a certain way to represent some kind of land use.

14:43If we look at that data closely, we see it's just an ordered set of square cells, equal sized, and each cell is representing…

14:53…some area on the ground. It could be a square meter. It could be a square foot, or even smaller, in some cases.

14:59It could be as large as a kilometer or more, alright.

15:03It depends on what your data is, where it came from and what it was developed for. But the point is, is that…

15:10…every single one of those cells then holds onto a single value and that value represents whatever the raster data is about.

15:17Is it elevation? Then it's probably in a value representing meters or feet above or below sea level, okay.

15:24If it's categorical like vegetation, it's holding onto a number, but that number is meant to represent a code, not an…

15:32…actual measurement or count or statistical value. Alright, again, so, yeah, we could look at it, if we could look…

15:41…and see the numbers behind that, we'd see each cell then holding a value. In a way, you could say that this is the attribute…

15:49…the only attribute that a raster dataset holds. It's that one value for each pixel, each cell.

15:59Alright, well, how do we make this stuff? How do we acquire, well, we can acquire it, but if we can't acquire it, how do we make it?

16:06For vector data, there's a number of ways. We can digitize it. We can use ArcGIS Desktop software, in fact…

16:13and there's other software out there that does this, where I can convert paper maps into digital data.

16:22I can take a puck or just a mouse, and I can trace along features like the boundaries of a parcel or the trace of a…

16:32…river, the course of a river to create a river dataset.

16:35Basically just clicking and approximating the location of a feature. It gets captured by the software and stored as digital data.

16:45This could be done from existing maps, paper maps, or it could be done from aerial photography.

16:52In fact, probably aerial photography is probably one of the biggest sources of vector data. It might come from survey data.

17:00So surveyors going out and collected very precise data about position and distances and bearing and so on.

17:09Data can come from automated devices like GPS and other laser ranging equipment.

17:17Vector data can be converted from imagery from scanned imagery or from aerial imagery.

17:23You can use special software there to convert it into points, lines, and polygons.

17:29Or it could be coming as output for some kind of processing.

17:32Some of you may be learning a bit about the geoprocessing you do with the software.

17:36Often the output of that is a new dataset which will be of a type vector, a vector type.

17:44How do we make raster data? Well, it comes from equipment that can capture large bands of information in…

17:53…pixels, like cameras mounted on airplanes and scanners mounted on satellites.

18:02We can process it a bit to classify the information coming from imagery.

18:06So using special software, you can, again, determine, say, the pixels of this value represent a certain type of vegetation…

18:14…and then turn the value of those pixels into a code. Again, we can output rasters as part of our geoprocessing tools.

18:25That's the very basic ways of making data.

18:28I just wanted to mention a couple of other types of data you may come across. In addition to feature classes of point lines…

18:34…and polygons, you could see data representing annotation, basically text on your map stored as data.

18:42Dimensioning. You know, see any kind of survey type data that includes arrows and dimensions and that's a…

18:49…type of dataset or data type. In the terms of raster, then we can assemble rasters together; so old datasets for…

18:58…different raster, maybe shot or flown at different times, but they can be assembled into a group and shown at once.

19:04A raster catalog and a raster mosaic are special types of those groupings of raster data.

19:12Some perhaps even more complex types. Geometric networks…so if you're involved in utility networks or hydrology…

19:20…studies, you probably get to know more about geometric networks and network datasets.

19:26Network datasets can do things like routing and survey, service area and other types of analysis of trade areas.

19:35There's complex datasets we call parcel fabrics.

19:39So if you're involved in cadastral mapping, you'll want to become familiar with this idea of parcel fabrics.

19:47There's relationships, there's terrains, three-dimensional representations with vector data.

19:53Triangulated irregular networks, TINs. That's been a data type for a long time.

19:59And topologies, where we've organized our vector data to conform to rules about the relationships of features…

20:07…within a dataset or with features from dataset to some other dataset. There's a spatial relationship between them.

20:14So you'll see other types such as those named here.

20:20Alright, I've just talked about the models and some types of data there. What's some other things that you need to be…

20:28…considering about as you go about acquiring data and understanding data?

20:33When it comes to ArcGIS, we need to know something about formats, so I'm going to just click on a link here which is…

20:37…taking me to ArcGIS help for the desktop, and there's a page that describes the various formats supported by…

20:47…ArcGIS Desktop, and there's lots of them. You could see if somebody recognized DWG and DGN, these are CAD-type files.

20:57There's Open Geospatial Consortium services, various types of tables, lots of different types of raster formats. SDC…

21:05…you might come across that; this is a spatial data compressed format. Shapefiles, a very popular format. Text files…

21:15…Excel files, and the list goes on and on.

21:20If a particular data type that you're looking for, you've acquired and you want to use in ArcGIS Desktop, is not…

21:24…supported natively, there's a good chance it can be supported through an interoperability extension.

21:32Alright, this allows several dozen more formats to be supported by the desktop.

21:42What else do you need to be concerned about? How about scale?

21:49Did anyone have a look at the maps in the Map Gallery last night or at some point today?

21:54Probably every single one of those maps has indication on them about the scale.

21:59Alright, 1 to 250,000, 1 to 10,000 perhaps if it's a small city. Well, those are paper maps. We're talking about GIS here…

22:07…where I've got interactivity. I can zoom right in or I can zoom right out.

22:11Why am I concerned about scale? I can zoom to any scale I like. Well, data has an appropriateness for scale.

22:19I can have very generalized data, which would be nice for, say, showing the outline of the country or continents or a very…

22:27…small-scale map, but as I zoom in closer to it, the coarseness of that data starts to reveal itself against more fine-grained data.

22:35You know, a good test of this is if I had an aerial image as one layer and this other dataset on top of it.

22:43If it didn't line up very nicely in a way that seemed visually pleasing, then I would say that I've kind of exceeded the…

22:48…scale limitations of my dataset. In other words, you want to group your layers together with appropriate scales.

22:58Kind of the same idea here's the spatial resolution of raster.

23:00I mentioned that in raster data, we're talking about a square representing a certain area on the ground.

23:06One meter, or it could be a kilometer or more.

23:09Obviously you want to have some kind of consistency in your data sort so that they make sense to work together.

23:16Accuracy, of course, is always important. Various levels of accuracy of data depending, it could be survey level…

23:25…it could be more community gathers data. You want to be aware of the differences that exist.

23:33Finally attributes, the descriptive information about our data, and I'm talking about vector data here.

23:40Is it going to suit the types of operations and the types of analysis that you're looking to perform?

23:51Alright, well, enough about data. Let's start looking at the sources of it.

23:56Now I mentioned most of it's not going to come with a software, in fact, well, up until the ArcGIS 10 release, we used…

24:02…to ship with every box of software a nice little packet of several DVDs. Very rich US data, but also global data as well.

24:12That data on DVDs is still available, but I think you have to now order it as a separate delivery.

24:20And the reason it's not offered automatically anymore, I mean, this is still available; this just got shipped to me last week…

24:28…is that a lot of it now is available…that same information is available online and you can just download it.

24:34Download the same data that used to come in those packages.

24:38And I'm going to hand it over to Eric here to give us an example of that and some other types of online data.

24:44Alright, thanks, Paul. How many have seen this disk in your organization? How many have lost them?

24:52How many actually borrowed it off of somebody's desk and forgot to tell that person that, hey, I borrowed the disk…

24:57…and then it goes missing? Anybody come across that? Yeah, that's what I thought.

25:02Most people find these disks, they hang onto them, they're a good source of data to start with.

25:08And so let me switch over here to my laptop. There we go. And in order to find these disks online, it's very simple.

25:18This is the main page of the Esri website, www.esri.com, and what we have here at the very top is a link to the products…

25:29…but real quickly, there's things here called Add Data to Your Web Map.

25:33How many saw Bern Szukalski's demo with adding CSV files to ArcGIS Online? Did you guys like that?

25:41Okay, you could start with Excel and make CSC files that as simple as x and y data.

25:47We'll actually work with that here in a little bit. So that's one form that we're going to come to.

25:51But there's a link at the top here called Products, and if you click on this Products link right here, and right down…

25:59…here at the bottom is the data. How many have ever visited this page? One, two, wow, three, four; okay, that's what I thought.

26:07Most people have never come here. I'm an instructor, so is Paul.

26:11Every time we teach class, I find more and more people don't even know that this exists because this is one link…

26:16…that you can go to, to start looking for data.

26:19So right here is…click the Data link, and one of the things that we'll talk about is that if you can't absolutely make…

26:25…it or find it, you'll have to either find somebody that will make it for you. So some of this is free.

26:30Some of it may cost because you're having somebody to go out there and collect it for you, which may save you time and effort.

26:38So one of the things we have here, there's different aspects of the data here.

26:41We actually have a Data Appliance inside your organization. So those of you that have a secure facility that can't get out…

26:48…to the Internet, you can actually purchase, for example, the ArcGIS Online content for internal use for that.

26:55But everybody likes this one here at the bottom, free. Everybody like the word free data? Yeah, that's what I thought.

27:02So, yeah, there's some things about using some free data. For example, how often is it updated?

27:08What use can you actually use it for? These are things you need to ask yourself while you're looking for these…

27:13…data sources and we'll show you some things to look for in our demos.

27:18And the one thing I like about here…this is the link right here for the data and maps for ArcGIS.

27:24That's the link that you'd want to go to, these DVDs that come with the software.

27:30So if you go right there, click this link right here, and it's going to give you a chance to order this, so you can…

27:36…actually order the DVDs like Paul mentioned, or you can go in here to download those from ArcGIS Online, okay.

27:44So you just click on those. For Server, okay, there's the ones for there. Let me come back here.

27:51Here's the data and maps for this, and at the very bottom of this one, this one's for the desktop, but right here…

28:00…is Download Data and Maps from ArcGIS Online. So you don't really need to have the disk anymore.

28:04Those of you that have dial-up speed Internet connections, I've had some students from Alaska, they will not be able…

28:11…to download the data 'cause you're talking about gigabytes and megabytes of data that you're going to go through and…

28:17…pull through for some of this stuff that you're looking for.

28:20How many knew that this was available? Did you guys learn something new right now?

28:24[Audience response] Yes.

28:25Okay, good. Paul, we're on the right track. So that's where to get started. Okay, now, what happens if you can't find stuff?

28:33Where do you go from here? Well, how many go to resources like this? Search engine…how many go right there?

28:44How many have…that have find out that's the proverbial needle in a haystack? How many spent hours looking for stuff?

28:52Yeah, and so one thing you definitely want to do when you're using search engines is to watch what you're looking for.

28:59Do things like put things in quotes. Use the and and or for Boolean searches. Use the word not.

29:06Sometimes you'll find what you're looking for, sometimes you won't.

29:10So for example, if I have to make a map for the city of Austin and I want to find resources for the city of Austin…

29:16…well, I could just come in here and just type in Austin and just do GIS data and hit Enter, and lo and behold…

29:27…right off the top of…the first thing is an FTP site right there.

29:32So coming in here and searching, you have to make sure when you're looking at websites that you can go in there and find…

29:37…them quickly and efficiently for that. And so, let me go ahead and click on this link.

29:52And I think I already have it right there. There it is. Brings it up.

29:55Here is the city of Austin GIS datasets that you can come through and look at.

30:00The one thing about looking on websites is to make sure that they would always have a disclaimer about the data…

30:06…whether how you could use it, whether you could use it for business use. Okay, for internal mapping, maybe fine.

30:12Business use may have some other issues there. You may have to get permissions to use this. They'll let you know that.

30:19And the other thing you'd really want to look for is how to find stuff quickly. And have information about stuff like this.

30:27For example, one of the things we'll end up doing is making a map in Austin, and let's just go down here and…

30:32…take a look at stuff. I'm going to take you to the environmental section right here.

30:36And the one thing I like about this website is it gives you some information, 'cause the one question you always have is…

30:42…how current is the data? That's fine if I'm working with 1990 census data and it's 1990, but what year is it now? It's 2011.

30:53What year did we just do the census in, 2010. So one thing it'll actually tell you is when is last update.

31:01So I'm going to scroll over here to kind of let you guys see that it will actually provide you some date information…

31:06…when it was last updated. And so, information like that, the format that it's in, point, line, and polygon…

31:13…this is actually going to be vector data, and it's…they're zipped up.

31:17And the nice thing about this data is that it actually gives you the metadata that you can go on and click on and…

31:24…see exactly what that dataset's about before you go and download it.

31:28Things like fields, the attributes that they're storing in there. What do those mean? What do they represent?

31:34That type of information's important when we're making a map.

31:38And so having the ability to come over here, and it looks like I'm going to be really slow today, Paul. There we go.

31:47So here's the metadata and it gives me some information about how to use this dataset.

31:53So looking at websites like this are very useful in evaluating what you could do.

31:59Now you could spend all day searching online doing keyword searches using your tips and tricks for search engines…

32:05…but there's one of the things you could do is find resources that are already put together, okay.

32:11The already maintained lists. And why go back and reinvent the wheel?

32:17And this happens to be from Harvard.

32:19And I just went in and did a keyword search for Harvard GIS and this is the website that we have here.

32:26And the things that you need to look for, things like it says public data resources.

32:31A lot of colleges, universities, a lot of government agencies, a lot of organizations that are [in] charge GIS and mapping will…

32:38…actually maintain lists like this so you come over and look. How many have actually found resources like this?

32:45I just make bookmarks for this. I just create a folder in my bookmarks and just kind of keep a running list and because…

32:53…these things change all the time and so I like, it's pretty well-organized for this. It's done by financial businesses.

33:01Maybe I should zoom in a little bit so you guys can see this a little bit better.

33:05So it gives me financial businesses, gives me links on what I'm looking for and it gives me federal…resources.

33:14It gives me also state data clearinghouses. That's another, like I just mentioned, a excellent resource to go through.

33:22And, of course, those of you that are international can come down to the international data indexes that are there.

33:31Now, even though we're talking about mapping in geographic data, don't be afraid of finding nongeographic data sources.

33:40Tabular data sources like in Excel or Access that you can access and bring in.

33:46For example, here is a link to the UN data. I already have this up right here.

33:51And what we have here is a series of data that's collected by the UN. And they have a section on databases.

34:00And I can come over and find information about data that I want to use.

34:06Now there's a little bit more work. We can come back to this a little bit later on on how to bring this in.

34:10So, for example, I'm going to do energy statistics, and this is all the information that we want to look at.

34:21Okay. So this is some nice resources that we have here. And let's take a look at total refinery output here.

34:28And we get two options here, either output and throughput.

34:32This gives me a chance to preview what I'm looking at and see if I can use this or not.

34:37So if I go in here to view the data, well, I'm going to get a lot of data at my fingertips. I got 91 pages.

34:48So you may have to think of things like maybe this is too much information.

34:51So they do have like, for example, I'll just pick like the last year, and they have filters that I can come down and apply…

35:00…to this and reduce the dataset a little bit more.

35:05Once I get it to the format that I want this to be in, well, the nice part about this is download.

35:10Things like this—very easy to navigate. Easy way to go through and find the information. That's very useful to know.

35:17Look for websites like that.

35:19If the website's not very useful for you to find the information, chances are you're not going to find what you're looking for.

35:25So I hit Download and then look, it gives me a common separated value, semicolon, XML, or even a pipe, and I can…

35:32…save this file and then go use it with a join or a relate, which we'll do a little bit later on.

35:38Everybody good? Alright. So that's some, the ability to look at resources.

35:44Also, take a look at other resources, how they offer it.

35:48This is my hometown, city of San Antonio, and look for things that say "download GIS data."

35:56And the one thing that's interesting about this is because Austin does everything in shapefiles, where the city of…

36:02…San Antonio does it with file geodatabases.

36:05So part of your tools in your tool belt that you would need to have is how to convert data back and forth…

36:10…and it's really straightforward with ArcGIS Desktop.

36:13The vast majority of the formats of data went from a shapefile to a feature class in geodatabase can be converted…

36:21…quickly and easily and done very automatedly through some scripting.

36:27So this little information like that, you need to kind of file away in the back of your tool belt to kind of have that…

36:34…information that this is going to be a file geodatabase versus a shapefile.

36:41Okay, Paul.

36:43Eric, could we also have a look at just ArcGIS Online really quickly?

36:46You know, I paused for a specific reason for that. How many of you used ArcGIS Online?

36:51How many have had to make a map and they needed reference data for a basemap just to quickly go through and do that?

36:57How many of you actually used ArcGIS Online again? Handful?

37:01Alright, let's go in here and take a look at this. I like ArcGIS Online, Paul. I'm glad that you asked that.

37:06ArcGIS Online, you've probably seen in action in the plenary, and this has become very useful.

37:10So let's say I have to make a map for the city of Austin.

37:13I need to find bike lanes and landmarks. Now obviously I can come back here into the city of Austin and what I was…

37:23…able to do here was to scroll through here and there's one dataset that I know that I'm looking for and it's this right here.

37:31Let see if I can…oh, did I miss it? Did I pass it up? I think I passed it up. It's called points of interests are here.

37:41Okay, downloaded that already. It's a ZIP file exported out as a shapefile. So I already have that data.

37:48So I need to take this data for landmarks, and I need to make a map.

37:53Now I don't have any other data for the city of Austin and so let's go to ArcGIS Online and see what I could use.

38:00It's very simple. When you come to this website, www.arcgis.com, you come over here and search. Just type in keywords, Austin.

38:12Now the great thing about this, you get some resources which you can start using here.

38:16So I could just, let me go ahead and blow this up. So for example, this is a community basemap.

38:22It's put out and sponsored by the city of Austin, that we host.

38:26And the nice thing about this is that I can open this up either in Desktop or ArcGIS Online.

38:33I'm going to open this up in Desktop.

38:39And I say Open, and that's going to launch ArcGIS Desktop for me.

38:50So Eric, what's happening here? Are we downloading data, or are we…?

38:55I'm glad that you asked that, Paul. So the question, am I downloading data? Yes and no.

39:00It just depends upon the type of service or the type of item that's been put up on ArcGIS Online.

39:06Some of this is layer packages, which is just the layer file of just properties of the layer, like labeling, symbology…

39:14…scale ranges, et cetera. Others are layer packages that have the layer properties and the data.

39:19Some are complete map packages that you just open it up into ArcMap and everything is there, the layers and the data.

39:26So just to really depends upon whether you're streaming it in from the Internet as a map service, or you're going to…

39:31…bring it in as a package, and the one way to tell is when you go to List by Source for this, it's actually going to be…

39:41…brought in as a service, 'cause otherwise, it would actually be on my C drive location.

39:46So this is the community basemap for Austin. So I need to make a map for bike lanes.

39:54I don't have any data for bike lanes from Austin. The other way to access ArcGIS Online is through the Add Data button.

40:02The only time I actually used the Add Data button in 10 is to come here to either add the basemap which I already have…

40:07…or I could go to add data from ArcGIS Online. And the issue I have with this screen is that with presenting this way…

40:19…I need to move this around a little bit. So I could come over here and search for this.

40:24Now the great thing about ArcGIS Online is that if you have a sign-in and you already have groups, you could search…

40:33…for your own data in your own groups. And you get a couple more tabs that could search here.

40:39So I'm looking for Austin data so I'm just going to type in Austin. I need to move this, scroll this down a little bit.

40:48[Audience question] Is that pulling from the web right now?

40:50It's pulling from the web. It's all through ArcGIS Online.

40:54Yes, ma'am.

40:59[inaudible audience question]

41:01No it's not in the cloud, it's all in my desktop. Alright now, all this is…

41:04[inaudible audience question]

41:08Oh, the service is actually sponsored by, it's hosted by us, so that basemap service I'm pulling in to my MXD.

41:13The MXD will reside on my C drive.

41:17So, now let me bring in the bike map, the bike routes here, and I'll show you the difference, okay. Click on Add.

41:24Now this is actually a layer package.

41:27When I bring this in, see, it actually gives me a path to my, this is actually a layer package that's already been symbolized.

41:33It already has the data. I brought that in from ArcGIS Online, whereas, this…the bottom one is a map service hosted by us.

41:40It's a service that you would have to be connected to the Internet to work. This map document is actually, resides on my C drive.

41:49So let's go ahead and just zoom in here to downtown Austin.

41:53And so, now I could go on since I've already downloaded my data.

42:07Go in the Add and drag and drop my layer file in.

42:11It's already been symbolized, and I could quickly make a map, and I probably should drag my historical landmarks…

42:23…above my bike routes and go on and finish my map up.

42:27So I found a set of data online from Austin. I downloaded it as a shapefile. I symbolized it.

42:34Like you see here, I found the bike maps that were online as a layer package, and then I brought in the basemap…

42:39…from the community basemap service. All making a map and just knowing where to search or bring these…

42:46…resources together, I can quickly make a map and off I go.

42:52Thanks, Eric. Yeah, so I just want to point out that that basemap is an amazing timesaver.

43:00You know, as I said before, in the old days you had to acquire data even with a lot of data resources available to me…

43:06…even, you know, fully available local data on a well-organized disk, it would take me quite a while just to make the basemap…

43:14…just the context on which I would throw my real business data, the information I was trying to analyze.

43:21Just as a background, these basemaps are great. It just saves me a whole lot of time.

43:25And you will notice as I zoomed in as Paul was talking that the basemap changed into showing you the buildings…

43:33…going from there, I'm just going to go ahead and hide this a little more and so it changes depending upon the…

43:37…scale that you're making the map.

43:39But I don't have to worry about cartography, labeling of the reference basemap stuff. I'm done. Off I go.

43:48Turn me over.

43:50I'll switch you over.

43:54Great, thanks, Eric.

43:55Okay, so that was an example of online data both using online services in ArcMap as well as using online sources where…

44:04…you download the data to your own local drive and then use it in your map.

44:11So you also did download there, just so we had ArcGIS Online content.

44:14We looked at using search engines to find data.

44:18Really these days just typing in "GIS data download" and then some keyword representing the type of data or the location…

44:24…you're looking for can be just, find, usually find you the data you're looking for.

44:29Premade lists like the Harvard site is a great collection of different data sources. And we looked at nonspatial types.

44:37So Eric downloaded the refinery information which was just tabular data.

44:42We're going to turn that into geographic data coming up in a moment.

44:47In the US, at least, I think pretty well every state and local government seems to have, at least the largest local governments…

44:54…have GIS data clearinghouses. I'm from New York City, and Bytes of the Big Apple are the GIS data mine.

45:03New York State has great resources. I think they all do. So we're very lucky here in the US.

45:09Alright, so now, that's acquiring data from a variety of sources.

45:13Sometimes, though, you've got to resort to making your own data.

45:17One of those sources of making your data might be GPS.

45:21I'm particularly tickled to talk about this because I don't know if this happens to you. If you're describing your interest in…

45:26…GIS, I describe it, even to my family still, I think all these years, oh, Paul's a GIS…and when people ask me, it's always…

45:34…"Does that have something to do with GPS?" Do you get that? I get it all the time.

45:39Anyhow, yes, it does have something to do with GIS, but just a little part, the data part, and Eric's going to show us a…

45:44…demonstration about making, getting, acquiring GPS data and actually bringing it into ArcMap to use it.

45:50How do we do that?

45:51Alright, thanks, Paul. [inaudible] Alright, this is my little eTricks legend.

45:58It's a little consumer-grade GPS unit and this is what I can go out and start creating my own data.

46:04It's a little bit of a lengthy process to do but just to show you that it can be done.

46:09Can you go out and get a more expensive unit that does a higher-end data collection like you'll see down in the Exhibit Hall?

46:15Yes. So here's what I did. I went out and collected tree samples where trees were located in a park to give them as markers…

46:24…for their trail map to update it for a park and so I want to be able to bring this in.

46:29So one little program that I actually do use quite a bit is something called DNR Garmin and this is a way that when…

46:37…I fly, I actually get my track when I fly across the country and I could keep track of that.

46:42So what it is, I need to get my data I've actually gone out and just collected trees with and I've just taken points with this.

46:50Now when I click data like this, the one thing I have to do, because this is not a very good unit for actual data collection…

46:56…as far as attribute information, I had to collect it on paper.

46:59I could record the latitude and longitude and then store that data in my GPS.

47:05And now to get that data out of my GPS, I use this little DNR Garmin and just go to tell it to save it as a text file…

47:13…and once I do that, I can just give it a name.

47:16And the great thing about this is that I can automatically turn this into geographic data.

47:20This is a little free program. My little inexpensive GPS, I can go out there and make data for this.

47:28Now I already have this saved.

47:30The big thing about working with this is to be able to bring it into Excel, and so having some good Excel skills definitely helps.

47:38So I'm just going to go ahead and open this up and bring this in.

47:41So this is the actual text file that I actually have saved already onto my computer and I just have to walk through this…

47:48…little wizard for separating this out and it's very, pretty straightforward because it's common to limited text file…

47:56…and just bring it in while I'm done and then if I want to go through and add attribute information to these features…

48:05…I just go put the fields in like this, type and off I go and I will fill those attributes in a little bit later on.

48:14Once I say this is an Excel spreadsheet, I've just basically just created some data because its in a, it has an x and y in this…

48:22…field that I can use, this latitude and longitude here.

48:27Now the big thing about working with GPS data, ArcMap likes to work in decimal degrees so when you're actually…

48:35…going to go out there and collect data, set your units to collect it in decimal degrees and…

48:39…usually the coordinate system for the unit should be in WGS 84.

48:45So once I save this, I'm now ready to go into ArcMap and of course, I'm going to go in, and let me go grab this real quick.

48:57And here's the Excel spreadsheet. I bring it in and of course, there's nothing there because it's nonspatial data.

49:04It's stored in an Excel spreadsheet. So to turn this into basically geographic data, I'm going to right-click and display as x,y.

49:15Okay, the x field is going to be my longitude field and my y field would be my latitude field.

49:23Okay, click Edit, and I need to specify the coordinate system, which happens to be WGS 84.

49:28I'm just going to go specify that real quick, and Paul, I knew this was going to get to me.

49:42Okay. Okay. There we go. Maybe. Okay.

50:01You just need to expose it [unintelligible].

50:11In your comments, if you'd like to ask us to get San Diego Convention Center to give us some high-definition monitors...

50:19Projectors.

50:20Projectors.

50:21I can almost…

50:22It's time to invest to invest in those, I think, or Esri should invest…

50:23There you go. Cool. There you go. Got it. Thank you. Now what happens here creates an event theme.

50:31So one of the things I wanted to be able to do is to right-click on this and to turn it into true geographic data…

50:37…is to export this out. If I don't export it out and turn it into a shapefile or a geodatabase feature class, it's just an event theme.

50:45It just resides in the map document.

50:48So I'm going to go ahead and put this out and go ahead and put this in as my plant markers.

51:01Now that I'm saving this as a geodatabase feature class, I can now use this at anytime. Off I go. So, pretty straightforward.

51:12And I could label those, and I'm going to just scroll down here real quick and turn this events theme off. There it is.

51:20Now, what's missing in this map?

51:23[audience response] Basemap.

51:24Basemap. And bring this in. And of course, Paul.

51:46It's just data…

51:47It's just a little slow in coming this in, but when it comes in, so…

51:50Okay, why don't we give that a few more seconds to do that, but let me just understand, Eric.

51:53So you took your raw, you have a fairly inexpensive GPS collection device and it didn't allow you to actually input…

52:01…the descriptive attributes about what you were surveying directly in the device.

52:06So I know there's devices out there that do do that. You can create forms.

52:11ArcPad is also…and ArcGIS Mobile allows you to do this as well…

52:15…to create forms to do direct data collection with your device.

52:18Sure.

52:19You chose to use paper form and then integrate this data later.

52:25And also you chose to save it as text file so that you could bring it into excel and you could augment that with…

52:29…some additional columns. 'Course, these devices also output directly to spatial data formats if you [unintelligible].

52:36Absolutely. I did this to show you how easy it is even with a consumer-grade unit to create geographic data…

52:43…and get up and running.

52:45In fact I don't even have to use a GPS unit to do so if I know how to get an x and y off of ArcGIS Explorer Desktop.

52:52I can do it that way and do the same exact process here. So, okay, Paul.

52:57Great, thanks Eric.

52:59[inaudible audience question]

53:02It's free from Minnesota DNR.

53:03They're unfortunately, Minnesota government has been shut down. Unless you find something that cached that website…

53:10…I do happen to have a copy. I'd be willing to give you a copy of the executable if you want it.

53:15So, okay, Paul.

53:17[inaudible audience question]

53:27Yeah, you could use the stuff, if you have a program that actually collects stuff from the iPhone…

53:31…and have a way to export it out. You'll have to figure out what that process is to export from iPhone or iPad…

53:38…from that device to some format like a text file or whatever and bring that in.

53:44[inaudible audience question]

53:46I probably could figure it out if we had, which depends upon which application that you're going to use.

53:51So, but we'll talk after a bit and we can take a look at it because I have an application we can look at. So, welcome.

53:58Yeah, and we'll certainly have a lot of time towards the end then to take questions as well.

54:01Eric, could you switch me over please?

54:02Yup.

54:03So thanks, and so just to sum up then about GPS then, in Eric's case, then as an example, we captured it and…

54:09…saved it as an x,y table. We were able to display x,y data. As long as it's got some kind of coordinate information in it…

54:15…we can use that coordinate information.

54:17We can tell if the software what do those coordinates mean, is it latitude and longitude or is it the coordinates…

54:23…of some other system. As long as we tell it what it is, ArcMap will automatically plot it out.

54:31Okay, and unfortunately I guess the download from the Internet was coming in fast enough there to see the basemap…

54:38…in there, but that nicely rounds it out.

54:40Okay, well, there's an example of making data. I wanted just to show a couple of other examples of making data here.

54:48Let's go to ArcMap myself here and I do have a basemap up here and you came in, you flew in from…

54:57…San Antonio the other day?

54:59Yes.

55:00Do you have a window seat?

55:01Yes.

55:02You did. Did you get to see out the window?

55:03Yes, I did.

55:04Did you know what you were looking at?

55:05No, but I recorded it.

55:07It's a lot of brown dirt, as I recall.

55:11Well, I always thought about this. I know I can create data in ArcMap. I can use ArcMap directly to create data.

55:17And I'm just going to do an example of that.

55:19I'm going to use my catalog interface here to go to an existing geodatabase and I'm just going to add a new feature so…

55:26…what I'm doing is right-clicking on my geodatabase. I'm going to add a new feature class. This is vector dataset.

55:33A geodatabase vector dataset. I'm going to give it a name here.

55:37We're going to call it Flight Path, and it's going to be a line feature, or what we call a polyline feature, multiple lines.

55:49That's the first part of this little wizard. The next thing is I need to tell it, well, what's the coordinate system?

55:53That's the other thing about any spatial data, probably the most fundamental thing to know is that it has a coordinate system.

55:59True spatial data has a coordinate system.

56:03And let's see, I'm going to use the same coordinate system that that basemap is using, which is a projected coordinate system.

56:11This is something that's probably worth remembering. The WGS 1984 Web Mercater coordinate system.

56:19That's the same one that ArcGIS Online and Google and Bing use. And the rest of this stuff I'm just going to leave by default.

56:28Well, maybe I'll add in a descriptive column here, call it Description or Desk.

56:36Alright, so I've added flight path as a new, empty-line dataset, a feature class, and I'm going to bring that into my map.

56:47There it is added to the top. It's got a little symbol here. Let's make it a little brighter red.

56:53Now we don't see it on my map because it's empty at this point, but what I'm going to do is start an…

56:56…editing session to create data.

57:00So, let's do that. I'm going to go into the Editor toolbar and start editing.

57:04It brings up a feature creation template over here, which I can then use, I can click on to go in and create data.

57:11I could start at, I'm going to just approximate the San Diego airport here. No, let's start in San Antonio. Where was that?

57:20Just got to pan over a bit. There you are. San Antonio.

57:25Let's start our new feature right there and let's carry over a bit to San Diego.

57:34Now…and I'll finish this sketch here. I have a new feature. Now that's just a direct straight line.

57:41Oops, don't want to make a new one. That's just a direct straight line. Fair enough.

57:47Sometimes you want to make straight lines. You can make polygons and points as well, but this other more sophisticated…

57:53…tool is in editing here. One of them on what's called the Advanced toolbar has something called construct geodesic…

58:00…which is basically to construct a great circle line.

58:04So I'm going to do this. Actually, maybe what I should do is just zoom out a bit here so I get both of these spots.

58:09I'm going to use this little tool here which is kind of neat.

58:11It brings up a dialog and it asks me to click on the starting point here, and I'll click on the starting point of the end location.

58:23And I'll click that and it creates a new feature and it's actually done it in a geodesic calculation.

58:28More or less, the flight path presumably that your aircraft took.

58:33Alright, this way you could study it up close. Oops, you know what I didn't do? I didn't save it. Let me try that one more time.

58:40Click here. Click here, and the last step is to create it. There we go. That's what I missed before. And here we go.

58:51Now I could probably just get rid of that other line here since I don't really want that. And I'll just click Delete and it's gone.

58:59I'll finish my editing up here. Do I want to save my edits? Yes. And there's my first flight path.

59:04Now I could give you a more dramatic curvature by flying to London, or something like that, but you get the idea.

59:12So that's an example of creating data. I'm going to give you another example here.

59:15I'm going to go to another data frame here. Eric showed you how you could download data.

59:23I took up his suggestion there and I went to San Diego's, or the association of governments in San Diego…

59:30…SANDAG website. They have a lot of geographic data available there, one of which is to outline the neighborhoods.

59:37So you know there's very specific geographies and ZIP Codes and census tracts, but another interesting one is just…

59:44…what the community decides are the neighborhoods within a city. And this is a dataset that I downloaded.

59:50Let me turn of old Starbucks there for a moment. This blue here.

59:54Now I looked at it and I go, well, this is kind of interesting, it's kind of got it reaching down to the border and above into the…

59:59…north county, but somehow it missed all this spot in the middle, I guess that's Chula Vista and National City and other areas.

1:00:06And, you know, for what I'm interested in doing later, I don't really like to have that missing part there.

1:00:12So I'm going to take some liberty here and just create myself a new polygon to add to this dataset.

1:00:19So once again, I'm going to go into my editing and I can click on my neighborhoods.

1:00:23There's some very interesting tools that we have here. One of which is called Auto-Complete Polygon.

1:00:31Now if I wanted to create any kind of other polygon, I could click on for example, a rectangle here and it would…

1:00:37…automatically create it, or a circle easily enough, or some kind of irregular polygon. I can do all that.

1:00:46Let me see if I can just delete those. Let's get rid of those since I don't really want them.

1:00:51What I'm interested in doing as I say, is filling that gap for my purposes.

1:00:57There's one here called Auto-Complete Polygon, which is really cool because it will take the boundaries of existing polygons…

1:01:02…and use them for my new polygon. So here I am. What I want to do is just fill the gap here.

1:01:06I'm going to click on my first part and let's kind of just follow the main road here.

1:01:13And I'm going to just click on that vertex and I can right-click because I'm doing is just drawing one side here.

1:01:21This is a part of my polygon, so I'm going to finish this part and I'm going to go over to the other side here and…

1:01:28…kind of just again, maybe follow the coastline a bit here until I've clicked on the vertex of the existing polygon and…

1:01:37…this time I'm going to right-click and say Finish sketch, and so it's filled in that whole space there, alright.

1:01:45Now that's just one of many interesting editing tools that come with ArcGIS Desktop.

1:01:50What else do I need to do about this. I should probably take a look at the attribute values here. I've added in a new feature.

1:01:59Somehow I managed to add a couple of features here because I've got two of them highlighted.

1:02:05So I could go in and just call this, you know, Southern Area or something like that.

1:02:14Alright, so I've created some data in this case. Just one example of doing that. Alright, so that's an example of making your own.

1:02:30Actually I just created a polyline for that flight path, as you recall, and then I just did the polygon there.

1:02:36We're not talking too much about raster data here because usually it comes from more professional sources like aerial…

1:02:41…photography companies and satellite imagery and so on, but I originally came across an interesting one for some…

1:02:47…mappers in New York City where they're doing, there's been a grant to plant a million trees in the Queens area and they…

1:02:56…want to capture that from above, so there's actually something to do called balloon mapping.

1:03:01Has anyone come across, or seen that?

1:03:04You can get a weather balloon, fill it with…you actually don't need a weather balloon, you can just get some bags…

1:03:10…and tie them together, you need some helium and some contraption that you can hold a camera in.

1:03:17They've got it all described here. It's really cool.

1:03:19And they float the camera up high, you know, a few hundred feet, and they've got a mechanism to take pictures…

1:03:25…I think it's just set on constant mode and it's taking pictures and they capture that.

1:03:29They get the photographs and then you can use software to move it into the right place.

1:03:34You can warp those images into place.

1:03:37And so you've got up-to-date, you know, up-to-the-minute aerial photography if you really need it.

1:03:42There's some interesting do-it-yourself solutions out there.

1:03:46Okay, now another source, a very important source, a very common source for geographic data, you might already have.

1:03:54If you're a business and you have customers with their addresses, or just maybe their ZIP Codes, or you have your suppliers…

1:04:02…or any other kind of information that contains addresses, patients and patient studies, you can take those addresses and…

1:04:09…turn it directly into geographic data. Eric, can you take us through that?

1:04:15Yeah, Paul. I may. I'm having a little bit of an issue, so we may see how far we get.

1:04:20I'm having some trouble with the Internet here, so. Alright, how many people like Starbucks? Seriously?

1:04:31Alright, well, let's go ahead and take a look at this.

1:04:35One of the things that Paul and I had done earlier was that we had gone out to the Starbucks website and we…

1:04:41…decided to go get the data for Starbucks. And so we went through and got that. Now where did I put that?

1:04:54Okay, where is that? I'm a little flustered because I'm not having the best Internet connection, so.

1:05:03There it is. It's text file. No, I had put it someplace else. There we go. I saved it as an Excel file.

1:05:16So we created this Excel file again, and we had to do a little bit of work to clean this up when we copied and pasted this…

1:05:30…off the website into like Notepad. We had to go through and clean this up.

1:05:34It took a little bit of time, but what we were able to do is take that Notepad document and turn it into a text file and…

1:05:41…then we were able to come over and bring this in and take this information and turn it into geographic data.

1:05:49Now it's very simple to do because you can do it for free. Does anybody have to work with address information?

1:05:56Quite a bit.

1:05:57Okay, you could use free resources like ArcGIS Online, you could do up to 100 addresses at a time for a thousand batch geocoding.

1:06:06So the things that you could upload for free.

1:06:09If you're going to do a lot, let's say, 25,000 addresses, well, how many people have time to go through and maintain reference data?

1:06:15That means that you have to go either the ZIP Code level or the street level and maintain address ranges on there.

1:06:21Anybody have that time? Anybody want to raise their hand? No.

1:06:25So one of the things you can do is you can actually pay for a subscription to batch geocode through ArcGIS Online and…

1:06:33…do up to 25,000 addresses at a time. And you don't have to maintain any sort of reference data at all.

1:06:40So I'm going to turn this into geocoding. And so I'm just going to tell it to geocode an address and I'm going to use…

1:06:53…the 10 North American geocode service. Anybody from outside the United States? Okay, you also have ones for European.

1:07:01This is in addition to the ones that you can create yourself.

1:07:07And what's going to happen here, it's going to basically prompt me to tell it how to take my addresses in my table and…

1:07:14…to geocode those, and I'm going to go ahead just take the defaults there.

1:07:24And of course, it's going out online and it's geocoding those addresses.

1:07:28It's turning that Excel file of addresses to points on my map right there.

1:07:35Now the one thing I wish I could show you here that's not coming in for me for some reason, is a basemap.

1:07:41So I could quickly take those addresses and add a basemap to this and go from there.

1:07:47I happen to have that, Eric.

1:07:48You happen to have it?

1:07:49Yeah.

1:07:50Why don't you just take it over from there.

1:07:51Okay, switch me.

1:07:52Because I'm having some issues here.

1:07:54I was actually, gave you a preview of it before here.

1:07:56I had the data that Eric had done the same kind of geocoding, I had a copy of it here.

1:08:00So that was the result of taking that list of addresses and putting it through the geocoding process of ArcMap using an…

1:08:07…online service and it plots it out in their locations. Not only does it plot them out, I can get information about them as well.

1:08:14I can click on this one up here in the north county and it tells me information about it.

1:08:18The data that we saved, that we scraped from the Starbucks website included all the hours and so on. So full information about those Starbucks.

1:08:27Now, we are running out of time here, so I think we're going to have to kind of cut this short, but what I wanted to show you…

1:08:32…is that, you know, an example of enriching the data, integrating the data, as I was talking about before when we first opened.

1:08:42I could see those Starbucks there, but you know, other than their location, which can be helpful, particularly around here…

1:08:50…because Starbucks in this building seem to be a little bit more expensive than the other ones. I was looking for…

1:08:58What if I wanted to do some kind of analysis on a neighborhood basis and say, well, you know, which neighborhoods…

1:09:05…have the most Starbucks?

1:09:07You know, that could be informative to me if it had something to do with my marketing or some other interest…

1:09:13…or where I wanted to buy a home, or maybe one day, or in dreamland I could buy a home here, but okay, let's…

1:09:19…take a look at, what about if I could get an idea of which neighborhoods have the most Starbucks.

1:09:24Well, what I need to do is integrate my neighborhood data with Starbucks and get a count of them.

1:09:30Well, I can do that. There's a tool which I can do a search for, something called a spatial join.

1:09:38And when I do that, it produces a new column.

1:09:42It reproduces my neighborhood dataset, but it adds a column in about the count of the features that it joined up with.

1:09:48And I don't think I've got it here. Yeah, maybe I do.

1:09:51I could just throw it into my map so that you can see what I'm talking about.

1:09:55I was able to create this dataset. It had a new column in it called Join Count, which I can use to symbolize on.

1:10:03So I'll now take my data and symbolize it on that.

1:10:08Quantities, the value is join count, and now I can see those neighborhoods then that have more than one, or no…

1:10:21…Starbucks in them, alright. Again, I've created information out of data.

1:10:27Various examples of this, but I hope you found that to be informative.

1:10:33Okay. There's a lot of things don't totally…there we go. So addresses, thanks, Eric. We looked at that.

1:10:41That's an example of enrichment. I'm sorry, Eric. I don't think we're going to get a chance to look at that oil refinery data.

1:10:46I want to leave some time to take some questions from you.

1:10:50We also, wanted, if we had time, to show you about adding value to data by documenting it. Giving it metadata.

1:10:57Very important topic. Probably the last thing anyone really wants to do because it's not as fun as the other stuff, but…

1:11:03…it is what you really cap off your investment in collecting and making data in is by making it searchable…

1:11:10…giving it authority when you use it any of your analyses or maps, and just making it easy to find ultimately.

Copyright 2014 Esri
Auto Scroll (on)Enable or disable the automatic scrolling of the transcript text when the video is playing. You can save this option if you login

Comments

Thank you for your question. Please refer to this resource: http://www.esri.com/data/find-data.html.

KarenJaffarian

Feb 13th, 2012. 11:30:34 AM

PLEASE HELP ME IN FINDING SAMPLE DATA FOR GEO CODING IN ARCGIS.

hiramanzoor

Feb 11th, 2012. 11:23:24 AM

Comment on this Video