00:03So the goals of this workshop are to kind of cover the overall concept of time and time in a GIS system.
00:10And this will be a few slides, real brief at the beginning, just a kind of a primer on time as it would relate to a map.
00:18And then we're going to talk about specific functionality for managing temporal information.
00:22And this will cover some of the mapping system and the controls and how you would work with it...
00:28...from a...a usage standpoint of, say, using ArcMap or ArcGlobe or parts of the ArcGIS system.
00:36We're going to look into data visualization.
00:39And I apologize that data visualization is what I just described.
00:42The managing temporalation...managing temporal information is actually data management and not the mapping system.
00:49And then we're going to cover a little bit about sharing as well.
00:54So the first section here on time and GIS.
00:59These concepts are really to explain some of the different ways to measure and model time.
01:05And look at some of the common patterns or some of the common types of temporal GIS outputs.
01:12So the first thing that we would need to understand when we're dealing with time is the basis of time.
01:18And inside of any computerized system, that basis of time is something that's based on a Gregorian calendar.
01:25So if any of you have dealt with this, you're aware of some of these issues.
01:30And as a programmer or a developer, you can't just write a simple thing and say, Add 365 days to add a new year to a, to a date.
01:39'Cause there's these complex rules.
01:42And so that actually matters.
01:43Our calendars are not based on a metric system, they're based on astrological definitions technically.
01:49So we can't add 31 days to compute a month.
01:53Weeks and months are not aligned evenly.
01:55I've got a little picture here where Friday is, or Saturday is the first day of the next month, and the month started on a Thursday.
02:02And it's complex; it's kind of a problem.
02:05So the reason I bring this out...
02:06Why does this matter, is that in working with time in a computing system...
02:12...you really need to use that system's guidelines and that system's functionality to do that computation for you.
02:20And so we've tried to provide in ArcGIS the tools that will allow you to do these time offsets and calculations.
02:28We do it in behind the scenes when we work with different forms of data...
02:32...so that you don’t really need to know all of these rules and work with these complexities.
02:36There are other types of time systems that we work with as well from a GIS perspective that are really not calendar based.
02:43And some of these are things that we would call indexed time...
02:47...where we may have an evenly gridded kind of sequence of events from a modeling perspective, scientific research perspective.
02:58And these oftentimes don't represent a time stamp, which is year, month, day, hour, minute, second...
03:04...but maybe it's just a, a number on a number line.
03:07It's very introval...interval based.
03:10And equivalent to that is something that is what we'd call kind of an epic time or really an epic event.
03:17But it's similar to that one I just showed you of a number line, except the zero point is a place that we know of.
03:24So if any of you have done work on a UNIX system and you've seen a log file with a UNIX or Linux type time stamp...
03:33...they just have bas...they've been counting the number of seconds since January 1, 1970, at midnight.
03:39And they use an internal number that evolves like that.
03:42So this is an example of a, an integer-based or sequence-based numeric value.
03:49And we can actually work with that if you have features in a geodatabase or you have some features that you don't have time stamps...
03:56...but you know the interval and the offset between them, we can actually work with that in ArcGIS.
04:02However, you know, we make some recommendations to avoid doing a lot of this calculations based on these big integers.
04:10The recommendation is to really store your temporal data as a date type.
04:15And that's kind of one of the things we'll talk about in that temporal data management...
04:19...is converting and using the system tools to convert from all of these formats into an actual date object.
04:25That date object type is part of the geodatabase.
04:29There are date types in all of the underlying relational database systems, and even into the operating systems.
04:35Or if you're working between Java or .NET, they have that date object.
04:40And that date object is actually going to make it easier for migrating data across systems or to do certain operations.
04:48So it's always a recommendation if possible, to store that temporal data into that date type.
04:56Some additional properties of time that are obvious and...and things that would make sense when you think about it but just...
05:03The fact that time is always linear.
05:05We don't have this like, where there's holes in time like you might in...in a spatial context, with projections and so on.
05:14Time tends to be very unidirectional.
05:18And that's a no-brainer, but it...you have to think that way.
05:22As we move through time, as we're updating the display...
05:25...things that are current are always replacing or adding to or overlapping things that, that came before.
05:33And there's also kind of a cyclical nature about time.
05:35And this kind of relates back to that concept of using those interval and regular sequenced time values...
05:45...that you might have with some of your more scientific data.
05:50So again, a real obvious kind of case, any of you that saw the plenary session on Monday...
05:57...saw some of the time functionality demoed very briefly.
06:01You might have seen this oil spill being mapped in conjunction with some other temporal sources.
06:09And...and this answers the question, why do we want to visualize data through time?
06:13Because it actually adds value, it actually lets us see something that we couldn't see by just say, printing these all out in a Layout tab.
06:21This actually lets us see the evolution or the dynamic change of some features.
06:28There're a couple of different types and the one that many of us are most familiar with is...
06:34...what we would call a dynamic type of...of feature.
06:38So it's a dynamic pattern, and these are things that move.
06:42And so anything from a moving vehicle or...or a vessel or an aircraft to potential...
06:50...you know, satellites in motion, animals that we might be tracking.
06:54Things like that.
06:55This is what we would call a dynamic GIS map.
07:00A similar one is something we would call a discrete, more of a discrete event.
07:04So a crime event, or an accident, something like that.
07:09And these are not necessarily going to evolve, or have multiple occurrences.
07:15It's more often just a single event versus the dynamic is really something that we're keeping track of as it moves...
07:23...so there will be multiple observations of the dynamic where the event.
07:27They may all be uniquely represented in your feature class, or in your data.
07:32The stationary pattern is another one where we actually look at that as a model where something exists at a known location.
07:41So a weather sensor or a traffic sensor.
07:44And from that known location, we might get regular or periodic samples of only part of what you would see in that feature.
07:52And so there are times where this leads to, and we'll talk a little bit about a data model where we know the location...
07:59...but the time value is with the observed attributes that go with that.
08:05And the last one is the, is kind of a change or growth pattern.
08:10And unlike the other three, this is usually never really an instant in time.
08:14It's usually more of a duration in time.
08:17So fire perimeters are a perfect example because fire perimeters are sampled maybe every 12 hours or something.
08:24And we see an evolving polygon that's growing as the fire is moving.
08:29Or the population or distribution or...or statistical heat map type of output.
08:34Those are all things that are a change or growth pattern and they represent a window in time or...or a time duration.
08:44In addition to these, these GIS patterns, the temporal visualization function brings different types of integration.
08:53So what are the, the different, I guess, resulting data models...
08:57...or external systems that might be contributing information into this system.
09:03And so some of the patterns that we've seen quite a bit of are real-time sensor networks.
09:09And we've lumped together moving objects and stationary sensors in kind of the same thing.
09:16But this is like that dynamic GIS pattern in a way of...
09:20...of events that are happening as vehicles are moving, or as sensors are updating.
09:24Another one is that simulation and modeling, which, it kind of calls back to that interval and gridded-based results...
09:32...where we might be producing a complex result of years of research, in weather and meteorology-type research, for an example.
09:41And that is also in parallel with what we call multidimensional data, is one of the types of data.
09:47So there's a number of ways to bring together, geographically speaking...
09:51...all of these different external sources of temporal information.
09:56So here's what, you know, everybody's been wanting to see, is this is now built into ArcGIS.
10:00We can handle all of this, it's part of ArcInfo, ArcView, ArcEditor.
10:06It's part of ArcGlobe, it's part of ArcMap, it's part of the server, the desktop product.
10:10It's there, but how do we use it?
10:12Well, we've built in this very simple temporal mapping system.
10:15And anybody here not know how to pan or zoom?
10:18Okay, I didn't think so.
10:19All right, you will not also know how to, you know, use the Time Slider.
10:24It's just like that. Moving the Time Slider is like panning through time.
10:28And it's going to take you from one range of time to another.
10:32So we've built this experience to be built into the product.
10:35There's...this kind of describes the whole thing, but in the lower right is, there's a Time tab on your Layer Properties.
10:41You open the Layer Properties and you enable time.
10:43We're going to see a demo of this in just maybe two minutes here.
10:47But once you've set up these properties, the Time Slider is functional and available.
10:51And that is something through, like I said, Desktop and Server.
10:58So the overall goal of this is to provide the temporal capabilities like you have with spatial...
11:05...to provide that panning through time or to kind of change that scale on time if we want to make an analogy to the zoom.
11:12And to provide that like I just went through on the last, I just described.
11:16But it works the same in these products and is part of the whole experience.
11:21So we're going to actually come up here and Hardeep's going to do a demonstration for us.
11:28All right, thank you, David.
11:31In this demo, we are...I'm...I'm going to focus on the simple...
11:35...up there, or not?
11:37Let's try this...
11:43So what we'll focus on in this demo is some simplified temporal mapping capabilities which we've exposed.
11:49David's already talked about those.
11:52What I have here is the Gulf of Mexico oil spill data, and this...
11:57...these are actually the trajectories over time and how the oil...oil was projected to follow certain directions.
12:05So this is data which we logged from NOAA.
12:08And if I open up the attribute table for the oil trajectory data, you'll notice that for each polygon...
12:16...or each oil trajectory polygon, I have a time stamp associated with it.
12:21And this is stored...this information, or the time information is stored in a date field.
12:26So if I open up its properties, you'll notice that this is the type-date field, right?
12:33So using this information, what I can simply do is I can set the, or configure the time properties on the layer itself.
12:40So in order to do that, I'll open up the Layer Properties, and new at ArcGIS 10 is the Time tab, right?
12:48Here, I can enable time on this layer.
12:51What this means is that now the layer will participate in the map time, which is controlled by the Time Slider.
12:56We'll take a look at the slider in a bit.
12:58And after that, I need to configure some of the time properties.
13:02So in this case, my layer time is stored so that each feature has a single time field, right.
13:09So all single time field, which had the time stamps associated with the polygons.
13:14So I choose that field.
13:16In this case, we autopopulate the...the date...the time field for you.
13:21Or you can also pick another time field, like if you have your time stamps in other field.
13:27Then you can specify the field format, which in this case, it's the daytime, so we automatically pick that up.
13:32If you have a string or numeric field format, we also support those.
13:37Then I can specify the time step interval.
13:40In this case, my data was collected on a daily basis, so I'll simply use one day.
13:45And let's hit OK here.
13:49And the moment I did that, we have the Time Slider window icon on the Tools toolbar.
13:54[Inaudible] We just drag and drop it right here.
13:57This is a new icon, or a new tool, in ArcGIS 10.
14:01So I click this, and it's going to bring up the Time Slider window.
14:05Let's move this guy back.
14:07And now, if you look closely, as soon as I enable time on the map, this is the leftmost button on the slider.
14:14You'll see my data is now reflective of the oil trajectory on second of May.
14:21Now if I move my slider back and forth, I can visualize my data over time.
14:31Now, a simple Time Slider option here is, now I can open up the Time Slider options to configure the Time Slider.
14:39So let's open up the Time Slider options dialog.
14:42And on the Playback tab, I can refresh the display when dragging the Time Slider interactively.
14:47So I'll choose that.
14:49And now if I move my slider back and forth, it's going to update automatically, or interactively.
14:57The key here is, why do we have it turned off by default is like if you have large amounts of data...
15:02...and if you try to move the slider, it might choke on you.
15:05So it's kind of, for...for lighter datasets, it works perfectly fine.
15:13Okay? So once you've configured your time properties on the layer, I use the simple Time Slider to visualize my data.
15:19The other thing I can do here is I can actually serve this time-aware layer to a map service.
15:25The way I can do that is simply using the...the workflow for serving out data.
15:31So I have this document which I already created, and I can right-click Publish to ArcGIS Server.
15:36In this case, I'll name this to be Oil Spill and hit Finish.
15:45And once I have it served out...this is a time-aware service now...
15:49...which means that besides the spatial extent, we're also providing the time information.
15:54So the time extent is also persisted with the map service.
15:58So once I publish it, I can then use it in a Web client.
16:02So I've already created a Web page, which...was...I'm using...
16:08I need to do something here, I guess.
16:16Let's try it again.
16:19Yes, so I'm picking it up.
16:26Let me show you another Web page that's again the Gulf of Mexico oil spill, and this is, in fact, on Esri's Web site.
16:34Ah, there it is. Finally.
16:37It took some time for some reason.
16:41So let's go back to my example here.
16:43Once I've published it, I can consume it on a Web client.
16:53Also you can use the Flex API or the Silverlight API to construct such a Web page.
16:59So the idea here is that once I've published or authored my layer...
17:03...I can then share it with my colleagues or with the entire GIS community.
17:08So that's what I wanted to show in the first demo.
17:14So we're going to move on and...and spend a little time talking about managing temporal information.
17:19As you saw, we had this nice set of data which was these trajectories of...of the projected oil spill area.
17:27What happens if the data's not quite as perfect, or the field isn't in the format we want...
17:32...or the fields are distributed in the wrong fashion?
17:35So we're actually...that's part of what we're wanting to emphasize for ArcGIS 10, is having the data in the right fashion.
17:44Similar to how you might adjust other properties of data spatially to make it fit your overall output.
17:54So we're thinking from a data modeling standpoint of different uses of temporal data.
18:00And I, I called back to this just a little bit ago.
18:03I mentioned time instant, or that, that duration or time extent.
18:07The instant is that one point in time.
18:11And we call that either a sample from a continuous flow of data...
18:16...so when you read water levels from a stream, it's obviously a sample at that instant.
18:23An observation or an event, they're all kind of analogous, so even moving vehicles...
18:28...you know the vehicle's constantly moving...
18:29...but you get that update once a minute that is kind of an instant or an observation.
18:34The extent is a time span, and so we, we think of those as a duration or if it's an interval, at times, if it's an even interval...
18:44...say every hour, you can make the assumption that between those intervals, there's a duration that's implied.
18:51If it's a very regular set of data.
18:54So that is the...the extent.
18:57There is also some less common, or maybe we should say very esoteric use cases, such as time in the attribute value.
19:07Where you may have features that have really no use of time in the mapping system, but have this validity time or time is valid.
19:17And that's kind of the same as transactional time except that's more from a database management standpoint.
19:23And it still is important because, from a query definition standpoint, or possibly from a symbolization standpoint...
19:30...you might use those time windows to affect your map output...
19:33...but those are not driven by the Time Slider and the temporal map.
19:37Those are things that you would define in your query or in your data adaptation layer, such as your SQL view.
19:43So these are the kind of overall uses of that temporal data.
19:47We're going to focus on the time instant and time extent entirely in, in these demos today.
19:57I mentioned a little bit ago about we recommend using the Date field when we were looking at the other integer and epic numeric types.
20:08One of the reasons to use that date type is, I guess, in comparison to string values, is that the date type is quite a bit faster.
20:17There are reasons why you might use a string, and actually...
20:21...spell out in there M-A-R-C-H, comma, you know, 2, 1, whatever...I want March 21.
20:27There are reasons you might want to put a string value in there.
20:31But it's so much slower and it adds a number of difficulties, at least from the mapping and data handling system...
20:38...because we are converting to that date type.
20:40So we're going to recommend as much as possible to convert into that date type.
20:45And plus, in the geodatabase, you can put an index on that date type...
20:49...and your underlying data storage mechanism will be able to give you those time windows much quicker...
20:54...especially when you're doing Web server-based queries...
21:04...the server asks for that one-day time window, and because we have an index on the data, it can return that result very quickly.
21:10Well, for the oil trajectory, not so important, but if you're dealing with a few hundred thousand records, it becomes very important.
21:20Since I mentioned the...the format, such as numeric and string formats, I'm going to go into detail here on this.
21:27Numeric format is exactly what they look like, except as an integer...
21:32...so if you have an integer in a database that...that is just four digits, you can actually use that as a year.
21:39Or you can actually string together year, month, day, hour, minute, seconds.
21:44The database thinks of it as a number.
21:46You could actually do math on those, it just wouldn't mean anything.
21:50So that is one way that we support...and the string formats are similar, except like I mentioned...
21:55...these can have dashes and colons and spaces and commas and on your different format specifiers in the string.
22:01The very important point here is that we support these supported sortable formats.
22:07So I have a couple examples here, and I've put some green and orange letters.
22:11If any of you can't really see the colors in the back of the room, come up and I'll explain this later.
22:16But in this string, if I had 2009, 06, 30, greater than 2008, 08, 30, that's true because the year is the most dominant.
22:25The year is on the left side, so in that database sorting algorithm, that would be true.
22:30If I put month, day, year, with the same date values, it would look as if June is greater than August, which will fail.
22:40So we have to just stick with sortable formats for speed and performance...
22:43...so if you're working with string and numeric types...
22:46...you go on the Time tab, and you say I've got string, and you hit that drop-down...
22:49...and then you panic, because you don't have month, day, year.
22:52We have tools that allow you to convert that when you import the data.
22:56But in the properties from the map system, and on the Layer Properties, it has to be in one of these formats.
23:02Additionally, named month strings are just a really bad idea.
23:05Which is first, the D or the F?
23:08You know, alphabetically speaking, April, August, December, February, et cetera, so stick with the types that are supported.
23:16And I'm going to actually jump out real quick just to show...
23:21...as many of you might be having a lot of questions about this at this point.
23:25This is a quick jump over to the online help system for ArcGIS 10.
23:31Has anybody here looked at, on our Resource Center, for the ArcGIS 10 help?
23:36Anybody here surfed through any of this area?
23:38Okay, we've got like five or six people here...
23:40I'm going to show you where you would go here.
23:44In the Professional Library, under Mapping and Visualization, you will be very glad to see there's a whole section on time.
23:53And quite a bit of what we're showing today is represented in some of the topics here on time.
23:59The Temporal data management is a whole section.
24:01Visualizing temporal data, serving time-aware layers, it's all covered.
24:05We've got some good examples in here.
24:09And all of these string formats that we were talking about earlier are also listed in here as well.
24:19So if you ever have a question on any of this, this is all available online. It's all covered.
24:33So I just mentioned, you know, what if your time is not in one of those formats?
24:36Well, there's a geoprocessing tool that's called Convert Time Field.
24:41It does understand all of these other formats because it's actually running a batch processing, converting that...
24:48...and bringing it into that geodatabase as the right format for the mapping system.
24:52So we can convert out of order month, day, year.
24:55We can do these custom string formats with the word March and the number 21, for example.
25:01So in the, in the screen shot, we have here the middle attribute is something called Input Time.
25:06And we've run it through this tool to create the date format object and the output time.
25:12It's very simple, and it does exactly what it says.
25:16So what types of layers in this system, what types of, of ArcGIS functionality is supported by this time system?
25:25And it's actually almost all of it.
25:27As you would expect, feature layers, data tables, the mosaic datasets, which supported the multidimensional data...
25:35...such as netCDF, tracking layers, network layers, types of imagery, everything with some very limited exceptions.
25:41There're one or two, a handful of things, possibly like the old labeling...
25:48...annotation things, and schematics and things like that.
25:52But with, for, as a general rule, when we put time into ArcGIS at 10, it was in the basemap object.
26:00Anything that goes onto a map or into the table of contents, you will at least see the option to enable the Time tab...
26:06...and unless that check box is grayed out, and then there's a few exceptions that don't support...
26:12...but if you have time stamp data on features, more likely than not, or I should say 99.99% chance...
26:19...you can enable the Time tab, choose a format, and this system will work.
26:25So this is an...and Hardeep showed this.
26:28I could almost skip right past this, but he showed this in his polygons, in the attribute table.
26:34But here's the example of, in this case, two different features, and three different time stamps each.
26:40So this introduces in your attribute table, duplicates of that feature ID.
26:47So you will see this, where you might have multiple features in an attribute table the same ID...
26:54...but combined with the time stamp is what makes them unique.
26:58And so our system handles all of that automatically.
27:01This type of data, this, I'd say unnormalized, or all fused together in one record set...
27:10...is the real common one for that first use case of dynamic...
27:13...where you're getting multiple observations of an object that you're following and tracking its progress.
27:18But I mentioned a little bit about that weather station...
27:21...or that center network example where we know the location of something...
27:25...but we're getting just attributes of some values and some observations.
27:30So if you have that situation where you have a one-to-many or one-to-one join combination...
27:36...there is a geoprocessing tool called Make Query Table.
27:39It performs this in-memory join.
27:42And when you run that, you're left with that joined table for you to then turn on and enable the time properties...
27:49...and it will work with the Time Slider just like a regular feature class would.
27:54So in this example, our station feature class, we have station 43, and you can see we're getting temperatures on a...
28:05...this looks like a yearly basis where we're getting a temperature for the first day of each year.
28:10And so we can join that.
28:11In a real-world example, it's quite a large number of stations, and maybe millions of observations.
28:16But you could still do that join.
28:17You can still use that output.
28:19Enable time on the Time tab and it will work.
28:25When I mentioned the time duration, or the time extent model...
28:30...one of the things that Hardeep showed as well in the user interface was the option of does each feature have one time field.
28:38Do we just represent the instant that it was observed, or do we have a starting and ending time field for each feature?
28:44If you have a time span of two fields, there are times where we want to populate that in time fields, so we've got a tool...
28:52This tool was actually here from 9.2 on as part of the Animation tools.
28:57We fixed it up and improved it a little bit.
28:59But what it does is it reads row number 2 start time and populates row number 1 and a time.
29:04So if you have irregular data, that has nonregular intervals, you might have a few records that were 10-minute samples...
29:12...and then maybe a 12-hour window and then more 3-minute samples and so on.
29:16You could run this tool and create those different length, durational end times.
29:21And then you could, of course, manually adjust them.
29:24And by enabling on the layer, a start and end time per feature, enables you some more advanced type things...
29:31...such as gaps between your feature's times...
29:34...or possible overlaps where the next feature might start before the previous one ends.
29:39It's all supported. It's all part of that system.
29:42But this tool will create and populate that empty End time attribute...
29:46...based on the next record start time to give you a duration from irregular observations.
29:54Another type of data that's supported is the mosaic dataset.
29:58Raster catalogs...actually I'm going to have Hardeep explain this one real quick.
30:02Okay, in terms of mosaic datasets and raster catalogs, what we, what we have is a similar support as feature layers...
30:11...so there's an attribute table associated with a raster catalog and a mosaic dataset.
30:17Now all we need there is that each raster is valid at a certain time, so you can have a time instant associated with a raster.
30:24So it's...it's basically as simple as that.
30:28And the other thing, something very commonly used, or the use case for raster catalogs or mosaic datasets is that...
30:35...you want to use an index field when you just want to go through the rasters in an order.
30:41So you can use that as well.
30:43So the ObjectID, for example, could be used there as an index field.
30:48Okay, so I'm going to look at the next case, which is What if time is stored in columns...
30:55...and my graphic has gone missing here so....
30:58I'm going to do a lot of hand waving and explain this, or I'll try and fix the graphic later.
31:04There are types of data where you might have a feature.
31:06It's similar to the join situation where you have a stationary feature with successive samples.
31:13The Census data would be an example, or we have a feature which is a state, you know, a state of California boundary.
31:20And then there's columns for the 1990 population, the 2000 population, the 2010 population.
31:26What this tool will do is actually, I guess, denormalize that and create successive feature records...
31:33...with one time attribute column and then populate the time stamp accordingly.
31:40So it essentially gives you a more properly formatted table...
31:46...with each feature having an individual time stamp instead of those multiple columns.
31:51I guess the key here is that, you know, the ArcGIS framework would understand data which is stored in records rather than columns.
31:59Transpose Time Fields? As...
32:01Transpose Fields. Transpose Fields.
32:08It was Transpose Time Fields from 9.2 on; it is now just Transpose Fields as of 10.
32:14And I can actually do this across more than just time fields, is one of the things that we did with it.
32:20We've talked a little bit about netCDF data and I need to just take a quick survey.
32:24Is anybody here working or has worked with netCDF data? Okay.
32:28For those that haven't, netCDF data is a storage format, operational storage format for scientific model-type data systems.
32:38It is similar to a Fortran array so it's, it's, it's very basic...
32:45I guess you would think of it as a Fortran array, but it's really an array of arrays and an array of that array of arrays.
32:53As many dimensions as you have.
32:55So when we talk about regular data, this is one of these formats that really implies regular data.
33:00Because you think of a cube, and if it's three times three times three...
33:03...there's definitely nine values that are stored in that array...
33:07...but as the dimensions grow, and the size of the, of these dimension grows, it becomes a very large numeric storage system.
33:15Well, what we have support for in ArcGIS is the ability to use these different dimensions...
33:21...and just like was available from I believe 9.0 on...
33:269.2 as well? Okay.
33:28The, the netCDF support allows you to choose one of those dimensions as your time dimension.
33:35When you do that, that layer is supported in the Time tab.
33:40You can set the intervals; you can use the Time Slider.
33:42The whole system works with it as a traditional time-enabled feature layer.
33:51So here's a screen shot of the toolbox.
33:55There are different tools based on that netCDF conversion of either to a feature layer or a raster layer or to a table view.
34:05And you simply choose which dimension is your time dimension.
34:09It's in the multidimensional tools if you're looking, if you do get the netCDF file, and you're looking for these.
34:16This is actually something that's got some specific use cases with it.
34:21If you're not familiar with it, and you have more questions...
34:25...if there's any time yet today, to go to one of the Mapping and Visualization island areas, or inquire about it online.
34:32We don't actually have a sample of this today.
34:35So the last bit I'm going to talk about in Data Management is Time Zones.
34:41And I'm just going to show a couple screen shots and look at this a little bit, and then Hardeep's got a demo coming up.
34:48So ArcGIS does have support for time zones in our time handling.
34:54And our time zone support is very comprehensive.
34:58We support all of the time zones that you'll find in any operating system or development platform.
35:05So if you're looking at the time zone IDs in the Windows operating system, we can use those.
35:11If you're using Java in ArcGIS Engine, you can use the system time zone from that language or from .NET or whatever you're looking for.
35:18We have support for that.
35:20We recommend if possible to standardize on UTC, which is that Universal Coordinated Time.
35:28And let the...by standardize, I mean from the data standpoint.
35:33In, in your ingestion of data or working with sensor data, most sensor systems and...
35:38...and most, say, vehicle tracking-type systems, give out UTC anyway.
35:44It's a best practice when you're crossing multiple time zones and dealing with multiple types of sensors.
35:49But if possible, don't convert that in your database or in your feature class to a time zone but leave it a UTC.
35:55And allow the Time Slider and the properties of the map to do that conversion for you.
36:01'Cause your users might be in different time zones in their systems where their system is running...
36:07...and then the client deals with that conversion for you.
36:10Especially important when you're publishing a temporal service through ArcGIS Server to avoid a double conversion.
36:16Again, it's not a bad conversion; it's just adding or subtracting a few hours.
36:19But why do it twice?
36:21And so keep it UTC; let the client do that conversion for you.
36:25We do have a GP tool called Convert Time Zone, which is doing...
36:32That's not exactly what it's called, is it?
36:34It is Convert Time Zone.
36:35Convert Time Zone, okay.
36:36And it is doing that temporal offset.
36:39If you do get some data that's in Pacific time, and you need to actually take off the eight hours offset and convert it to UTC.
36:46There's tools that...in the GP framework for that.
36:51So some of the added value of that is daylight savings time's kind of a quagmire as well.
36:58Daylight savings time is very subjective to political disagreements.
37:04There are daylight savings times that adjust less than a one-hour offset...
37:08...so there are time zones of the world that go into daylight savings time by 30 minutes or 45 minutes.
37:15And there are evolving definitions; even three years ago, in the U.S. ...
37:20...daylight savings time started almost a whole month earlier than it ever had before.
37:25In the last, I believe, 120 years, there have been 16 different definitions of the daylight savings time boundaries.
37:32Just in the U.S. and North America.
37:35So it's a complex problem because what do you do if you're dealing with centuries of data...
37:40...and you really want that sample to be spot-on accurate to the proper month and it's you know, mid-March...
37:46...and you're not sure when it's...which year is in or out.
37:49Our recommendation is to not actually honor that daylight savings time; deal with it as standard time.
37:57But then it becomes a transformation that you need to take into account...
38:00...as you make your specific slices or as you cross these boundaries of these time zones.
38:05ArcGIS does not have a built-in map of every daylight savings time definition, of every country through time.
38:13And it probably won't. So deal with it in standard time.
38:17And I'm going to jump over here and show one quick thing...
38:20...just as an illustrative example of, of the time zone problem.
38:27This is a good old Wikipedia document.
38:31And I show this and a lot of people then just kind of shake their head, and they were never aware of this...
38:37...these types of issues...political issue with, with, with time zones...
38:42All of China is one time zone.
38:43Did anybody here know that?
38:44All of China is one time zone, and it's all Beijing time.
38:49So somebody on the western part of China gets up and goes to work and the sun comes up around noon.
38:56These kinds of things happen.
38:58If we go up and down here on one of these lines, we can look and say, like, right here...
39:05...these are a plus-five offset, goes into a plus-six, crosses into plus-eight, back to plus-five into plus-five and a half...
39:13...we haven't rotated around the globe at all.
39:16So these are the kinds of issues...
39:18There's no automatic way to kind of geocode a known point into its time zone.
39:22It's very political.
39:24There's not simple, like, 25 or 26 time zones.
39:26There's a lot of regional differences.
39:31Plus, you can really see these half time zones; three and a half, four and a half.
39:35Australia has one that's a 45-minute during daylight savings time only.
39:39So it's kind of messy, and so I always just like to show that.
39:43So we're going to do a demo here.
39:46All right, so what we've seen so far in the demo is the...the oil trajectory data.
39:51Now and moving on with the same survey area, we have some other datasets such as the fishery closures...
39:58...the oil sightings on the beaches...
40:00...and I have some atmospheric data as well.
40:02So all of these have a temporal component.
40:05However, what I'm going to do here is I'm going to progress through these multiple temporal datasets and visualize these together.
40:11At the same time, and in the same way, I'm going to show you the data management tools we have.
40:17So how, how, how can you use those to your benefit now when you're dealing with temporal data visualization?
40:23So first of all, I have the fishery closures data, so if I open up a...just turn this on...
40:31...and this in fact is the fishery closure polygons, which were put in effect at different times as, as the oil spill was happening.
40:40So it was changing.
40:42We open up the attribute table here, and you'll notice that it has a start date field which is...
40:48...which actually stores the polygon time stamps.
40:52One interesting thing about this data is that it's irregular.
40:55So the first polygon was put in place on 18th of May, the second one on 28th, the third one changed on...on the 31st.
41:05So for irregular data, as David suggested, what we can do is, we can use the Calculate End Time tool.
41:11Before I do that, I'll have to create a field to which I will write my date values, or time values.
41:17So I'll just add the date field and call it End Date.
41:23You can also use the geoprocessing tool to create it in a, in a, in a model.
41:28The Add Field tool.
41:30So I'll...I'll use the Date Type here, and hit OK.
41:34And all...all of the temporal data management tools are available under Data Management toolbox.
41:41Under the Fields toolset, we have the Calculate End Time.
41:45We also have the Convert Time Field, which David mentioned.
41:49The Convert Time Zone tool is here, as well as the Transpose fields.
41:53The other way to find these tools is, go to the Search window...
41:57...this is something new in ArcGIS 10...
41:59...and I can simply type in "Calculate End Time" and search for it.
42:05And here I get my tool.
42:08Click on it, and, in this case, what I need to specify is the Input table.
42:13In this case, it's the fishery closures.
42:15The Start Time field in that data was the start date, and the end date is the one which we just added to that dataset.
42:23And I simply run the tool.
42:27And let me open up the Attribute table, here we have the end date.
42:30And essentially what it did was, it copied this particular date in the second col...second record to the first record.
42:37So now the fishery closures are in effect for the first polygon from 18th of May to the 28th of May.
42:43And likewise, the next polygon is from 28th to 31st.
42:48So how can I benefit from this is, essentially, if I enable time on this layer...
42:53...in this case, each feature does not have a single time field, it has two time fields...
42:58...which means that the polygons is valid for a certain duration and time, so I'll choose that.
43:03And I can specify the Start Time field and the End Time field.
43:08Also the field format is going to be the date format, so I don't need to do anything there.
43:12In this case, the time stamp...I'm going to choose one day...
43:15...because the time stamp actually is going...is, is one day here, because...
43:23Come to think of it, the fishery closure polygons are changing every five days...
43:27...or ten days, or two days, so that's why I chose one day here.
43:31Now I'll hit OK.
43:33And now if I move my slider all the way to the 18th, there's my first fishery closure put in place...
43:41...and as I move in time, you'll notice that the polygon is going to change.
43:46And my underlying oil...oil trajectory's also changing at the same time.
43:51Also I can play this visualization by simply hitting the Play button.
43:58[Audience question] What would have happened if you didn't use the end time?
44:01In that case, you would have seen some flashing on the screen; like it would have appeared...
44:04[Inaudible audience question]
44:09So, the, some other Time Slider options are, I can go into the Playback...
44:14...and you can see that I can control the speed between each time stamp being displayed on the...on the screen.
44:20Also I can play in a specified duration.
44:23The other thing I can do here is I can specify the time zone information.
44:28We can talk about that in a little bit.
44:30The time stamp interval has to...
44:32If I...even if I have daily dataset, I can visualize it every five days if I want to, so it'll go to the fifth day instead.
44:40Also I have the display date format; in this case, I can choose my format, this date here, to be something different.
44:47So let's make it more legible and hit OK.
44:51So you'll notice that now the date is slightly better.
45:00Okay. The next dataset I have is the oil sightings on the beaches and the marshlands.
45:07So this is a point dataset. Let me just turn this on...
45:10And you can see these are the oil sightings; they have a time associated with it.
45:14So when our oil was sighted on a beach, they would record it and put it in a feature class.
45:20So if I open up the attribute table, you'll again notice that it has a start date right here.
45:27So these were also daily datasets, so at the end of the day, they would record that feature.
45:32This is the fishery closures, sorry.
45:35Open attribute table here...
45:37So here's the date field, actually.
45:39So it was again collected on a daily basis.
45:42The thing I wanted to show you here is something called Display the Data Cumulatively.
45:46So as the oil settings are happening, I want to display this data cumulatively to a certain point.
45:51The way you do that is you'll enable time on the layer and specify a time step of one day.
46:00But if...by the way, if I don't specify a time step interval, the system will automatically calculate it for me.
46:06So it will give us an indication, so let me do this actually.
46:09I'll do zero days here, and it's going to say like whether you want us to calculate it for you.
46:14So that's another good feature here.
46:17So I'll say Yes here, and this stuff I wanted to show you here is the Display Data Cumulatively option.
46:23Where I'll want to show a progression.
46:25So the oil was sighted on day one; there was oil sighted on day ten as well, but I want to see all this cumulatively.
46:32So if I choose this option, and hit OK...
46:35Let's go to day one.
46:36And you'll notice that we have some oil settings on second of May...
46:40...but as I progress in time, you'll notice that it's growing in...it's growing cumulatively.
46:45So all the points remain on the screen or in the display.
46:50So this is especially important like if you have something where you want to show progression...
46:54...like a fire progression, or such a progression.
46:58Now furthermore, I have the Met Stations data; this is atmospheric data, which...
47:05...for...for these particular Met Stations, so let me turn this on.
47:08This is a point feature class.
47:10And I'll turn...I'll open up the Attribute table, and here I'll show you we have the stations.
47:17So these are point locations of those stations along the Gulf Coast, or Gulf of Mexico coast I'll say.
47:23So here I have the station IDs, as well as the names of the stations.
47:28What’s missing here is the temporal data.
47:31So the data was downloaded, you know, using an...an Excel format.
47:36So I have this data, which is stored in Excel, and this is the time series associated with each station.
47:43So for each station, I have a time associated, and it's an hourly dataset, so for, if you look closely...
47:50...for the same station, I have multiple values for different times...
47:53...for the wind speed, direction, air temperature, water temperature, and the pressure reading.
47:59So I'm going to make you a multidimensional visualization geek by the time we leave here.
48:05So how do I bring this data and utilize this with my, with my temporal map?
48:12The way to do it is I can convert my Excel worksheet data into a geodatabase table.
48:18So there's a tool called Table to Table; it's on the Conversion toolbox.
48:23If I go in here, it's right here actually.
48:29This is a Table to Table tool.
48:31So I'll use that tool, and furthermore, we'll, we'll bring in the data first, and let me open up a model I already built so...
48:43...a lot is here to explain there.
48:46Ah. Doesn't look good. There you go.
48:50So we have the Table To Table tool; it brings in my Excel worksheet data into a geodatabase table.
48:56And I've already run the tool to this point.
49:01If I open up the geodatabase table, notice that we have our data, which was pulled from the Excel worksheet.
49:11So now I can use this data to perform a one-to-many join.
49:14I don't know if, if you noticed in the geodatabase view...
49:17...there were 16 weather stations, and we have here about 13,000 observations.
49:23And so that's the type of pattern where you would see this join pattern be very useful.
49:30So the other thing I'd...if you notice here is that this date format is a string format.
49:37And it's kind of a little weird but it's eerier, eerier, so this is 2010, the month of June in this case.
49:47And the first of June, 2010, and then zero, zero, zero, it's the twelfth hour or the midnight hour.
49:55And then as I progress, it's one, two, three, all the way down.
49:59So it's an hourly dataset.
50:01Now what I want to do in this case is I want to convert this data, or this time field, into a date field.
50:07The way I would do that is again, let's go back to the model.
50:12So what I'm going to use here is the Convert Time Field tool.
50:16And again, this can be found under the Data Management tools.
50:21Right here...Fields and Convert Time Field.
50:28And back to my model; let's run this tool actually.
50:34So now, what it's doing is, it's going to go through each time stamp stored in the string format...
50:38...read that format, and convert it into a date field.
50:45[Audience question] Are all these tools available with the ArcView bundle?
50:48Yes, they should be.
50:50So let me open up this tool actually; I forgot to do that.
50:53Let's see, Input Table is the format; the Input Time field.
50:57The other thing you can specify here is the Input Time format.
51:01And here are the different formats which we support.
51:03So you can have your data in different formats. This is a string format.
51:07Also, something interesting here is the Custom format.
51:10So David explained if you have your date written out as March 3, 2010...
51:15...you'd take that custom format and convert it into a date field.
51:18So something very, the given, the given message here is that use the date field if you can, so that...that's very important.
51:25It's faster in terms of query and display of data.
51:31So let's take a look at my table now. So it's the same table. I'll open it up.
51:36Here's the date field. And it's all automatically calculated, you know, what...what time of the day it is.
51:45Now, now to use this data, what I can do is I can perform a one-to-many join with individual stations.
51:53So I can join the time series data for individual stations based on the fact that...
51:59...if I open the attribute tables here, you notice that this has a station ID.
52:04And likewise, the meteorology data I have has a station ID too.
52:08So I can use the SQL expression there, and the Make Query Table tool, I'll show this in a second here.
52:14So let's open up the Make Query Table tool, which can be used for creating a one-to-many join.
52:19What it inputs is, is the, are the tables.
52:23So the one is the Met Stations feature class I have, the point feature class.
52:27And then the second one is the meteorology data I had in the table.
52:31So once I do that, I can specify which fields do I want to bring along into the, into the output layer.
52:38One tip here is that if you want your output layer, output table to be in the form of a layer, with the associated points...
52:46...you should pick the shape field here for sure from the, from the input feature class.
52:52And likewise, I can bring all the other fields in the output table.
52:57The key here is that I need to use it, use an expression.
53:01I can go into the SQL, or the Query Builder and specify that the station ID in the feature class...
53:06...is the same as the station ID in the meteorology data I have.
53:11And that's about it, actually. And I run the tool.
53:20And here's my query table layer, which got added, and it's an in-memory join...
53:25...so here's the layer, which gets stored with the map document as well.
53:28So I have all this data now, and how do I visualize this?
53:33I have these variables, there...there's a lot of variables in here.
53:37If I open up the attribute table again, we have everything in terms of the wind speed, the direction...
53:43...the gusts, the air temperature, water temperature, barometer.
53:47So it can, it can be important like when you're dealing with such a situation when the various barometers...
53:54...the wind speed, for example, is an important one.
53:58The water temperature is an important one, too.
54:00So how do I visualize this?
54:02So what we can do is I can...I can...I'll show you how you can symbolize these points effectively.
54:08So let me open up the Symbology tab here for the Query layer.
54:13And under Categories, I can choose to symbolize my data with wind speed.
54:19So that's the color, the wind speed will be reflected by the color changes, all right?
54:24The other thing I'm going to do is I'm going to change the symbology and choose an arrow symbol here for the wind direction.
54:31So let me choose a character marker symbol.
54:34Use a dimensioning one, I like this one better.
54:38And I'll use this.
54:40And I'll choose a darker...oh, it's the same one...use this.
54:48The other thing, I've...I've completely forgot about, is I'm going to make these arrows slightly bigger...not that big, but...
54:58And so I have the wind speed all, all sorted out.
55:02I have the wind...the arrow, arrows, arrow symbols here.
55:07How do I use the wind direction now?
55:09So let's go to the Advanced tab here, and then you can apply rotation based on the attributes.
55:15So I'll use the wind direction here and hit OK.
55:23And what you're going to see here is a bunch of overlapping arrows, and these are the wind directions, so, right.
55:32The...now to visualize this over time, what I'm going to do is enable time on the layer, go to the Time tab, enable time.
55:44It's automatically going to pick the field.
55:46In this case, my time step is going to be hourly, so I'll hit OK here.
55:50The other thing I want to cover here is the time zone...
55:53...so you can also set the time zone if your data was collected in a different time zone.
55:59Hit OK here.
56:03And let's open up the Time Slider options.
56:06In this case, I'm going to choose a time step of my slider to be one hour.
56:13And again, if you've set some time zone on your layer...
56:16...you can choose to visualize your data in a different time zone as well...
56:19...so we have all the time zones listed on this machine.
56:26I hit OK here, and let's go to the month of June.
56:32And now you can see like if I zoom in closer to this area, you can see those arrows.
56:43I'll turn off this point dataset, and as I move the Time Slider...
56:47...these arrows are representative of the wind direction, as well as the wind speed.
56:52Furthermore, if I want to visualize the wind gusts, as well, the values there...
56:58...I can choose to label these points with the, with the wind gusts, or an attribute field.
57:04In this case I'm going to use wind gust and specify the size.
57:10Hit OK, and here I have the wind gusts as well.
57:14So all of a sudden, what we've done is we've used this atmospheric data...
57:18...and visualized it now using symbology and some of the Data Management tools.
57:24All right, this is what I wanted to show you is.
57:30Okay, well that was a whole lot of stuff, wasn't it?
57:33We're going to cover a few more things, and kind of...
57:38Let's see, ten after eleven here, so we're going to keep going and talk about some more advanced data visualization.
57:45And these advanced visualizations are things which are much less common or likely to be used.
57:53What you saw there was just time in ArcGIS mapping.
57:56And it's pretty easy to use, and I know every one of you is going to be using it.
58:00So what the advanced concepts cover are things such as time animations.
58:07What you saw there was, yeah, it was an animating display.
58:09When we play back, or we use the Time Slider...
58:12...but as far as creating an animation, there's an animation framework in ArcGIS...
58:17...which is basically just to animate the display and create like a video file...
58:21...so if we want to export some, some specific things.
58:25Along with moving through time, the animation subsystem allows you to place a camera...
58:31...and to move that camera through your animation, so you can do flyovers...
58:35...and you can pan across areas and change your extent through time.
58:40And that's a more advanced, I guess, set of functionality.
58:46As well as, say, fading in and out of different layers, as well.
58:50If you have existing time layer animations, such as what you had in ArcGIS 9, those should also work the same in ArcGIS 10.
58:59And they're going to, when you use that Time Layer Animation, it's going to set the time properties on that later.
59:05So it's basically time enabled.
59:08If you're just looking to visualize data over time, you're not going to do this.
59:12You're going to use the Time Slider and all the time properties we've showed you.
59:16I'm going to give you an example here, of, in this case, moving a camera through time...
59:21...so we have a camera in space, we're changing extents, and then we're going to pan and we're going to come in...
59:26...as well as moving through, moving through space and time.
59:30And you can do these consecutively and concurrently in an, in an animation.
59:35So if you're looking to create something like this, even if it's not the big globe kind of scale...
59:40...the animation framework is time enabled, and it does allow you to move the camera through time.
59:46Another type of visualization, which is not part of the mapping system per se, but is data through time.
59:54So creating a graph as part of the data that you're, you're looking at, you might create a graph.
1:00:02And this works just like it did from 9.2 on.
1:00:07Yeah, it's the same.
1:00:09Other than it's hooked into the Time Slider.
1:00:12So it's going to use the same time extent that you set the map display will control the graph.
1:00:17I'm going to show you an example on the next one.
1:00:18Okay. And one other type is, what we would use, a Tracking Analyst example.
1:00:25This is an extension; it's not designed to do any of the things that we've looked at here...
1:00:33...but it's designed to basically monitor and observe real-time data.
1:00:37And so Tracking Analyst will create track lines from multiple-point observations.
1:00:41And it will try and do predictions on where a vehicle might be headed.
1:00:45And then there's advanced aging of information and per-feature analysis.
1:00:51And so the Tracking workflow is definitely...there's a whole booth on that; it's an extension product.
1:00:55It is also time enabled; tracking layers participate with the Time Slider just like the rest of ArcGIS.
1:01:01But it's a real-time and more advanced type of visualization.
1:01:05So we've got a demo coming up here.
1:01:13All right, I'm still not done with the multidimensional visualization, so I'm going to continue on that streak.
1:01:22I have the Met, the atmospheric data aggregated by the day...
1:01:25...so what I did was I used the Summary Statistics tool, and aggregated by the day.
1:01:30So if I open up the aggregated data...I'm not going to show you that now; we're kind of running out of time there.
1:01:36What I did was I created the...the mean wind speed for the entire day, the max air temperature...
1:01:43...max water temperature, and likewise for the other, other, other ones, right.
1:01:48Also, I have the time associated with that, so I'll enable time on this.
1:01:58And the other thing I'm going to do here is, I've...I've already created a graph...
1:02:02...which represents the other parameters, which we didn't visualize.
1:02:08And in this case, it's a bubble graph, so this is something new in ArcGIS 10.
1:02:12The bubble graph, in fact, is, allows us to visualize multivariables.
1:02:19For example, in this case we have the wind speed and the atmospheric pressure...
1:02:22...and the size of the bubbles is representing the air temperature.
1:02:26So all of a sudden, we have some more variables which we can look at over time.
1:02:31The other thing I'm going to do here is I'm going to set the Time Extent of the slider to be the same as the Met...the aggregated data.
1:02:38So the way to do this is go to the Time Slider options.
1:02:41Here on the Time Extent tab, I can choose to visualize only a certain, a certain time extent, which is of interest to me, so let's do that.
1:02:51And I'll essentially use a Met, data aggregator.
1:02:54Hit OK here.
1:02:56And now if I move my slider over time, you'll notice that the bubbles are moving as well.
1:03:04All my data below is moving, and at, on fifteenth of June, you know here's the air temperature...
1:03:10...here's the atmospheric pressure, the wind speed, the wind gusts, oil trajectory, all of it is right there.
1:03:18Now furthermore, David mentioned that we can also use Tracking Analyst layers.
1:03:23The main advantage as...as you look into, from the temporal visualization perspective...
1:03:27...is that Tracking Analyst comes with advanced rendering capabilities, wherein you can render based on time.
1:03:34So let me add...I'm going to close this guy here.
1:03:37And I'll add a tracking layer.
1:03:40So there's the Tracking Analyst toolbar, which has some tools for advanced temporal visualization as well as analysis.
1:03:50So I'll add the temporal data here, and in this case, my data source is going to be Hurricane Alex.
1:03:55Now it's called Tropical Storm Alex, I guess.
1:03:59And in this case, I'm going to go to the point feature class.
1:04:04This is one of the datasets I downloaded, and this is probably not reflective of where it eventually ended up being.
1:04:12But what I can do here in this dialog, I can specify the Date_Time field, which contains the...the...the time stamps.
1:04:20Also I can choose something called a track ID.
1:04:23In this case, we're going to use the, a storm name.
1:04:26So this track ID can be used for, for a variety of purposes, and one of these is symbolizing over time.
1:04:33So let me add this dataset; let's go to a bookmark, and here I have the Hurricane Alex, or I'll just call it Alex, I guess.
1:04:45It's not a hurricane any longer, so.
1:04:48So once I have that in...in here, I can go to the Properties...
1:04:53...and it's symbolized based on the advanced rendering capabilities there.
1:04:58So I can choose to have the most current event based on a different symbol.
1:05:02So I'll choose that, and I'll symbolize the most current event with a hurricane symbol.
1:05:08So I'll search for that symbol...probably this is new at ArcGIS 10 as well, the ability to search symbols.
1:05:15So I can do that, and I'll choose hurricane; hit OK.
1:05:21The other thing I'm going to do is I'm going to use the track IDs and create a track out of it.
1:05:27So as a point moves, there'll be a track as well.
1:05:30So I'll choose that and hit OK.
1:05:35So now in order to visualize this over time, we again go to the Time tab.
1:05:39This has slightly a different...a different look and feel, the Time tab here...
1:05:44...because the date time and all those properties have already been configured on the Add Temporal Data Visit, which I showed earlier.
1:05:51In this case, I want to keep this layer synchronized with the map time.
1:05:54And also I want to display the data cumulatively.
1:05:58So I want to keep the track as it, as we progress in time.
1:06:02So let's go all the way to 20-6.
1:06:08Maybe a better way to do it is simply go to the Time Extent, and let's choose Hurricane Alex in this case and hit OK.
1:06:16And now if I progress over time, you'll notice that I have a track associated with my point feature class.
1:06:26Now this is a tracking layer; now that, that's the example there.
1:06:30And also I have my other datasets being animated at the same time.
1:06:34Right? That's about it.
1:06:38Okay, so lots of different types of data and lots of different things we can do with it, all related to the map time.
1:06:46Time Slider sets the time on the map, just like panning and zooming set the extent.
1:06:51All the time-enabled layers, they're enabled on that map, will respond to that map time.
1:06:57We're going to just kind of summarize some of these best practices.
1:07:01You saw these little yellow check marks throughout the presentation.
1:07:04Some of you were writing them down; that's good.
1:07:07Use a Date type field whenever possible.
1:07:09Index that Date type field; use UTC and avoid issues with time zone differences.
1:07:16Use standard time if possible.
1:07:18We have a good set of data conversion tools to convert into the supported field types and storage formats.
1:07:27And if you have questions about the data models and when to use the single or join table structures...
1:07:33...that is also part of our documentation as well, which I didn't go through on the help system, but that is also covered.
1:07:40And future directions, I will mention there is a Special Interest Group discussion at 1:30 this afternoon...
1:07:48...for people that are doing research into space-time modeling.
1:07:52So if that's a focus area and you've spent a lot of time working on multidimensional involving time...
1:07:59...1:30 today, it's in room 31A, and it's going to be a packed room, because it's only about this big...
1:08:06...and there's already a lot of people that are coming.
1:08:08But you'll be able to meet other people with similar interests...
1:08:11...and provide feedback to some of the engineers and developers that are working on time at Esri.
1:08:17Other future directions are looking at things such as time as it relates to metadata...
1:08:22...some advanced concepts in temporal data management.
1:08:25We've done a bit of work in 10; there's more work to go as far as automating some of that data processing...
1:08:31...which we're maybe looking for feedback from you on.
1:08:35And you know, what do you need?
1:08:37We need to get information; you have a survey form out there.
1:08:41You can start filling that out; we do have, I think, five minutes or so for questions and answers, so question right here.
1:08:47[Inaudible audience question]
1:08:53Repeat the question.
1:09:00So the question was, when you create a graph, do we need to do something special there to make it time aware?
1:09:06[Inaudible audience question]
1:09:07In the graph creation process, I would suggest that there's something...
1:09:13...when...when you are dealing with graphs, when you update the graphs, sometimes the axes need to be set to a certain time.
1:09:21So you can choose to have...right now what we do by default is that the axes are going to be set...
1:09:29...the values on the axes will be set automatically, so you can choose to preset those values, the maximum value on the graph axes.
1:09:36So that makes it look better.
1:09:38The other ones are...it's there in the help as well.
1:09:42There's some tips and tricks in terms of how do you create graphs and visualize it over time.
1:09:47So you might want to refer to that, but if there's something specific, I can show that to you, like how I created this one.
1:09:54We can go there, right?
1:09:56Okay, in the back there?
1:09:57[Inaudible audience question] How do these tools work with a geodatabase [inaudible].
1:10:03So the tools don't...Okay, the question is, how do these tools or the temporal mapping system...
1:10:08...work with geodatabases where there are archive tables?
1:10:11There's not an automatic acknowledgment of those history or archive tables in these tools.
1:10:17If we...Let's see if I have it here, quickly...I don't know how quickly I'd find it. Yeah.
1:10:24If you remember this slide here, where we were kind of talking about system-generated auditing in the database, et cetera.
1:10:31There are some patterns for time in the database that are not time as an attribute...
1:10:37...where we can actually control that through our mapping system.
1:10:40And so that's part of future directions, is how do we honor archived and historical...
1:10:45...or delta table-type information that has specific time windows on it.
1:10:51But not all of that archived data is meant to be used.
1:10:54It's like interval or animation-style time.
1:10:57So we need to get better understanding on that. But it's not something that's there at 10.
1:11:03Let's see, right here.
1:11:04[Audience question] Can you use other formats like Julian dating...
1:11:07...and the other question I have is can your polygon's start and end time overlap?
1:11:14So I'll answer...There's two questions here, the first one, and I'll have you answer the first one about the Julian date.
1:11:20The Julian date, yeah, out of the box, we don't, but if you...
1:11:23...if you want to do it programmatically, yes, there is, there are ways to do it on the time object, so.
1:11:31And you'll have to develop your own custom, custom slider for....
1:11:36So and then can you repeat the second part of that question?
1:11:38[Audience question] If you have a, your polygons where you have the start and end date so your, your fishing seasons overlap.
1:11:45Yes so, the question is, can a polygon where there's multiple time stamps on a polygon...
1:11:49...that have start and end durations, can those durations overlap?
1:11:54And, excuse me.
1:11:56I think, what I'm understanding here is that one, let's say you have one polygon which is valid from T1...
1:12:04...not T1, but say, it's valid from January first to January thirty-first...
1:12:08...and the second one is valid from January first to January fifteenth.
1:12:13Is that reflective?
1:12:14[Audience comment] Or one from the fifteenth to February something.
1:12:17Yeah, it'll show both the polygons at the same time.
1:12:20So then when it's...
1:12:21Each, each polygon is essentially almost like its own feature, you might have the exact same area and boundary...
1:12:27...and it might be this is a clone of that polygon with different times.
1:12:31And those separate features, as we play through time with the Time Slider...
1:12:36...there might be gaps where they don't have continuous where it might kind of flash on and off.
1:12:41Or they may overlap, and if it's an overlap condition and it's the same boundary, you won't see it.
1:12:46If it has evolved, you might see both of them briefly until that overlap is gone.
1:12:52So...I'm going to take one back here.
1:12:55[Inaudible audience question]
1:13:09Yeah, can you switch real quick?
1:13:12So the question is, if...if time is continuing to evolve, and the underlying time repository is not static...
1:13:19...and things are being added continually, can you keep this current?
1:13:24And I'll mention that, in, if you publish this, a layer against that time source, and you publish that through Server...
1:13:36In, this, in, in...
1:13:38Yeah, this option here, you, what we, for historical data, we suggest that you calculate the Layer Time Extent.
1:13:45So that's what the slider actually uses to calculate the full time extent.
1:13:50The other thing you can do here is you can choose this option...
1:13:53...which saves data changes frequently, so calculate the time extent automatically.
1:13:58So using this option, the slider knows that there's a dynamic layer...
1:14:02...and it'll show the dynamic layer in the, in the...in the table of contents.
1:14:06[Inaudible audience question]
1:14:10When you say that...
1:14:11[Audience comment] So the underlying data doesn't follow...
1:14:13The underlying data can be based on a view regardless.
1:14:16What happens here is this time extent gets saved into the layer with that setting, which right now is the ninth of July.
1:14:24And so the Time Slider would come to the far right and stop.
1:14:26And the server would not know that the data is changing as well, so the Web clients, et cetera...
1:14:31...if you click that check box, then every time you bring up the Time Slider, or every time the map is loaded into the browser...
1:14:37...it queries for the time extent, and it finds the range of time.
1:14:40[Audience comment] That's cool. I was just...the underlying data itself can be a view that's changing [inaudible].
1:14:46Yeah, I see. Yeah, yeah.
1:14:48Yeah, so have you looked...?
1:14:49There's something, you know if you are in your map document already, you, there's some tools here which I didn't cover.
1:14:56This is the Full Time Extent.
1:14:57So let's say your data's changed, you could, if you click this button, it's...it's automatically going to calculate the new time extent.
1:15:04The other thing is, have you looked at the query layers that are part of 10 now, where you can build a layer based on a SQL query?
1:15:11[Inaudible audience comment]
1:15:12That might be something, like if you just have a view against a...
1:15:14...like say an Oracle table or something, you can build a query layer against that raw data.
1:15:19And if that data changes, when you bring up the Time Slider, it will find the newer date fields.
1:15:24Yep. So. Thanks.
1:15:26Let's see, over here.
1:15:27[Audience question] When you showed the Make Query, Query Table tool, and you said it would...
1:15:32...does that actually, will it allow you to average [inaudible] values for a whole day?
1:15:37[Audience question] Or is that a separate tool?
1:15:38That's a separate tool; I used the Summary Statistics tool on that.
1:15:41[Audience question] So you used Make Query and then Summary Stats table?
1:15:45Yeah, that's what I used on that.
1:15:47So actually, you don't need...
1:15:49...yeah, let me, let me...
1:15:51[Audience comment] Yeah, that would be awesome if you...
1:15:52Let me answer this again.
1:15:53So you have the time series data; you could actually run the Summary Statistics tool on that data itself.
1:15:59And then use a Make Query Table.
1:16:01So that'll be even better, because you don't have to join like a larger dataset that's already aggregated to a daily...
1:16:08[Audience comment] But when you do that Make Summaries Stats table...
1:16:11[Audience question] Can I say, average it, average this station for this season?
1:16:16No. No, okay.
1:16:17Yeah, you could do, I can give you a trick here.
1:16:20What you can do is you can create a new field and say that you know, these...these features are valid for a certain season.
1:16:28See what I mean? Like these, these'll be grouped by a season then.
1:16:31And that's where you would use the Summary Statistics and say that this is the field, the season field...
1:16:37...is which I want to base my summarization on or, you know, howsoever you want to summarize the data.
1:16:44Okay, I don't see that there's the next presenter here, but I'm going to keep taking questions.
1:16:49I just want to say before we might get flushed out that, thanks everybody for coming...
1:16:53...but stick around and keep asking questions until the next person shows up, so.
1:16:59Yeah. Back there. Yeah, right there.
1:17:01[Audience question] In your Time tab on your layer [inaudible] in a checkbox.
1:17:07[Audience question] Does that just make the symbol persist? Or if I was doing rainfall, would my symbol actually [inaudible].
1:17:20[Audience question] I have...I've irradiated.
1:17:22[Audience question] So my [inaudible] season, my data is in a format of inches per day.
1:17:31[Audience question] But my display is the range over time. Does that make sense?
1:17:34So it's going to be like, on the second day, you want it to be...
1:17:38[Audience question] Two inches.
1:17:39Can I ask a question here?
1:17:40I think our use of the word cumulative is that the map display is a cumulative display of features.
1:17:46Are you looking to say that that feature grows, the feature accumulates?
1:17:49[Audience comment] Correct. From here, when you say cumulative, you're really saying persists.
1:17:53We're saying, we're saying the older feature persists when the next one comes...
1:17:57[Audience comment] Correct.
1:17:58...but the map display is cumulative in multiple features.
1:18:02We're saying the map is accumulating multiple features.
1:18:04[Audience comment] Correct, so you're not accumulating...
1:18:07The data. No. No. The data's not accumulating into a single feature.
1:18:10When we look into that...into that direction for sure, you know...
1:18:13...that's why we want to hear like what you guys want in terms of data aggregation and all this stuff.
1:18:20[Audience question] I've been asked to, by...I've, I've...
1:18:23[Audience question] ...I've worked with [inaudible] with the city, and I've worked with parcels.
1:18:26[Audience question] And I've been asked by the planners to be able to click on a piece of land...
1:18:30...[Audience question] and see how that's been zoned through time.
1:18:34[Audience question] Or how it's been subdivided through time is a separate problem.
1:18:37[Audience question] Can, can I show, will the symbology change when I, when I click through times?
1:18:46[Audience question] It was zoned industrial, and then it was, or it was zoned county and then it was annexed, [inaudible].
1:18:52Yeah, it should like...
1:18:53Yes. Yes. It should, yes.
1:18:58What you...I was going to say what you may have is, through some span of time...
1:19:01...where there might be all kinds of other iterations on the features.
1:19:04You might have this parcel that just existed, and when it goes away, say, in January 28 of some year...
1:19:10...now maybe there's two parcels that replace it, right?
1:19:13So it's up to you whether one of those new parcels keeps the same parcel ID of the old one or do you create new...two new IDs.
1:19:20That's part of your data management, right?
1:19:22But, but essentially a polygon would duration to some point, and it would no longer be valid...
1:19:27...and two new polygons might be in the same space as what the previous one.
1:19:31And they're now persisting forward from that point on.
1:19:33As far as rendering, and...and showing the symbology of that, any of the attributes can affect the rendering...
1:19:38...so you could have different color values, or outlines, or crosshatching, or anything based on those attributes that you have.
1:19:45[Inaudible audience question]
1:19:49So the question is, can you animate rasters through time?
1:19:52Yes, you can.
1:19:53So the key here is that you have to create a raster catalog or a mosaic dataset.
1:19:57And have an attribute field which has the time stamps.
1:20:01So that's...as soon as you have it, you enable time on the layer, and yeah, you [inaudible] business.
1:20:07[Audience question] So if I was to set up a layer like this, with, with [inaudible] problems, switching out the data source with Python?
1:20:18When you have such a dataset, and if you switch the data source...
1:20:23[Audience question] Yeah, if I had just any of these layers up here, if I went and switched the data source through Python...
1:20:30To do something different.
1:20:31So keeping the existing, let's say, layer properties, the symbology or whatever, but just changing to a different data source.
1:20:38I think that would be...
1:20:40It's not a pattern that we've, we've really built up a new one from a data source and changed the properties in Python, but...
1:20:45The...one, one comment I'd like to make here is that...that there's a tool called Apply Symbology.
1:20:50I think there's a function in ArcPy now when you can just grab a symbology...
1:20:55...or the layer properties from another dataset or another layer.
1:21:01At that point, we don't support it right now.
1:21:04There's a...there's a...yeah, we didn't develop that one there, but...
1:21:09...so the key there is that you'll probably have to, have to change the time extent...
1:21:16...if the data is totally changed in time extent, that might be a little problematic.
1:21:21But you, what you could do there is that you should author your layer with a dynamic option, which I showed on the layer.
1:21:27That's probably the way to go on that one.
1:21:30Right? Yes, please.
1:21:32[Audience comment] I've created animations in the past; I've had to create a fake point for a...labels on my date and time.
1:21:39[Audience question] Do you guys have a simple way to put a date and time...
1:21:42Oh, I didn't sow that, show that.
1:21:46I had my layer done, but...so on the Layout field, what you can do is insert dynamic text and data frame time, and...
1:21:59...here, it's a dynamic element, so if I open this up, I can say Time...
1:22:05...and it's going to get the slider's time, and the display format as well.
1:22:12And then I can change the symbol, and David had a...had a video as well, on his slides, so I'll make it 28.
1:22:24If I move the slider now, it should update...
1:22:29...the time as well, so this is primarily useful when you're trying to create videos.
1:22:34Here's a video tool, Create Video tool, right off the slider.
1:22:37The other place where it's useful is when you are trying to use ArcPy scripting for generating temporal map books.
1:22:43 We didn't cover that here, but now that is another capability that we have the data frame time...
1:22:49...and I can just go through the different times and create maps as a...as a map book, so.
1:22:55 [Inaudible audience question]
1:22:57Oh this one is Insert Dynamic Text and Data Frame Time.
1:23:02Because the current date and time are your current system date and time, not from the database.
1:23:07[Inaudible audience question]
1:23:14There's a question in the back.
1:23:16[Audience question] Is it possible to have two or more Time Sliders...
1:23:20...and then change their [inaudible] time per layer, and then synchronize it.
1:23:26Okay, so the question is, if, if, is it possible to have two or more Time Sliders...
1:23:31...and then as you change the current time that they keep synchronized.
1:23:35So there is one instance of Time Slider for the map; we're not, there's not like two different Time Sliders that come up.
1:23:43There is a lot of properties on this Time Slider that allow you to create time windows...
1:23:48...and per layer, you can react to the Time Slider time.
1:23:52On layers, you can offset; you can do different time zones.
1:23:55You can do those things as a function of the Layer Properties, but not to say, have two sliders, like one per layer.
1:24:01Yeah. That, that, that's not...
1:24:03There's...the slider is per data frame, so you could possibly create two data frames as well.
1:24:10So...if you're looking at that offset kind of thing, maybe you have a layer that's 2009 for all of May...
1:24:18...and you have 2010 for all of May.
1:24:21Well the Time Slider says 2010 right there, that's the...the control.
1:24:25You take the 2009 layer and you go to the tab and say Offset plus one year...
1:24:29...and now both layers, you can do like an A, B kind of comparison...
1:24:34...as one of them will be kind of artificially rendering in 2010 with that one-year offset.
1:24:38So that eliminates the need to have lots of sliders for different layers.
1:24:42So it's this property here, right at the bottom. Right.
1:24:45Okay, any, there was a question over here, right here.
1:24:48[Audience question] Just curious, what's the appropriate workflow for getting an animated graph onto a layout for export for videos?
1:24:55It's simple as this. Let me do... I'll try.
1:25:02Add to Layout, right-click on the graph, Add to Layout.
1:25:06[Audience question] So that'll work with the Time Slider?
1:25:07Yes, it should. Let me place it right here.
1:25:12Let's move the slider. It did...moved...the bubbles, so.
1:25:15Yeah it did. Yeah. It's doing the labeling at the bottom too, so it's good.
1:25:19Yeah. So it's all synced up, everything is synced up.
1:25:23[Audience question] When you calculate the End Time tool, you showed how it's offset.
1:25:26[Audience question] What happens for the very last record? Does it get to save End Time, Start Time?
1:25:29You know what, we actually had that in the notes and I didn't speak it; it does.
1:25:36So yeah, the last instance will keep the last instance Start Time, so these arrows point up, except the last one is the same.
1:25:43You can manually edit that and create the offset on the last one if you want to, yeah.
1:25:48I skipped through that accidentally, I was already past it and...
1:25:51And this is all available in the help, you know, these graphics...
1:25:54...and so we've worked quite a bit on the help in this release as well, so...
1:25:58...in general in ArcGIS 10, the help is much more clearer.
1:26:02[Inaudible audience question]
1:26:05Yeah, the, the User Conference proceedings we'll have this.
1:26:08We'll have...we haven't uploaded it yet, as far as the...the PDF.
1:26:12We're going to do that today, but the video will be available too, or the audio.
1:26:18[Inaudible audience comment] Does it work with the ArcGlobe and ArcScene?
1:26:25Yes, it does.
1:26:30[Inaudible audience question]
1:26:44So when you...when you set the Layer Properties...
1:26:46...and you publish a document, the services that are created in Server are time enabled...
1:26:51...so the Time properties, such as, if you did set a time zone...
1:26:54...or you set an interval, or what your time extent, and all of those fields...
1:26:58...those go with the service; they're coming out of Server.
1:27:01So the REST API, the SOAP API, and including the different WMS, WFS...
1:27:07...you're able to make a query request from that Web client to set a time window.
1:27:13[Audience comment] Okay, I've had a problem doing that, and I was very negative, something's wrong with my, [inaudible].
1:27:29So you have the netCDF data in the map document, and that's what you're trying to publish?
1:27:35Yeah, there might be some issues there; I'm not sure myself.
1:27:41Is there anybody that might help?
1:27:43Yeah, you could probably stop by on the Spatial Analyst island and look for Norman, as...as the lead...
Working with Temporal Data in ArcGIS
This session provides an overview of the functionality, techniques, and tips for visualization, query, and analysis of temporal data in ArcGIS. It includes an overview of considerations and best practices for the conversion, loading, and storage of spatiotemporal data. We will explain and demonstrate core support for time in ArcGIS 10, andcover visualizing real-time data with the Tracking Analyst extension. Examples of concepts and tools to solve some real-world problems will also be given.
- Recorded: Jul 1st, 2010
- Runtime: 1:28:02
- Views: 140124
- Published: Aug 25th, 2010
- Night Mode (Off)Automatically dim the web site while the video is playing. A few seconds after you start watching the video and stop moving your mouse, your screen will dim. You can auto save this option if you login.
- HTML5 Video (Off) Play videos using HTML5 Video instead of flash. A modern web browser is required to view videos using HTML5.