Transcript
00:01Thanks for attending this afternoon.
00:02What we're going to talk about is a business perspective on deploying into the Amazon infrastructure.
00:10Myself, my name is Andrew Hendrickson. I'm a solution architect within our corporate sales management division.
00:15I'm going to be copresenting with Marwa Mabrouk from our service implementation services division, correct?
00:21And so, I will pick up and start the conversation today in discussing, you know, is the Amazon cloud right for your GIS?
00:31And I'll talk about a lot of different things from a business angle, but we'll also...
00:36...dive a little bit in and talk about architecture as well.
00:39So I think it'll be necessary to talk a little bit about patterns and practices as well.
00:44We'll talk about business cases for using the Amazon cloud.
00:48Within that, we'll kind of focus on elasticity and time to market...
00:51...as well as risk aversion and budgetary reasons for utilizing the Amazon infrastructure.
00:57We'll talk about ArcGIS 10 a little bit and we'll float a little bit back and forth and talk about some technical...
01:04...we'll deep dive a little bit for some of the deployment options that I'll discuss.
01:10And then we'll wrap up talking about some services that we have to help get you started.
01:19So with ArcGIS 10 we see a change.
01:24You know, we see a cloud-ready system that out of the box supports the ability to have...
01:30...both an on-premise server as well as a hosted server.
01:34In addition to our desktop, mobile, and rich Internet clients, we now have the ability to have multiple, or I should say...
01:40...sort of a hybrid approach to architecting a solution to satisfy your business needs.
01:47So what becomes important now is to start to talk about, how does GIS fit into your IT enterprise?
01:54What is the governance around the GIS itself? Is GIS part of it?
02:01Is it part of the IT, you know, enterprise plan?
02:06Do we consider it mission critical? Right? 'Cause we've got to start talking about SLAs and service-level agreements...
02:12...when we're talking about including the GIS on infrastructure that you do not necessarily own.
02:21So in a sense, are you in or out of the IT governance?
02:25So what this slide attempts to describe, is cloud an option for your GIS?
02:30In the left column I have listed as tiers, and I've just sort of named them, randomly as...
02:37...SLA 1 through SLA 3, meaning service-level agreement again.
02:42Let me define service-level agreement.
02:43What I’m talking about is what is the required uptime...
02:46...or expectations of that system match with your business workflow needs?
02:52So the way I've laid this out is, in the second column it says Uptime.
02:56What is the expected uptime of a particular application or technical workflow?
03:01Is there five nines? Is there four nines? Is there three nines?
03:03This is what I’m really getting at in terms of uptime. So 99.999 percent uptime.
03:09Does anybody have that type of uptime with their GIS today? Okay, couple, right?
03:14Let's move down a little bit and talk about 95 percent uptime...
03:17...which basically means you get about 18 days a year that you can be down.
03:20Does that sound more realistic for the GIS domain?
03:24This is something that we need to begin to consider because the type of infrastructure that you will use to support it...
03:30...will either enable you or disable you from doing that.
03:33So let's go from left to right on SLA 1.
03:37SLA 1, the uptime there required, 99.99 percent. 999 percent, which gives you 5.25 minutes of downtime a year.
03:48Some folks are laughing, which translates into 25.9 seconds a month...which translate into about 6 seconds a week.
03:58So this is a...this is a sample, by the way.
04:02This is just how I want to start to get you thinking.
04:04On the right-hand side I have listed under Infrastructure, On Premise.
04:09Why do I have listed On Premise?
04:10Because there may be the inability for a cloud vendor to support that type of uptime, depending upon what you choose to use.
04:19But you need to be aware of this ahead of architecting a solution and including the cloud in your potential conceptual architecture.
04:28Number two, the second column there, SLA 2. Uptime requirement, 95 percent.
04:33Well that gives you about 18 days a year that you can be down, or 36 hours a month, about 8 hours a week.
04:39Down meaning not available to the rest of your business.
04:42The infrastructure I've listed here is a combination or a hybrid of on-premise and cloud...
04:48...where we're able to mix and match the SLAs
04:51...on the particular pieces of infrastructure to match your business needs.
04:57SLA 3, 90 percent required uptime. 365 days a year.
05:02Again, I'm recommending in the third column the same type of architectural pattern for deployment to meet those needs.
05:10So the takeaway from this slide is, we need to begin to think about the GIS the same way...
05:14...we think about other critical mission, or mission-critical systems.
05:19A good way to do this is to start thinking about the technology as it falls into deployment patterns, or patterns of usage.
05:30So over the past few years, we've been working a lot with large clients and small clients alike...
05:35...and we've noticed trends in the way folks are deploying Esri technology.
05:39The first pattern that we want to talk about is data management.
05:43So where is the data being managed?
05:45Sometimes this is also referred to as asset management.
05:49But this directly correlates with how you're collecting, organizing, and exchanging your data.
05:53 collect once, reuse many times.
05:56So from a technology perspective this correlates with our geodatabase, our geodatabase information model.
06:03Moving to the right, Planning and Analysis.
06:05So here's where we're able to take information out of that place where we're storing it...
06:09...and transform it into actionable information.
06:13We do that how? Contemporarily, we do that with our geoprocessing framework.
06:18There's other ways that it can be done too, but primarily we're talking about geoprocessing.
06:23Further to the right, Field Mobility.
06:24Getting information into and out of the field.
06:28Having a field user be able to actually alter attributes in the geodatabase...
06:33...or change features and submit them back in real time.
06:37The fourth pattern, Operational Awareness.
06:40Here's where we're able to take information and make it available to the rest of the business...
06:43...whether it be via a web map, or a mashup, right? But this correlates with our web API technology.
06:51Why do I like using these patterns when I'm talking about the cloud as well?
06:54Because the technology performs differently, depending upon which pattern of usage you're using.
07:02So it's a good way to start thinking about your business process workflows...
07:06...and which ones might be better served in the cloud versus on premises.
07:13So one neat thing that we've seen happen over the past few years is the usage of our web APIs is increasing tremendously.
07:21So it's giving, relevancy to the GIS domain.
07:24The folks that are editing data are actually doing things within the geodatabase editing features, but what do we have?
07:31We have a lot of demand coming from folks who want to see those web maps.
07:35They want to see the GIS data taken out of the domain and mashed up with other types of map services.
07:42Utilizing the Amazon EC2 paradigm, we can very quickly expand out a web mapping application.
07:50And we can also bring it back.
07:51So if we've got peaks and troughs in our usage, we can expand and bring them out...so...and bring them back.
07:57So the concept I wanted to leave you with is let's begin to think about the patterns of usage...
08:01...within your business enterprise as well, before you make a decision as to what way you want to deploy the technology.
08:08Is cloud actually an option for you?
08:16So I thought I'd throw up a little quote, definition, you know. So what is the definition of "elasticity?"
08:21"The tendency of a body to return to its original shape after it has been stretched or compressed."
08:28Is elasticity a reason, by a show of hands, for why a lot of you were curious about utilizing Amazon?
08:35Maybe? Okay.
08:37I challenge that in the future it may be, for you.
08:40I may see more hands in the future.
08:46So I'm going to dig in a little bit on elasticity.
08:49You can adjust for peaks and demands, troughs, for your data management tasks that you're performing today.
08:56So, with our potential deployment options today...
09:01...we see the availability to create high availability with ArcGIS Server in the Amazon cloud...
09:07...as well as the enterprise geodatabase.
09:10We see the availability to actually deploy a highly available infrastructure...
09:18...that you can do updates from out of the cloud, into the cloud.
09:23But let me clarify that, in business, the cloud is almost like you're renting that server hardware, right?
09:28You don't own it. Right? There's implications there too.
09:31So as we think about this from a budgetary perspective, as we think about these deployment patterns...
09:37...think about the implications for your budget as well, right?
09:41Is it hard for folks to provision, hardware?
09:45I have found in my career it could be very difficult to provision hardware...
09:49...because it comes out of a certain style of budget...
09:51...whereas this may not come out of the same style of budget, so I'll come back to that.
09:55Okay, enhanced and dynamic processing.
09:57Large batch processing, geoprocessing large-scale analysis.
10:02Being able to blow out that infrastructure and then bring it back without taking ownership...
10:06...or having to worry about actually provisioning all of that hardware.
10:12Some things we've seen going on already. Cache cooking. Do we like this term of "cache cooking?"
10:18So creating your cache and then moving it around.
10:21Something you have to do not so often, depending upon how often your data changes.
10:26But maybe you want to use some infrastructure that you don't own to actually create it...
10:30...or store it, and then bring it back.
10:35So actually deploying your cache in S3 as well.
10:38And we'll talk about precisely what S3 is and what the price implications are later in the presentation.
10:43Large batch geocoding, or just geocoding in and of itself...
10:47...do you want to support that on your own infrastructure or sort of farm it out?
10:54So the operational awareness pattern, in mobile as well. I kind of lumped these together on this slide.
10:59So growing out capacity as needed. This has been a barrier for many clients in the past.
11:06Or, simply, we didn’t know how many folks were going to be utilizing web maps...
11:12...or mobile capabilities, so we put something out there and said people will come to it.
11:16Well sometimes I say be careful what you're asking for.
11:19Put something out there and then all of a sudden on day two you've got 1,200 people coming at it at the same time, right?
11:24So how do you support that without sinking your infrastructure?
11:28This type of deployment, the Amazon cloud gives you very, very nice options here.
11:34So expanding your capabilities in near real time.
11:38Hopefully some of you were able to attend the earlier session...
11:40...were able to see that it does not take a lot of time to provision a server.
11:45 So one server access with ArcGIS Server, high availability. This is a big deal.
11:52We're going to start to see folks that in the past have not been able to actually deploy in...
11:57...highly available environments, be able to utilize these deployment patterns to do so now...
12:01...which means you can begin to support more mission-critical workflows.
12:07Same thing between the mobile pattern of usage as well as the operational awareness pattern of usage.
12:15So I wanted to throw some pretty simple architectural style diagrams at you today as well.
12:21What we're looking at is a traditional on-premise deployment, where we've got a single user, or a couple users.
12:26I don't mean to denote it's only one person, but basically there's a desktop...
12:30...there's an ArcGIS Server, there's an editing environment on premise.
12:35On premise meaning you own the server. You've got to provision the server, right?
12:39You own it, right? You've got to administer it.
12:47So this one shows a cloud deployment of the same architectural pattern...
12:52...where the user is accessing the same pieces of Esri technology...
12:58...but now they don't own that physical piece of hardware anymore.
13:01It's actually on Amazon's infrastructure.
13:04The desktop can still exist there. ArcGIS Server can still exist there and you can do some editing in the cloud.
13:11You don't have to own any of it. This is one deployment pattern that we're seeing today.
13:18So expanding that out a little bit, let's talk about actually adding some redundancy to it, right?
13:25So here we've got an on-premise person, I'll just keep referring to it as a single person...
13:31...but on-premise data management and analysis occurring, where you're still managing assets and you're doing geoprocessing.
13:37You're adding value to the data on premise, but you're pushing across and up into the Amazon cloud...
13:44...information that you can serve as a web map.
13:47So you're not coupled to the infrastructure that you have on premise to serve a greater audience in the cloud.
13:56And we can utilize many, many different parts of the Amazon technology platform to manage growing this out.
14:03And we'll talk about that later in the presentation as well.
14:07So this is listed as ArcGIS Server 1 through N.
14:11This is a very, very nice architectural approach as well for decoupling your different environments.
14:17There is an SLA that's different for the operational awareness pattern...
14:21...than it is for your data editing environment in this proposed conceptual architecture. The two are not connected.
14:33In this slide, we're demonstrating a bit of a hybrid, where we've got, an on-premise user.
14:39They may have an actual desktop there or maybe they're just tunneling in to Amazon...
14:46...and accessing ArcGIS Desktop there, with ArcGIS Server there as well.
14:51And we can have the actual infrastructure supporting data management and visualization decoupled as well...
14:58...with them both sitting in the cloud.
15:08We can synchronize between geodatabases in the cloud as well, with multiple ones existing.
15:15This has a lot of implications in terms of being able to support a large amount of users...
15:21...for being able to actually synchronize a highly available geodatabase on Amazon infrastructure.
15:28This has typically been a pain point in the GIS domain for achieving maximum uptime of a redundant geodatabase...
15:36...while trying to support the actual, the physical device itself.
15:42Hope this is becoming clear how it's playing out.
15:44There is a bit of...a degree of separation that we want to have for the types of patterns that you're using the software...
15:51...and we want to correlate those with how you're deploying it.
15:53We want to see you correlate it with how you're deploying it.
16:02So in this one, you know we've got a publication instance actually in the cloud, editing actually going on on-premise...
16:07...and we're synchronizing between the two and simply creating an active passive pair...
16:13...where we don't require that high level of redundancy between the two databases.
16:20 So again, let me rewind us a little bit and say it's very important for you and us to understand...
16:26...how available the data needs to be to an application or an end user...
16:31...before you choose your type of deployment pattern.
16:35And when does the business say that the data actually needs to be live?
16:43So in this case, you'll notice that the operational awareness pattern...
16:46...which is the one all the way to the right where we're serving web maps, hasn't changed at all.
16:50It's completely different. So they are decoupled even though they're all in the cloud.
16:59With this slide, it's broken down even differently.
17:03Another message I think I should state for you is that there's a lot of different options now...
17:10...and the ArcGIS platform is pervasive across all of it.
17:14So you have the ability to, even if you cannot have because of some sort of IT governance...
17:20...where you're organization does not allow things to exist outside of your data centers...
17:25...or outside of your own owned hardware...
17:28...maybe you might want to just have a development environment that exists on Amazon...
17:32...whereas in the past you didn't have a separate development environment.
17:36You can build a development environment out very quickly and get rid of it when you don't need it.
17:42It's also very good for a QC/QA environment.
17:45This one is demonstrating a completely on-premise deployment, but only with a test environment in the Amazon cloud.
17:54So as you can imagine, there is a myriad of ways that we can mix and match the way that we deploy ArcGIS.
18:04And the way that you utilize data management is also very important.
18:08As Marwa will talk about later, there's implications for the size of data that you're going to be moving around.
18:14So if you don't need to move a certain amount of data from on-premise up, don't.
18:21'Cause it may cost you more money.
18:25We'll come back to a pattern later in the presentation as well.
18:29So time to market. Here's another business reason that I wanted to discuss with you today.
18:34So getting a server provisioned quickly, getting an application up and running quickly.
18:39There's a bigger issue here too, erasing the limits of creativity with the ability to quickly respond to business needs.
18:48We see this with a lot of clients today.
18:52We see this in emergency response, where you quickly have to create an application to respond to some sort of need.
18:59So utilizing the cloud, the Amazon cloud, tremendously, tremendously increases your time to provision hardware.
19:07So rapid provision of ArcGIS Server equals less time to spin up your servers.
19:13They're easy to set up and administer.
19:19You can release a web mapping application extremely quickly, in under an hour.
19:31This completely removes restraints on innovation. Very exciting to me.
19:36It gives you the ability to test different deployment patterns all the while you're doing this, right?
19:41Maybe something isn't working for you...or the organization.
19:47It allows us to be simple as well.
19:49I love staying as close to off-the-shelf software as I can so I can switch between versions, I can upgrade...
19:58...and allows me to scale very quickly, so if I do put something out there quickly and it's not correct...
20:04...I can go back. I can rewind and redo it.
20:13Another concept I want to talk about, risk aversion.
20:16Large organizations, small organizations, any organization is typically going to be risk averse, right?
20:25You know, as you grow technology throughout your business and you meet and serve more needs...
20:31...you should be risk adverse. You shouldn't just be spending a lot of money and dumping it out there.
20:36So we shouldn't have to limit ourselves due to cost ceilings as well.
20:43So as we're building things out and we make a mistake, it's good to be able to bring them back quickly.
20:53So what is the cloud appropriate for?
20:56There's some best practices that we've been talking about today a lot.
21:00I haven't called them out necessarily as best practices but they are.
21:03High availability, redundancy.
21:06What is it appropriate for, you know?
21:08Is it appropriate for your development environment?
21:11Is it appropriate for your staging environment?
21:13Is it appropriate for production?
21:16That depends upon your organization, right?
21:20By being able to do performance and scalability tests ahead of actually releasing things, we limit our risk.
21:26Maybe the cloud isn't reliable enough to meet your needs.
21:31This goes back to that service-level agreement stuff we talked about. Is it secure enough, you know?
21:38One of the main reasons why we see folks considering deployments to the cloud...
21:44...is to maximize CPU utilization across infrastructure, right?
21:49Why do I have this under Limit Risk?
21:52I kind of toyed around with this one for a little while, because I have in the past bought...
21:58...or I should say spent a lot of money on hardware, and then when we went back and evaluated it...
22:02...we weren't actually utilizing as much CPU as we needed to across that hardware.
22:07So when I was reevaluated and I was going back for budget again...
22:10...I had a bit of a problem justifying those big, honkin' machines that I had bought.
22:16Utilizing cloud deployments. We can limit that risk tremendously.
22:21'Cause you can spread things out much differently than you can with that one big honkin' box that I just referred to.
22:27That's what I mean by real utilization of owned property, of owned equipment versus rented.
22:32Again, sort of touching on the concept of budgetary concerns.
22:37Compliance as well. This is interesting.
22:39You're able to comply with certain rules and regulations by being green in terms of computing environments utilizing the cloud.
22:49I'll take questions at the end.
22:52So budget. Growing the GIS into your business enterprise requires unique budgetary planning.
23:02We always need to limit capital expenditures, right?
23:06Especially nowadays. Flexible expense budgets can be used. What do I mean there?
23:11Can you use your expense budget for purchasing hardware?
23:16Ah! But are you purchasing hardware in the Amazon cloud or are you purchasing a service?
23:22You might be able to utilize different budgets to grow out capabilities within your enterprise.
23:29So reducing operational costs as well. No heavy lifting. This is interesting. I simply mean no heavy lifting.
23:35You're not loading servers into racks. You're not worrying about power, space...
23:38...air conditioning, you know, any of this sort of stuff.
23:41Somebody else is dealing with that. That's built in to the cost of the actual service itself.
23:46And again, this time-to-market effect is very important.
23:50So literal cost and practice. We're going to talk about the literal cost and practice.
23:58We're going to talk about what an A-M-I is, or an AMI.
24:01We're going to talk about the cost of use for very specific scenarios. This could vary greatly.
24:11And we'll talk a little bit about billing and how it works as well.
24:15So I think at this point I'll turn it over for a couple of minutes.
24:23You might want to come over here.
24:31Sorry. So this section I'm going to be talking about how to estimate your costs.
24:37Some of the concepts have to do with the actual services that Amazon offers.
24:41We had a session earlier today where we went into those services, explained them in a lot of detail...
24:48...so I’m going to do this a little bit briefly, while also giving you a good idea about what these services can do...
24:56...and then how to understand how you're going to get billed for them.
25:01The...one of the most important concepts about the Amazon cloud is the instance types.
25:07What Amazon does is that they prepackage their computing power and their memory capacity in a preset configuration.
25:17This is maybe...
25:20So, for example, if you want to use a processor dual core versus quad core...
25:26...you can't set this according to what you need at that moment.
25:30You're going to pick out of the list, and that list will contain a predetermined set of capacity configurations...
25:37...and you will go with one of them. And depending on what you choose, you're going to be billed a certain rate per hour.
25:43So I put here the sizes that are typically published by Amazon.
25:47They have been modifying them and they've been known to add to them pretty quickly.
25:52The ones that are out there right now are the category standard, high CPU, and high memory...
25:56...and from the name you can tell what has been the drive for that category.
26:02They want to offer machines that either have more CPU power or more memory capacity.
26:08I've also included a couple of examples.
26:11For the 64 bit, the example I have on the left side includes the smallest machine that they have...
26:16...which is basically around 7 gigabytes of memory and it's a dual core with 4 EC2.
26:25And the way Amazon would do the computing unit, it's extracted to this term called EC2, which is an Amazon capacity...
26:34...and it equates to around 1 gigahertz of speed for the processor.
26:38So their processors will vary depending on the different categories and depending on that number of EC2s.
26:45So in short, this means this is a dual-core machine that has pretty reasonable speed...
26:51...not very fast processor, and it's only got 7 gigabytes of memory. It's 64 bit.
26:57Now on the other high end, they offer other machines that seem to be a little bigger.
27:02So, the high CPU extra large has more emphasis on the CPU power, so the CPU tends to be a little bigger or a little bit faster.
27:12They also don't have that much memory in it.
27:15One of their most recent releases was the high-memory category...
27:20...and they have the largest and it's called quadruple extra large.
27:24They typically kind of rank them as small, medium, large, extra large.
27:28So this is the biggest of all the instances you can get...
27:32...and it's got about 68 gigabytes of memory and what equates to 8 virtual cores.
27:40Now each of these instances, they come with different sizes and they also come with different prices.
27:47I included here another example for the standard type. This is the smallest.
27:51The smallest is around 48 cents an hour and that is what you will be paying if you run that much CPU and that much memory.
28:02It also comes in extra large. The price would be around 96 cents per hour.
28:08This is what's called the standard on-demand.
28:10So this is the pricing if you want to not sign up for something that is long term.
28:15You just want to use it for a number of hours and then you don't want to be paying again...
28:21...and then when you feel like using it, you go back and start some other instance.
28:24If you...if you don't want to do that, if you know you're instance is going to be running all the time.
28:30So for this coming year, I am planning two instances that I'm just going to have running all the time.
28:36Now you can get something similar to like a bulk discount and that's what the reserved instances are for.
28:43You can see you would pay a certain year term that includes an up-front cost...
28:47...but after that the usage rate per hour goes considerably low. It can go to savings up to 30 percent...
28:55...so what most people would do is that for the instances they know they're going be running all the time, they will use the reserve.
29:02And then for the other instances that they would like to use the elasticity model for, they would use the on demand.
29:08So that's how this model really works.
29:11And you can see considerable cost savings when you take into account how the reserve will be used and how the on demand.
29:22So to run an actual machine, if you want to compare a machine in the cloud to having it on premise...
29:29...what are the costs to running a machine in the cloud?
29:32A lot of folks go to the Amazon website and they're not really sure how to figure out...
29:37...which service is what and how things work out.
29:40As we just walked through the computing power in terms of CPU, and the memory has it's own hourly rate.
29:47There's also the rates that are related to the storage and typically the storage goes into the elastic block storage.
29:55So the elastic block storage is like an external hard disk that goes with your machine...
30:00...so apart from the actual C drive on the machine...
30:03...you're going to be paying for every gigabyte that you would like to attach to that machine.
30:09So this storage can vary quite widely.
30:12You might have a dataset that is just 5 gigabytes and then you're just paying for 5 gigabytes...
30:18...or you can have a dataset that goes up to 2 terabytes or more.
30:21And then you're going to be having multiple EBS blocks, each contains different datasets...
30:27...and all of them are attached to the same instance.
30:30And if you have that...the same dataset attached to multiple instances...
30:35...you would paying for that times the number of instances.
30:40And I'll have a later on example that'll explain that at a little bit more detail.
30:44But for the time being, if you're trying to look at the costs of just one machine in the cloud...
30:50...you have to consider the hourly rate that goes with the instance type that you've chosen...
30:54...the storage capacity that you have attached to that machine...
30:59...in addition to the network costs, which is expressed as data transfer in and out.
31:04I've listed here just some example for how the costs work.
31:08For the data transfer, Amazon has a promotion, so for the time being it's free...
31:14...but what we understand is that it's not going to be free forever.
31:18As for the data transfer out, first gigabyte per month is free...
31:23...but after that the first 10 terabytes are 15 cents per gigabyte...
31:28...and after that as your load increases, the prices start going down.
31:33But that kind of gives you an idea that if you are going to really equate a machine running in your environment...
31:39...and what you would get in the Amazon bill, these are the three things to take into account.
31:45And if you understand how long you're going to be running your instance, the storage capacity...
31:51...how many users are going to be sending requests using the network...
31:56...you can estimate the cost that you will see on your monthly bill.
32:04Speaking of instance, there's a very important concept just in case this is the first session you attend for the cloud...
32:11...the AMIs are one of the important concepts that go hand in hand with using the cloud.
32:17It's a machine image, so once you've created an instance, it has the software...
32:22...it has the data, it has everything you need, you create an image.
32:26And the image in the Amazon cloud is called an Amazon Machine Image.
32:31Esri has been working on creating AMIs that include our software, so we have two available.
32:37One with ArcGIS Server 10 and another one with enterprise geodatabase...
32:42...and if you start from these AMIs and create your own by launching an instance from this one...
32:48...and then setting it up with your data, then saving that as your own custom AMI...
32:54...whenever you use that custom AMI, you have a ready-to-use machine...
32:58...not just with the software, but with your data and with your applications as well.
33:06Other services and I'm going to come back and see how they relate to the patterns that Andrew's been talking about earlier...
33:14...but just to understand, these are very important basic services and that's really what makes...
33:19...these are the bits and pieces that make the cloud solutions, how you use it and how you deploy it.
33:24Another service is the Elastic Load Balancer. And this is an important service...
33:28...because it plays the role of a load balancer that does the brokering between different instances.
33:33So if you have a distributed environment, you would rely on the load balancer to distribute the load between those different machines.
33:41The load balancer doesn't just work as a load balancer between a few machines in one data center.
33:46It works with the cloud, so it's elastic enough to go across different zones...
33:52...across different data centers, and it will also grow with the load.
33:58So it works, in a sense, a little bit different from what a physical load balancer will do. It's more suitable for the cloud.
34:04So if you're doing something in the cloud, this would be a very important service.
34:09The way they charge for it is per hour, so you would pay, like 0.025, I think that's like a quarter a cent per hour...
34:23...for using it, just for having it up and running. And then you would pay per gigabyte of data process.
34:29So if you've seen the previous prices for the data transfer in and out...
34:34...if you are going to calculate a certain data going in and out throughout...through your instance...
34:40...that would be the same amount of data that would be going through a load balancer as well.
34:45And the Amazon CloudWatch is a service provided by Amazon.
34:49The purpose of it is to make monitoring easier.
34:52So once you turn it on, you can monitor the progress of your machine resources.
34:59So it will monitor the processor utilization, the memory utilization, the network utilization...
35:04...and you can see the graphs that express that on hourly rates.
35:08That service costs 0.15, I’m not sure, that's like less than a quarter dollar an hour.
35:17In general, that would be around $11.00 per machine per month.
35:22So if you have like three machines, that would be 11 times 3 per every month.
35:27And it's one of the really handy services as well.
35:31Also worth mentioning, the elastic IP.
35:34So part of the nature of the cloud, when you start a new machine...
35:38...it will be assigned a new IP address and it will include a new host name...
35:42...and a lot of people typically configure their machines based on a known IP.
35:48So if you want to avoid this nature of changeable IP address...
35:52...you can attach an elastic IP to your machine and from there on it will always have that IP.
35:59So that's a stable IP. It never changes.
36:01Once you create it, it sits there and you can attach it to any machine you start and that will become its IP.
36:06So that's the way to control the elastic nature of the cloud if you want to have a tied-down, known configuration.
36:14The way they charge for the elastic IP, there's no cost for having it up there...
36:21...but you actually start paying for it if it's not attached to a machine.
36:26So as you see, the class model kind of varies widely between the different services.
36:31So I want to make sure you kind of understand the basic ones and then you should know that as you...
36:37...kind...discover new services, always check what the price model is like. Don't make assumptions.
36:43So this one, you actually pay for it if you're not using it. But if you're using it, you're not going to pay.
36:49And the remapping, which is the reassigning.
36:52If you keep reassigning it to different machines, based on this reassignment, they will charge you.
36:57So the first hundred reassignments to the machine are free...
37:01...but after that you start paying a certain charge for it, which is around 10 cents.
37:10One more service to explain really how the elasticity works in the cloud.
37:15So everybody hears the words AMIs, which is the machine image...
37:20...and they understand an instance. But how does this elasticity really work?
37:24If you want to implement elasticity, the AMIs really play a very important part in it.
37:28Because what happens is that you want to automate the ability to see if these machines that I have running...
37:37...for example, I have two instances, and if these two instances are having a CPU utilization higher than 70 percent...
37:46...I would like to go and start another two instances.
37:49And you want something to do this automatically for you.
37:52That is the elasticity of the cloud. And that is really done through that service Auto Scaling service.
37:58So the Auto Scaling service will utilize the CloudWatch to monitor the CPU utilization...
38:05...and you can define in that service that I would like to start two more instances if these ones are utilized that much.
38:13And then once these two new instances are up and running, I would like them monitored as well.
38:18So if they are not used that much, so if they are...if the processor utilization of the new instances, the auto scaling just started...
38:28...are used less than 10 percent, I would like the auto scaling to shut them down and go back to just having two running.
38:35So this ability to add new instances depending on the utilization can be done programmatically.
38:42You don't have to keep monitoring it and then from there do it manually.
38:47You can automate the whole aspect using the Auto Scaling service.
38:51And that is really how elasticity works in the cloud.
38:53It's the ability to use the AMI to create instances when you need them and shut them down when you don't need them.
39:01For that service, the way Amazon charges for it, it comes at no extra cost.
39:05The cost goes for using the CloudWatch service...
39:08...as well as the time you pay for the instances when they're running, so the actual cost of the instances.
39:17Now a word of caution. When you are doing the elasticity, it's always good to understand what you expect...
39:28...or at least do some assumptions around when you expect to have those extra instances running...
39:32...because in the end you're going to get a bill. And that bill is going to charge you for every hour every machine ran.
39:39So if you don't know ahead of time that you're going to need to start four instances and keep them running for two weeks...
39:47...it's good to maybe not have them run, but...that's part of the risk aversion.
39:54You want them to be running so users will find them, but you should know your bill will be affected.
40:00So always kind of have this trade off and know that while you can start the extra instances...
40:05...and it's really great to avert the embarrassment of having your site go down because of extra load...
40:11...always be aware that this is going to reflect on the bill...
40:13...and be prepared to see that variation in the bill when you start those extra instances.
40:22So part of the beauty of the cloud is that it's pretty vast.
40:27However, the Amazon cloud has kind of enabled the ability to know where your software...
40:34...or where your instances will be running.
40:36Because there are a lot of limitations or a lot of requirements that certain data would not leave certain borders.
40:43Certain content would be hosted in specific places.
40:47So from that perspective, Amazon has identified where the cloud is really running.
40:53They have four regions. One in the east coast, mainly in Virginia. One in the west coast here in California.
40:59There's one in Europe in Ireland and another one in the Asian Pacific realm. It's in Singapore.
41:06So you can pick where you want your machines to be running...
41:10...and you can identify from there that's going to be the geographic location.
41:14Now within every region, there's a set of different zones, which represent different data centers.
41:21So you can be running all in the east coast and still be geographically redundant.
41:26Each of these zones is a completely different data center that sits in a different location within that state.
41:38So in general, kind of a recap, there are other services in the cloud and each charges in a different way.
41:44But these are maybe the basic ones that touch on the different deployment patterns that Andrew has talked about earlier...
41:50...and I'll come back and kind of use an example to show you how they do.
41:54But in general, if you're trying to estimate costs, there are some kind of key rules.
42:00One of them is data size really plays a very important part in estimating the cost.
42:05Now if your data is not very large, say maybe 5 gigabytes...
42:11...and you don't expect a lot of people are going to be using the services on this machine...
42:16...say for example you have four or five users using that service randomly during the day...
42:22...it's not expected that the majority of the cost is going to be going towards the data transfer.
42:28The majority of the cost you're going to see is going to be really in the hourly rate...
42:33...the price to keep the CPU and the memory running for that many hours.
42:37The costs for the storage and the costs for the data transfer become pretty much negligible in comparison to the hourly rate.
42:46But if your data is very large, if we're talking maybe 1 or 2 terabytes...
42:52...that is going to be a significant cost if you have many users using that data.
42:57So then that becomes the part where you really need to come up with certain assumptions...
43:03...around how many users are really going to use that data and how much of that data will be moving around...
43:10...whether through requests that are incoming or outgoing, or just for updates and maintaining it.
43:16It would be important then to take into account the life span and the life cycle of the data management...
43:23...due to the fact that it will have a major impact on your cost.
43:26It will even probably be higher than the actual hourly rate.
43:30So it's always important to understand when you're deploying to the cloud, make certain assumptions.
43:35Understand a certain usage model or how the system is going to get deployed and how it's going to get used.
43:43And from there, make around these assumptions certain rules that you can use to estimate the cost for...
43:52...each one of the services, to estimate the actual bill that you're going to get.
44:00Now to use an example, this is one of the deployment patterns that Andrew's talked about earlier.
44:07You can see here that we have multiple ArcGIS servers...
44:10...so we've kind of discussed in detail in the earlier session this morning...
44:15...how the AMIs for ArcGIS Server work and how the instances would work.
44:21So to kind of recap on that quickly, using the AMI you would generate one instance, set it up with your own data...
44:29...with your own application, and then create your own custom AMI based on that.
44:33And then from that custom AMI, you can start as many instances that, as you launch them...
44:39...they will have the software configured, they will have your data, they will have your application.
44:44And then from there, you assign the Elastic Load Balancer to all those different instances.
44:49So in the cloud, we're not separating the SOM and SOC in the deployments.
44:53The Elastic Load Balancer is the main tool used to distribute the load between the different instances.
45:00So from that perspective, you are using here two services.
45:04The Elastic Load Balancer, to do the brokering, as well as the instances that will run ArcGIS Server.
45:11Now, knowing your services and knowing how many people are going to be using it...
45:15...you can estimate how many of these instances will be needed.
45:19And if you want to monitor them, you can use the CloudWatch service and from there you can keep an eye...
45:25...and see if you need extra instances to be started when you need them, you go and start them.
45:30And when you don't need them you can shut them down.
45:38So this is what an Amazon bill looks like. They usually break down the number of hours from the different services.
45:49So in this case, based on a large Windows instance that was running that many hours...
45:55...and of course, within a month it's impossible to run that many hours.
45:58This actually represents many instances. So they lumped it all into one item.
46:05So you see that many hours, around 2,000 hours by...multiplied by the rate 0.48, we get that cost, $1,000.00.
46:15Then the storage, that's the EBS drive, and over here this is how they break the cost for it.
46:22So you could see the gigabytes per month, the number of gigabytes multiplied by the rate, and then the number of requests.
46:30These are I/O requests going to disk. And also the backups for this disk. And that's what a snapshot is.
46:41And from there, the number of requests to store that snapshot and retrieve it. So that's how the storage costs are.
46:47And you can see this is not a very high cost in comparison to the hourly rate...
46:51...and it's because the data we're talking about is not very large.
46:56And then the Elastic Load Balancer.
46:57So if you have multiple instances and you were trying to distribute the load between them, that's what the service is.
47:02And you can see how the cost is broken down for that.
47:05And the Amazon CloudWatch, that's the one used for monitoring.
47:09So that's kind of the breakdown of the EC2 bill. But this is the actual bill of everything.
47:16So this contains everything that Amazon would bill you for. It includes the S3, which is the Simple Storage Service.
47:24This is like the big file server in the cloud where you can put your data and once you put it there, it's published.
47:32It's also good place to leave your data as a transition while you're setting up your environment.
47:38So in this case we haven't used S3 so there's no cost there.
47:42But if it is used, as you get access to it with an account, you will see the cost here.
47:49Also, the data transfer.
47:51You can see it's pretty negligible because there wasn't really much of a load on these instances that were running.
47:57But that's what the bill would look like and you can see it up above the title that this was marked for one month.
48:04So Amazon bills monthly, whatever you have running in the infrastructure, you will get that bill.
48:09And at the beginning, they ask you to give them a credit card to create an account.
48:14And put a limit on that credit card just to make sure that if they hit that limit, they notify you before they go and bill more.
48:22But what they will do given that mark, they will get the bill every month...
48:26...and they will bill you to your credit card according to that.
48:33So a couple more things to take into consideration and going back to the time to market...
48:40...beside just thinking on this as hardware, there's...
48:44...you really need to kind of maybe think of it also as a different way to do things...
48:48...because of the nature of the cloud, to make the best of it...
48:51...maybe you need to learn a few new habits.
48:57Something to consider, if we compare the time in the past it took for procurement, hardware setup...
49:02...IT setup, software setup, this has all been approximated in just going and launching an instance.
49:09So launching an instance takes about 15 minutes. And once you launched it, it's ready to use.
49:13You can start copying your data, copying your application, and in comparison to the number of days...
49:19...or weeks sometimes it took to accomplish all of that, it's become really fast and easy.
49:25Next thing to do is to, once it's set up, you can go and create your own custom AMI.
49:30So even the time it took to set up your data and application loading...
49:34...next time you launch an instance, that has been approximated. You don't have to do that except once.
49:39Once you launch the instance based on your custom AMI, it's got everything ready.
49:44So from that perspective, you really need to start thinking about maybe a different way to trouble shoot.
49:51You're not really tied to one instance. If you created an instance and it doesn't have a persistent problem...
49:58...just for like, suddenly it stopped working, a lot of the times now it's okay to go and terminate that instance...
50:05...and just start a fresh one that works. It saves you a lot of time from that perspective.
50:10Also, kind of the way you do updates. You don't have to take a machine down to do an update.
50:14You can go and create another instance, do the update, and then switch them.
50:18And when a machine is ready, you can put it behind the load balancer and now everybody can access it.
50:23You don't really have to make it available all the time.
50:26So, taking these things into account, and how you manage your time, and how you do things...
50:32...you can actually be a lot more effective in very little time and do things very, very quickly.
50:39But with great power comes great responsibility.
50:42So there are a few things to keep in mind, and one of the most important recommendations I make...
50:50...if you really are going to use the cloud, you really have to follow up on what you start and make sure you terminate it or you stop it.
50:59Because a lot of people are in the habit of once you get a machine up and running...
51:02...it's running and then you go and do something else. Even though you don't need it anymore, it's still there.
51:08You don't recognize that you are going to get billed for it until you get the bill.
51:13So some of the best practices is really to remember. You just use the software and the hardware when you need them.
51:20When you don't need them anymore, you stop it. So you stop paying for it as well.
51:25And then when you need it again, you start it and you start using it again.
51:29So that's really one of the best recommendations to keep in mind.
51:33Also, using the AMIs.
51:35Like I just showed you, it takes away a lot of the things you used to spend a lot of time on unnecessarily.
51:41So now that you have a ready-to-use AMI, you just launch the instance and it's ready to use. It gets everything you need on it.
51:47Also, elastic IPs. If you think of a distributed environment that keeps changing its IPs...
51:52...elastic IPs is one of those really good features to take into account...
51:57...so once you've configured your environment, you don’t have to keep reconfiguring it.
52:01Then having the AMIs with the elastic IPs and the Elastic Load Balancer, everything really works much easily...
52:08...and it's a really easy job to maintain it from there on. Also, should add to automate wisely.
52:18So I've seen a lot of folks get very excited about the fact that we have web services in the cloud...
52:23...and now they go and start building scripts to all sorts of very exciting things and very great stuff...
52:29...but then you find that it really wasn’t used much. It didn't really save them that much time.
52:34So it's always good to consider that there are web services to enable you to do all sorts of things in the cloud...
52:40...but that doesn't mean you should just go and start building scripts unless you really need them.
52:46And like I just said, troubleshooting takes a whole different paradigm.
52:51So if a problem is not persistent, it's just a fluke or if it's just happening today...
52:57...you don't really have to go and keep troubleshooting it to get that machine up.
53:01You could just kill that instance and go and start a new one.
53:03And that saves you a lot of time and saves you a lot of effort.
53:09Just a quick note, there are a few good references to take into account when you are doing this type of cost calculation.
53:17One of them is the Amazon Calculator on their website. It's a very nice tool. Excuse me.
53:23And also, keep an eye, because the prices in Amazon do change.
53:28Luckily they change to be cheaper most of the time, but they do change a lot.
53:34And also the services. They keep providing new services all the time.
53:38So maybe they release a new service that you find to be really good for you, works better...
53:43...and then you can migrate to that rather than keep using the one you have.
53:47So this is something to keep an eye on.
53:49And also because it's a new environment, there's a lot of blogs out there...
53:52...and a lot of people are willing to share their information and expertise through them.
53:55So if you're very interested to learn what other people are doing, you will find a lot of information out there.
54:03So give this back to Andrew and...
54:07I think maybe this will work.
54:13So yeah...we also want to make sure that we give you the message that...
54:19...there is support and services today, if you're interested in doing this on your own.
54:24I’m sorry, not on your own. If you need assistance.
54:28There are certain licensing questions that will inevitably come up at the end of this session when we ask you to...
54:33...give us some questions, and we'll address those, but there aren't easy entry ways into this.
54:40There are custom servers that we provide. We've got a jump-start package for you.
54:46There's architectural assistance, you know, through your distributor or out of your...through account management.
54:54There's a bundle that we're offering and there are experts very close by that can speak to the bundle.
55:01And there are premade AMIs that we've been working on for quite some time.
55:06And with ArcGIS 10 this is supported out of the box. So with that said, I'm going to do a bit of a review.
55:14We're not done, that's for sure, but there's a lot of information that's being thrown around at you today.
55:19I mean the reason why we wanted to have a business section, discussion I should say...
55:24...in addition to technical ones, is, I mean, think about what Marwa just went through.
55:28Think about the implications for you setting up the wrong way. Right? How much it could potentially cost.
55:35So let's rewind a little bit and just think back to how we began the discussion today.
55:39You know, is the Amazon cloud right for you? It's Infrastructure as a Service. You need to understand that.
55:47The patterns and practices, yes, but what does ArcGIS technology do for you today?
55:51How can it better serve you in the Amazon cloud?
55:55We gave you a very brief introduction to an approach for beginning to dive in and investigate from a business perspective...
56:05...how the platform should align with your business processes, and business cases, right?
56:12Sometimes folks do things just 'cause it's cool. Right? And maybe that's a valid reason.
56:18But I think what we're trying to...to get across to you is let's have a good reason to do it and then we'll do it.
56:24I'm just playing around in a development environment.
56:26That's a great reason, to be honest with you, 'cause then you get to know how the technology works.
56:31Think about all the different abstractions we talked about today. You need to become familiar with those.
56:36But, you know, the main points that we thought were important today, and there are many more, not in any particular order though...
56:42...but are elasticity, I think this is a big deal in the GIS domain. I really do.
56:49I've seen limitations and failures with deployments because we just can't get to enough CPU when we need it.
56:56That barrier is going away.
56:58Time to market. Time and time again it has taken us a long time to get a technical workflow up...
57:04...and supportable so we can support the business. This eliminates that as well.
57:10Risk aversion. You know, I love the concept that if something's not just working I can kill it. That's a neat concept.
57:21And then the budgetary one too. I mean I thought this was important to include today, because personally I've had success...
57:27...in swapping around budgetary arrangements to pay for cloud deployments, and with clients as well.
57:33And that's simply...
57:37How many people capitalize their hardware on their budgets?
57:42I mean, do you own this hardware that you're deploying ArcGIS Server to with Amazon?
57:47You don't technically own it, which means it comes from a different expense budget.
57:52 So the message here, again, you've seen this in the plenary, we've talked about it today...
58:01...is that ArcGIS 10 is the enabling technology here.
58:05It's pervasive. It can be deployed on premise as part of your enterprise or locally, or in the cloud.
58:12Other things don't change.
58:13The capabilities are still there for visualization, for the creating your data, managing your data.
58:19This has huge implications for a collaboration message. Huge. Right?
58:24The discovery of data, managing your data, analyzing data.
58:27 ...This is genuine transformation of the platform.
58:32So, ArcGIS 10 is a complete solution, as well as a complete system. So did we include our...? No.
58:44[Unintelligible] Yeah, we're going to do some Q&A now. Is that okay?
58:50I had some predefined topics that I was going to suggest to you, but apparently it was in a different presentation.
59:00 So with that, no awkward pauses, let's open the floor. Yeah, we'll start with Lisa.
59:09What are the security implications to using the cloud? [Unintelligible]
59:26Sure.
59:27Do you get security with the cloud [inaudible]?
59:31Do you want to repeat the question first?
59:32Yeah.
59:35Sorry, so the question is what are the security implications for using the cloud?
59:41The instances that you use in the cloud typically have two levels of firewalls.
59:46One that is set by the cloud itself; it's called the Security Group.
59:51And the other one is a firewall local to the machine itself.
59:55So within the instance itself you have pretty much good control over the security.
1:00:00The part where the cloud gets to be more open is when you are exchanging the data or moving it around.
1:00:07And for that part, the recommendation is to either encrypt your data or to resource for something...
1:00:15...like a virtual private network where it's a special connection that's very well encrypted...
1:00:20...very well isolated from the rest of the cloud.
1:00:22So in terms of specific federal security regulations and certifications and accreditations...
1:00:30...the cloud has only been certified and accredited for moderate level.
1:00:34So not for all sorts of federal certifications.
1:00:38So from that perspective, they're not considered something as efficient as an on-premise environment.
1:00:45So it's worth kind of knowing the details and what you need...
1:00:49...what exactly is the security level you're trying to achieve...
1:00:52...and from there looking at a specific service in the cloud that will match that.
1:00:58[Audience question] So do you have to manage the [inaudible] as far as on that specific [inaudible]?
1:01:02Yeah, the security groups are very easy to manage.
1:01:05In the other session that we have on the cloud, if you'd like to attend it, we demonstrate how you set this up.
1:01:10It doesn't take...it takes less than a minute. Very fast and very effective.
1:01:16So if all what you want is just to make sure nobody else is going to be accessing your machine, you can control that.
1:01:20Like I said, there are two levels.
1:01:22There's the security group, which includes many instances, but there's also the local firewall.
1:01:26You can turn that on and keep it enabled for your instance.
1:01:29And then if you are exchanging any data that you feel is sensitive, you can keep it encrypted and that will protect it.
1:01:37In a sense, there's sometimes not a lot of differences between different zonal approaches within your own business today.
1:01:46Not sure who's next.
1:01:48[Audience question] Can I, for example, implement a three-tier architecture...
1:01:52...and keep the database server on premise with the web server, application server in the cloud?
1:01:59The question - and pardon me if I get it wrong - but I think your question is, Can I implement a three-tier architecture...
1:02:04...where I have the database on premise, correct, and the web server and application server in the cloud?
1:02:11So is the presumption that you would be going back to your on-premise data in real time to draw it back?
1:02:17I don't think that would be a best practice, okay? You're creating a lot of single points of failure there.
1:02:23There might be a better way of taking the information, the data, out of that on-premise instance...
1:02:28...and moving it onto the cloud in some way, shape, or form that's optimized for serving it back out.
1:02:33I don't know if you want to add anything to that.
1:02:35Yeah, I would say that would be the recommended approach is keep your database with your server.
1:02:42Because they communicate through TCP, and you don't really want that to be over the Internet.
1:02:46Yeah. Yes, sorry. Yes.
1:02:49[Audience question] Is there an educational cost schedule for universities and colleges?
1:02:57Is there an educational cost schedule for universities and colleges.
1:03:03Does your university or college, you know, have an enterprise license agreement with E-S-R-I, Esri?
1:03:08[Audience answer] Yes.
1:03:09Okay. So yes, there's a cost arrangement and agreement there.
1:03:12[Audience question] Is that on the Amazon side as well?
1:03:13No. As far as I'm aware today, the answer is no. I don't know if anybody else wants to chime in on that from the audience.
1:03:21I can confirm that, that these are two separate things.
1:03:25The way the AMIs work is you start them, but you bring your own license, so if your license is an ELA...
1:03:31...you can then use it as many times as you need depending on the number of cores you're starting.
1:03:36But if your license is only four cores, you are bound to the same rules you are bound to in on-premise environment.
1:03:42Plus you'll get the bill that Marwa showed you, or the university will.
1:03:47Yeah, so these are two different costs right now.
1:03:49We're not bundling the licensing with the actual Amazon costs.
1:03:53And Amazon bills you for their costs, and you have your license...
1:03:57...and you license the instances once you enable them based on that.
1:04:02I don't know if you want to add anything.
1:04:03[Audience participation] So Amazon does have a really neat grant program. Go to aws.amazon/grant.
1:04:10Universities and other educational institutions can take advantage of their grants, and they provide free [inaudible].
1:04:17[Inaudible audience question]
1:04:18Yeah. Aws.amazon/grant.
1:04:23Yeah. Thank you, Neil.
1:04:25Any questions regarding our bundle too, this is a great resource over here, Neil Tomlinson.
1:04:31So we have some more hands. Yes?
1:04:33[Audience question] You mentioned that you have two Esri AMIs right now that you're testing.
1:04:39How does the individual organization create their own for deployment and use in the cloud?
1:04:46So if you're going to create your own AMI, we recommend that you base it on the Esri AMIs.
1:04:53So you probably want to build it because you have your own software stack that you would like to add to the Esri software...
1:05:00...or are you talking about just replacing what Esri has done in their own AMIs?
1:05:04[Audience answer] Adding additional things. Adding data, having [inaudible]...
1:05:09Sure.
1:05:10...[inaudible] certain use cases.
1:05:11Yeah. Start with ours is what we want. Yeah.
1:05:13[Audience question] You can start with yours, add to it and save it as your own.
1:05:17Yes. And that's the concept of a custom AMI.
1:05:19Now these AMIs are great to distribute internally within your organization, but according to our license setup...
1:05:27...when you start sharing it with another organization, that you need to come back to Esri with that.
1:05:32[Audience question] If I have an ELA, I can use it in my organization.
1:05:34Yes. Yes, absolutely. Yes?
1:05:39[Audience question] My question had to do with the reserved instances and Amazon's pricing structure.
1:05:43Does that only apply to one instance, or are there like...
1:05:48Because I heard you say, well, you can just kill that instance and create a new instance, you know.
1:05:54How does that work with the reserved instances if you only get one, or can you get multiple instances with the reserved...
1:06:00What they say is you have two instances running for the duration of a year. Okay.
1:06:04Now you could stop and start and kill and start new instances.
1:06:08As long as there are two instances running all the time, you will achieve the cost savings that they promise you by doing that.
1:06:18Yes?
1:06:19[Audience question] Do you support these [inaudible] AMIs with the [inaudible] on premises?
1:06:23I'm sorry.
1:06:25[Audience question] Like running an [inaudible] against the cloud on premises...
1:06:28...do you use those AMIs like you use other AMIs?
1:06:31Well, these AMIs are now built and optimized for the Amazon environment.
1:06:36They take advantage of specific capabilities in the Amazon environment.
1:06:39To build something similar to that for different virtualization software would require building it for that software.
1:06:47But right now, the ones we have work just with Amazon.
1:06:50[Audience question] How would you go about building them?
1:06:54So the question is how would we go about building that custom one?
1:06:57I think we could maybe just have a sidebar conversation with you.
1:07:00Yes, and also the other session we have, How to Use ArcGIS Server in the Cloud, we go into a lot of details.
1:07:05We had that one earlier today. There's going to be two other offerings for it Thursday and Friday morning.
1:07:13We go into a lot of details on how you start your own instance, how to set it up with your own data...
1:07:18...and just create your own custom EBS, custom AMI from there.
1:07:22If you would like, I could show you that also offline. Yes.
1:07:29[Audience question] Correct me if I'm wrong, you said that, in terms of like optimizing ArcGIS Server...
1:07:33...you wouldn't want to add SOC machines; you would want to use the...
1:07:38Full AMI.
1:07:39[Audience question] ...the elastic cloud and just add SOC instances on that one machine?
1:07:44Now when you launch an instance from the AMI, it includes both the web applications, the web server...
1:07:51...the SOC and SOM, all on one machine.
1:07:53So what you do, when you start multiple instances, is you enable the Elastic Load Balancer to seed these different instances...
1:08:02...and it will do the brokering between them and...
1:08:05[Audience question] Isn't that more than one SOM on each machine then?
1:08:09Yes. In that case, the SOM isn't really doing any distribution.
1:08:13[Audience question] For the actual...
1:08:14Yeah, it's just running on one machine, so...
1:08:18[Audience question] But that's the difference between, like, real hardware...
1:08:21...where you add another machine that you dedicate as the SOC machine, right?
1:08:25It's a different approach, but we've found that to be a very efficient approach for the cloud to kind of deploy it in that way.
1:08:32So you have one AMI and then you create multiple instances.
1:08:36The load balancer works very well if you're trying to do geoprocessing and stateful type of services.
1:08:43You can use the sticky sessions in the Elastic Load Balancer and that will allow you to do that kind of thing pretty seamless.
1:08:49The only drawback for it is that ArcMap doesn't really support the sticky cookies yet.
1:08:57The deployment pattern though that you're talking about is utilized, you know, not just in the cloud.
1:09:05We can talk more about that later too, so whether it be a software load balancer or a hardware load balancer. Yes?
1:09:12[Audience question] So does that mean that I only have to have several SOC instances [inaudible]?
1:09:20With this deployment pattern, that is correct. Yeah.
1:09:24Yes?
1:09:26[Audience question] Go ahead and tell us about your jump start and your bundles.
1:09:30Okay. We'll start with the bundle, okay?
1:09:33We actually have the gentleman who architected this thing sitting right here...
1:09:36...so that's why I'm looking at Neil, for the bundle anyway.
1:09:39You want to come on up? I'm glad you came.
1:09:43I'm not.
1:09:50So do you have a specific question about the bundle?
1:09:54[Audience question] How it works, cost.
1:09:55Okay. So basically it's a preconfigured instance that we have wrapped our term licensing around.
1:10:03It enables a lower point of entry for standing up ArcGIS Server, and it does take advantage of the AMI.
1:10:09So everything we've discussed up here is possible with the bundles.
1:10:13[Audience question] What is the cost?
1:10:19Yeah. Can we take that offline? Okay, great.
1:10:22Have you sync up with your account manager. What's that?
1:10:27[Inaudible audience question]
1:10:29Well, not offline. I just think that we... It has to do with his particular licensing.
1:10:34So the cost of a four-core AMI would be no different than a four-core license that you're deploying on premise.
1:10:43So if you're paying X amount of dollars for that four-core license, it's the same. You can take your licensing anywhere.
1:10:50You know, it's just within an audience, I don't want to presume what people are paying for their four cores of license.
1:10:57The retail cost is $40,000.
1:10:59So for a four-core license, to deploy it in Amazon, you can take your licenses wherever you want to go.
1:11:08So I would encourage everyone, now we have the Managed Services Island available in the booth area.
1:11:15If you would like to stop by, we could give you an idea about the differences between the bundle...
1:11:19...and the managed services packages that are all based on the cloud.
1:11:23So if you want to leverage that and have Esri do the management on your behalf, you can learn about that.
1:11:30You can learn about the costs and all the details regarding that.
1:11:34[Audience question] Which island?
1:11:35The Managed Services Island. Any other questions? Yes.
1:11:46[Audience question] The EBS, is that tied to an instance?
1:11:49Yes. Typically an EBS is attached to a specific instance.
1:11:52[Audience question] So if you upload data to an EBS, say if you had three instances running...
1:11:58...do you have to upload that for each one separately, or should you upload it to one, kill everything, redo [inaudible]?
1:12:06Well, it depends. There are different approaches to that.
1:12:10Some folks prefer to put it on one EBS drive and share that like a Windows share, just like you do on premise...
1:12:17...and from there have multiple instances all look at one EBS drive.
1:12:21Or another alternative is you can create one EBS drive per instance.
1:12:26So to do that, just like you create an AMI for a machine, there's a snapshot for an EBS drive.
1:12:32So you can create a snapshot and from there launch multiple copies and then attach it to each of the instances.
1:12:39The latter is actually the most recommended, which is considered best practice, because you can see with it the best performance.
1:12:48[Audience question] Is Esri looking at branching out into other cloud services? I know Windows has Azure and ones like that.
1:12:55I'm just curious to know, are you looking at setting up the equivalent of AMIs for those?
1:13:02Yes, we are. Okay.
1:13:03Yeah. But to elaborate a little bit on that, Azure doesn't have the infrastructure capabilities for services.
1:13:10As they do, we are going to definitely be interested, but right now you can use the API to build your applications...
1:13:16...and do what you need with it using specific components that we have available on that.
A Business Perspective on Deploying ArcGIS for Server in the Cloud
This session will cover models and platforms for deploying ArcGIS for Server in the cloud from a business perspective. We will help you understand how to think about costs when deploying ArcGIS for Server in cloud infrastructures, private clouds, etc.
- Recorded: Jul 1st, 2010
- Runtime: 1:13:34
- Views: 121481
- Published: Aug 25th, 2010
- Night Mode (Off)Automatically dim the web site while the video is playing. A few seconds after you start watching the video and stop moving your mouse, your screen will dim. You can auto save this option if you login.
- HTML5 Video (Off) Play videos using HTML5 Video instead of flash. A modern web browser is required to view videos using HTML5.
Right-click on these links to download and save this video.
- 480x270:MP4 (490.2 MB)
- 960x540:MP4 (681.8 MB)
If you don't have an Esri Global Login ID, please register here.