Behind the buzz of Cloud Computing 52North Open
Behind the buzz of Cloud Computing 52°North Open Source Geoprocessing Software in the Clouds FOSS 4 G 2009 Bastian Schäffer, 52°North FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
Agenda • Cloud Computing 101 • WPS in the Clouds FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
Cloud Computing 101 FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
Definition • Emerging trend in mainstream IT • Cloud as a metaphor to represent large networks and infrastructures • Store data, run applications and compute on distributed (3 rd party) facilities • Paradigm behind buzzword!? ! FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
Characteristics • Efficiency Resource Pooling • • Outtasking On-demand Scalability Cost FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
Mass market FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
Mass market FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
Mass market FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
Legally Binding Performance • INSPIRE – Search Queries • Maximum 3 sec response time* • Handle 30 parallel requests per second – Image Download • Maximum 5 sec response time* • Handle 20 parallel requests per second – Overall 99% service availability (362 days/year uptime) * During normal traffic (90% of uptime). FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
Characteristics • Efficiency Resource Pooling • • Outtasking On-demand Scalability Cost FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
Architecture Saa. S d. Saa. S Paa. S Iaa. S FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
Technology • • • Hardware Cluster Virtualization Grid Computing Application Framework (Hadoop) etc. FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
Cloud Types FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
Providers - Amazon Web Services - Google Apps Engine - …. FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
Amazon Web Services • • Small Instance – The small instance (default) equates to "a system with 1. 7 GB of memory, 1 EC 2 Compute Unit (1 virtual core with 1 EC 2 Compute Unit), 160 GB of instance storage, 32 -bit platform" Large Instance – The large instance represents "a system with 7. 5 GB of memory, 4 EC 2 Compute Units (2 virtual cores with 2 EC 2 Compute Units each), 850 GB of instance storage, 64 -bit platform". Extra Large Instance – The extra large instance offers the "equivalent of a system with 15 GB of memory, 8 EC 2 Compute Units (4 virtual cores with 2 EC 2 Compute Units each), 1690 GB of instance storage, 64 -bit platform. " High-CPU Instance – Instances of this family have proportionally more CPU resources than memory (RAM) and address compute-intensive applications. FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
• • - Cloud Watch Auto Scaling – CPUUtilization – Network. In – Network. Out – Disk. Write. Ops – Disk. Read. Bytes – Disk. Read. Ops – Disk. Write. Bytes – Request. Count – Healthy. Host. Count – Un. Healthy. Host. Count Elastic Cloud Balancing FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
Costs FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
Google Apps Engine FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
Google Apps Engine - Easy to manage Java or Python Several restrictions Big. Table vs. RDBMS FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
Costs FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
Costs FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
WPS 101 – What is WPS about? FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
Introduction OGC Web Services SOS FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
Introduction OGC Web Services SOS WMS FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
Introduction OGC Web Services SOS WMS WFS FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
Introduction OGC Web Services SOS WMS WCS WFS FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
Introduction OGC Web Services CSW SOS WMS WCS WFS FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
SDI Integration • Processing FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
SDI Integration • Processing FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
SDI Integration • Processing FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
SDI Integration • Processing FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
Introduction OGC Web Services CSW SOS WMS WCS WFS FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
SDI Integration • Computational Power • Network Bandwidth FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
SDI Integration • Computational Power • Network Bandwidth serverside processing FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
SDI Integration • Processing FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
SDI Integration • Processing Service FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
SDI Integration • Processing Service Standardized Interface unified access Deploy-once-use-everywhere FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
SDI Building Blocks FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
Introduction OGC Web Services CSW SOS WMS WCS WFS FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
Introduction OGC Web Services CSW SOS WPS WMS WCS WFS FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
Introduction WPS -Introduction FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
WPS 101 § What is a WPS? Web Based Processing WPS FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
WPS § WPS Process 1 Process 2 Process n FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
WPS § WPS Get. Capabilities Process 1 Process 2 Process n FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
WPS § WPS Get. Capabilities Process 1 Describe. Process 2 Process n FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
WPS § WPS Get. Capabilities Process 1 Describe. Process 2 Execute Process n FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
WPS § Example WPS ? ? ? FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
WPS § Example WPS ? ? ? Buffer Process 2 Process n FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
WPS § Example WPS ? ? ? Buffer Process 2 20 FOSS 4 G: 52°North WPS Process n http: //www. 52 north. org/wps
WPS § Example WPS ? ? ? Buffer Process 2 20 FOSS 4 G: 52°North WPS Process n http: //www. 52 north. org/wps
Introduction Technical Features FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
Introduction WPS additional features § Execution FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
Introduction WPS additional features § Execution Synchronous Asynchronous Binding GET POST SOAP FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
Introduction Execution synchronous Object 1 FOSS 4 G: 52°North WPS Object 2 http: //www. 52 north. org/wps
Introduction Execution asynchronous § Push-model FOSS 4 G: 52°North WPS Object 1 Object 2 http: //www. 52 north. org/wps
Introduction Execution asynchronous § Pull-model Object 1 Object 2 reference 50% result FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
Introduction Clients FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
http: //giv-bandog. uni-muenster. de: 8081/OL/Spanish. Roads. html FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
u. Dig • CLIENTS FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
Jump • CLIENTS FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
Performance Tests FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
Demo FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
Conclusion • WPS use possible in cloud environments • Scaleability provided • Google Cloud easy to use good for light-weight application Good integration with other google apps • Amazon cloud More complicated to use Full-scale solution Flexible • Cloud Interoperability present from client perspective (external) not from provider perspective (internal) FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
Conclusion Future: Impact on GIS Business Models – Selling of full GIS packages Saa. S – Other impacts on SDIs • Role model • Etc. FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
pu bli h fin is bl d pu sh d bin Georesource provider Georesource owner bind Georesource owner Georesource provider FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
Conclusion • THURSDAY: 13: 30 Parkside G 04 „Geoprocessing in the clouds“ introduction to geospatial layer in the cloud FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
Thank You schaeffer@52 north. org FOSS 4 G: 52°North WPS http: //www. 52 north. org/wps
- Slides: 79