Internal Grid experiences in Montepaschi Group Internal Grid
- Slides: 39
Internal Grid experiences in Montepaschi Group
Internal Grid experiences in Montepaschi Group
Agenda Internal Grid experiences in Montepaschi Group Introduction 2001 SOA Architecture 2005 Internal Grid solution and applications 2008 Grid and Virtualization 2009 Evolution
IL GRUPPO MONTEPASCHI About 34. 500 Employees 39 > 3. 000 Branches in Italy Foreign Branches and Offices Group’s Head Product Companies Banks Service Companies Up-to-date on 09. 30. 2008
Il Consorzio Operativo Gruppo Montepaschi Il Consorzio Operativo è la società che svolge in accentrato per le aziende del Gruppo Montepaschi lo sviluppo e la gestione dell'Information & Communication Technology, i Servizi di Back Office ed i Servizi Ausiliari Le Banche costituiscono il Consorzio:
Agenda Internal Grid experiences in Montepaschi Group Introduction 2001 SOA Architecture 2005 Internal Grid solution and applications 2008 Grid and Virtualization 2009 Evolution
Group’s Information System From Inside To outside
Estended Multichannell Architecture Mainframe Services Web Services CED WEB Server (IIS) Server WEB Server ATM POS Server Channels Branch Call Centre HB Internet Autom. Branch WAP GSM CB Internet ecc.
Broker
Batch Processing • IBM Tivoli Workload Scheduler • CICS (PAF) Batch TP • Flows Converter (BTS) • GRID (AGA)
Agenda Internal Grid experiences in Montepaschi Group Introduction 2001 SOA Architecture 2005 Internal Grid solution and applications 2008 Grid and Virtualization 2009 Evolution
MPS Internal Grid • Use idle resources for CPU intensive jobs • Interaction with heterogeneous systems (desktops, servers, dedicated server farms or even Host) by means of standard or standards-to-be protocols. • Evolution from Condor to a custom solution • Communication between nodes is performed using Web Services
Accomplishments • Current Accomplishments – Clickstream analysis (January 2005) – IAS 32 -39 (August 2005) – Top Management Monitoring (January 2006) – Basel II (Algoritmics) (October 2005) – DOC 1 (December 2006) – many other apps …. until today • Next Steps – Host Batch downsizing – …….
Gartner’s vision on Grid Computing Source Gartner Jul 2007
The Grid Computing power is everywhere, we try to make it usable by anyone. Miron Livny v Average Mainframe usage: 80% v Average RISC Servers usage: 45% v Average Intel Servers usage: 10 -15% v Average Client usage: lower than 10% v “Year 2008 will see a doubling in usage of Servers” Source: Gartner v Server usage will further increase in the future There’s a lot of space in the bottom Richard P. Feynman
Server farm • About 600 non-dedicated Windows and Linux servers • We expect to have 1. 000 central servers with Windows 2003 Server • About 27. 000 jobs every day (41. 000 peach)
Realizations • Clickstream analysis – In production since the start of the year – About 50 sites – 476 instances on single servers Job entity valued in 2 -4 CPUs servers working for 8 hours The same job requires 2 hours of our Grid infrastructure Phase I. Open Source + Condor Phase II. Open Source + AGA Phase III. SQL Server (AS) + AGA
IAS 32 -49 • • First hypothesis on Mainframe (Cobol+ DB 2) Realization with GRID (Cobol + AGA + SQL Server) In production since July 2005 Elapsed time less than 1 hour
Basel II • Chosen the Algorithmics’s (Unix/Linux and Oracle) for Market Risks Analysis Job • Supplier proposed a SUN machine or a Grid Data. Synapse • Solution based on AGA. NET (on Windows Servers) with Linux nodes (we are discussing the porting of Algoritmics on Windows), including data loading • in production since 2005’ end
Top Management Monitoring Datawarehouse for compliance • First implementation dedicated scheduler and machines • Today Grid scheduler…… Microsoft Reporting Services • loading data with Grid
Generation of documents and account statements for Customers • Formerly DOC 1(PDF document generator) for z/OS was used • Effort estimated: 6 days of elapsed working time (of a 8. 000 MIPS machine). • Now 1 day. • Today all banks in production on GRID (6 hours on mainframe -> 2 hours on a few Grid machines for the main bank).
Conversion of batch procedures from mainframe • Currently testing the porting of batch procedure – Cobol – PL/1 -> rewriting
Murex Reporting • Currently more than 150 reports on Grid
Agenda Internal Grid experiences in Montepaschi Group Introduction 2001 SOA Architecture 2005 Internal Grid solution and applications 2008 Grid and Virtualization 2009 Evolution
Grid and Virtualization • Our goal is the Grid computing node virtualization • We are experimenting both Thin. App by VMWare and Xenocode • If the application environment is not present on the node, we download it dynamically (using streaming) with the application • Finally we destroy the virtual environment
Task execution sketch Real environment Virtual environment \nasfi 1. localVirtua l. Apps
How it works Application to be executed in a virtual environment
Task execution sketch - continued \nasfi 1. localVirtua l. Apps The virtualized Execution host is downloaded using streaming from the network share
Task execution sketch - continued \nasfi 1. localVirtua l. Apps Virtual execution environment is created and the application (also downloaded from a central repository) is executed within it Application is downloaded from a central repository
Task execution sketch - continued Output When the task ends, the virtual environmment disappears with the application itself \nasfi 1. localVirtua l. Apps Applicatiocn
Agenda Internal Grid experiences in Montepaschi Group Introduction 2001 SOA Architecture 2005 Internal Grid solution and applications 2008 Grid and Virtualization 2009 Evolution
New areas • Grid scheduling with virtualization also for real time infrastructure (using Linux Virtual Server for balancing) • Use of eterogeneus environment (GPU, FPGA) for high intensive computing task – Es. Monte Carlo simulation in Nvidia GPU • Grid Services • Semantic (Data, Web Services, Grid)
SOA architecture needs GRID • Business services are not only RPC calls • We need long running processes also • SOA is not only for internal use
Grid Services • Web Services allow integration of heterogeneous systems to achieve A 2 A communication and for shortterm transactions, involving the exchange of relatively small quantities of data. • Grid Services will allow integration for more significant jobs, considering the CPU usage and also the quantity of data. • GRID vision allows the network to evolve to an environment in which machines and human beings can collaborate.
Cloud Computing • Cloud or Fog ? • Standards ?
« Croire tout découvert est une erreur profonde, c’est prendre l’horizon pour les bornes du monde ! » Camille Flammarion • Information tecnology is not only support for business. • It’s changing our way of learn, exchange knowledge, buy, work, etc.
Thanks Piero Poccianti Consorzio Operativo Gruppo Montepaschi Funzione Osservatorio Tecnologico
- North bridge south bridge
- Grid-group theory
- Social trap example
- Within group variance vs between group
- Anova within group and between group
- Voluntary group and involuntary group examples
- Group 1 vs group 2 specialties
- Thermal decomposition of group 1 nitrates
- Amino group and carboxyl group
- Amino group and carboxyl group
- In group out group
- Group yourselves
- Sumner's classification of social groups
- Joining together group theory and group skills
- Difference between internal check and internal control
- Vouching in auditing
- Types of dining
- Contrived experience
- Cs_rs11-iiia-1
- An account of the personal experiences of an author
- Positive subjective experiences are
- Guiding storytelling experiences
- The importance of social sciences
- Guiding play
- They do not appreciate my singing
- What are the experiences of latin american countries
- Direct experience list
- Near-death experiences are ap psych
- Comparative development experiences of india and china
- Expériences professionnelles
- Quote the passage when the creature experiences
- Experience de magendie
- Using job experiences for development assumes that
- What experiences from 1763 to 1776
- W.w. jacobs important experiences
- The totality of a groups thought experiences and patterns
- Https://quizlet.com
- Early experiences in rhythmic movement should focus on
- Subjective experiences in physical activity
- Artistic experiences