LHCB Computing q Computing Tasks q Computing Model
LHC-B Computing q Computing Tasks q Computing Model q Software Strategy â Objectives â Technology â People q Project Plan for LHC-B Computing â Project organization â Development phases and major milestones John Harvey - October 29, 1997 LHCB Status Report 1
LHC-B Computing Group q q q q q Pavel Binko Olivier Callot Lola Camacho Marco Cattaneo Jean-Pierre Dufey Yuri Ermoline Markus Frank Harris John Harvey Eric van Herwijnen Irakli Mandjavidze Pere Mato Hans Muller Andreu Pacheco Florence Ranjard Wolfgang Tejessy Andrei Tsaregorodtsev John Harvey - October 29, 1997 LHCB Status Report 2
Introduction q New software for a new experiment â intense use of software in triggering (Levels 1, 2, and 3) â many orders of magnitude more data and CPU power q Need better quality Control â better designs, better control procedures, more manpower intensive q Resources scarce â improve efficiency - use engineering practices and modern technologies â strategy must encourage all members of collaboration to participate q Need experienced people â LHC-B staff active in current experiments - big advantage â Need to close culture gap q Long lead times q Important to have a well-defined strategy and investment in project management and planning John Harvey - October 29, 1997 LHCB Status Report 3
Software Strategy Objectives q Reuse â put effort into building high quality components â become economic by extracting more use out of components q Architecture-driven approach â identify basic building blocks - 3 levels : patterns, components, frameworks â reuse spans across application domains l event display, geometry DB, data storage models, controls, GUI q Common Infrastructure â standardise on a set of working principles, process, development environment â minimise diversity of hardware and software q Commercial software â Licensing model to minimise cost and ensure collaboration-wide availability q Evolution â development and maintenance span ~20 years â plan for changes in needs and technology John Harvey - October 29, 1997 LHCB Status Report 4
Software Strategy Technology q Why Object Technologies (OTs) ? â Evolved from sound principles of software engineering â Young staff with some training in computing familiar with OTs â Technical prerequisites are in place l development environments (languages etc. ), ODBMS, communication standards, frameworks â Widespread use and support by computing industry â Adoption by HEP collaborations (Ba. Bar, STAR, LHC, …) â Object modeling leads naturally to reusability l encapsulation, design patterns, component-ware, frameworks John Harvey - October 29, 1997 LHCB Status Report 5
Software Strategy Technology - Languages John Harvey - October 29, 1997 LHCB Status Report 6
Software Strategy Technology - Distributed Computing OMG Application Objects Common Facilities Object Request Broker Object Services q Different standards â CORBA, IDL (OMG - ODMG) â DCOM, OLE (Microsoft) â Javabeans / RMI (Javasoft) John Harvey - October 29, 1997 LHCB Status Report 7
Current LHC++ components John Harvey - October 29, 1997 LHCB Status Report 8
Manpower - Profiles q Architects â experienced in design of large software systems, familiar with standards. â deliver architectural design documents and frameworks q Software Engineers â develop basic building blocks , apply quality control â require formal training in software engineering practices â deliver reference documents and user guides q Software Toolsmiths â select and maintain software tools used to build our software â install software tools and give support to programmers in their use â manage the codebase and production processing on real and simulated data keeping track of all LHCB datasets q Application Programmers â must be familiar with software development environment and follow quality procedures when appropriate â trained in use of supported languages, design methods and tools John Harvey - October 29, 1997 LHCB Status Report 9
Migration Strategy q q q q Harvest knowledge in legacy systems - dump legacy thinking LHC-B has limited software production activity now - this will change Longer we delay the more difficult it will be to make the transition Hands-on experience best way to learn Need a framework equipped with basic tools before people can start Intensive training can start once this framework is ready Need mentors and knowledge transfer between staff Technology still evolving and must be tracked - choices at appropriate times q Benefit from support groups - news services, library, seminars, in-house training, support for engineering tools, joint projects John Harvey - October 29, 1997 LHCB Status Report 10
Other issues addressed in report q q Software development process Documentation Collaborative Computing Training John Harvey - October 29, 1997 LHCB Status Report 11
Organization of Computing Projects Steering Group • coordination • planning • architecture OFF-LINE Computing Facilities • Computing Model • CPU farms • Desktop • Storage • Network ON-LINE Recon- Analysis Simulstruction ation • Level 2 • Level 3 • Prompt • Full DAQ DCS • Framework • Event • DCS • Tools Builder • LHC • Production • Interfaces • Safety • Crates • DAQware • Frameworks • CORBA, DCOM • OS Re-usable Components • Controls • GEANT 4 • CLHEP John Harvey - October 29, 1997 • budget OPS SEG • Control room • Tools & methods • SDE • CASE • Code management • Quality Control • Document. • Training • Licenses • Librarian • Collab Tools • Event Display • Data Quality • Bookkeeping • Data management (DBMS) • Event Storage (HPSS) • Graphical User Interfaces • Histograms LHCB Status Report 12
Links to Sub-detector Groups Application Project (e. g. DAQ) • Project Leader • Vertex • RICH • Inner Tracker • Outer Tracker • ECAL • HCAL • MUON • Trigger L 0 • Trigger L 1 • Trigger L 2/L 3 John Harvey - October 29, 1997 RICH Computing Team LHCB Status Report 13
Development Phases q Identify phases by boundaries which correspond to major decisions q Plan for technology change q Move to OTs which will have major impact â FORTRAN to C++ q Important to prototype â gain experience â study behaviour and performance q After prototype phase take final decisions on technology q Boundary of prototype and production phase should have less major impact â design review, C++ to JAVA? John Harvey - October 29, 1997 LHCB Status Report 14
Software Planning for Transition Phase (1) John Harvey - October 29, 1997 LHCB Status Report 15
Software Planning for Transition Phase (2) John Harvey - October 29, 1997 LHCB Status Report 16
Global Software Planning Showing Main Development Phases John Harvey - October 29, 1997 LHCB Status Report 17
Global Planning For DAQ System John Harvey - October 29, 1997 LHCB Status Report 18
Summary q Immediate challenge is a change of software paradigm q Plan to make transition as painless as possible q Relatively good position since we start later and have less investment in legacy code q We have a kernel of experienced people - to be complemented by outside help q Long term strategy involves a prototyping (learning) phase and a production phase q Organise all computing as one project â minimise barriers between on-line and off-line â maximise reuse of software components John Harvey - October 29, 1997 LHCB Status Report 19
Software Strategy Architecture-driven development q Patterns â well engineered systems are full of patterns â means of leveraging expertise of experienced architects â provide a common vocabulary and understanding for design principles q Components â systems constructed out of re-usable tested components, with known characteristics and well-defined interfaces â take longer to build, cost is higher â often can be commercially obtained q Frameworks â set of pre-fabricated building blocks used, extended or customised for a particular application. â ~half code in a typical application dedicated to routine operations, that can be built once and canned for reuse…frameworks give high level of reuse â e. g. framework that provides histogramming, statistical analysis, visualisation can be used for interactive analysis, data quality monitoring, …. John Harvey - October 29, 1997 LHCB Status Report 20
- Slides: 20