LCD Computing Setup Server Specs and Setup Desktop

  • Slides: 14
Download presentation
LCD Computing Setup Server Specs and Setup Desktop Cluster Organization Physics Software Distribution Plans

LCD Computing Setup Server Specs and Setup Desktop Cluster Organization Physics Software Distribution Plans and Schemes Jeremy Mc. Cormick, Sergey Uzunyan, Guilherme Lima, et al 10/8/03

Server Hardware Specs • Dual-CPU Athlon: 2. 133 GHz • 2 Gb RAM •

Server Hardware Specs • Dual-CPU Athlon: 2. 133 GHz • 2 Gb RAM • HD: 1 master disk, 1 secondary, 4 RAID • ~1 TB total storage 10/8/03

Server Configuration • Red Hat 9 • kernel 2. 4. 20 -13. 9 smp

Server Configuration • Red Hat 9 • kernel 2. 4. 20 -13. 9 smp • hostname k 2 • IP 131. 156. 85. 141 • accessible via SSH 10/8/03

Server Filesystem Size Mount Description /dev/hda 1 13 G / root fs /dev/hda 3

Server Filesystem Size Mount Description /dev/hda 1 13 G / root fs /dev/hda 3 19 G /home dirs /dev/hdb 2 185 G /k 2 bkp backup disk /dev/lcd/k 2 dist 9. 9 G /k 2 dist physics distribution /dev/lcd/k 2 work 145 G /k 2 work project work dirs /k 2 data project data /dev/raid 0/lcd_data 734 G 10/8/03

Conceptual Diagram 10/8/03

Conceptual Diagram 10/8/03

NFS Structure Mount Description /k 2 dist physics software distribution /k 2 bkp backup

NFS Structure Mount Description /k 2 dist physics software distribution /k 2 bkp backup /home/$USERNAME user home directory /k 2 work/$USERNAME project work directory /k 2 data/$USERNAME project data /sdisk/$MACHINE workstation shared disks 10/8/03

Physics Software Distribution • simulation, analysis & event generation • shared binaries, libraries, scripts,

Physics Software Distribution • simulation, analysis & event generation • shared binaries, libraries, scripts, includes, etc. • usable from any node in desktop cluster • common environment & setup scripts • /k 2 work/$USERNAME application builds possible • /k 2 dist isolates physics apps from Linux fs 10/8/03

/k 2 dist directory structure Directory Description Contains apps applications directory tree with packages,

/k 2 dist directory structure Directory Description Contains apps applications directory tree with packages, libs, binaries bin executables shell scripts, binaries, symlinks to binaries configuration info currently contains node list documentation application docs (pdf, html, ps, etc. ) include source includes symlinks to include dirs install_files installation files install packages (tar. gz) in dirs libraries symlinks to libraries 10/8/03

/k 2 dist/apps Analysis jas, root Event Generation pandora-pythia, peg Libraries aida, boost, cernlib,

/k 2 dist/apps Analysis jas, root Event Generation pandora-pythia, peg Libraries aida, boost, cernlib, clhep, freehep, g 4 phys, geant 4, lcio, Mesa, pegs 4, xml 4 c Simulation lcdg 4, mokka, tbeam Utilities david, dawn 10/8/03

Useful /k 2 dist/bin Scripts prjenv. sh • project env • add. /k 2

Useful /k 2 dist/bin Scripts prjenv. sh • project env • add. /k 2 dist/prjenv. sh to ~/. bash_profile or ~/. cshrc appenv. sh • application env • setup java vars, PATH, LD_LIBRARY_PATH, etc. • included by prjenv. sh g 4_5_2_p 01 env. sh • Geant 4 env vars • included by prjenv. sh nodes. sh • print node names, IPs, host • ex. = for n in `nodes. sh hn`; do ping $n done 10/8/03

Simple Remote Job test_job. sh # set project environment. /k 2 dist/bin/prjenv. sh #

Simple Remote Job test_job. sh # set project environment. /k 2 dist/bin/prjenv. sh # run job nohup testbeam -m /k 2 work/jeremy/run 10. mac -o /k 2 data/jeremy/tb-test. txt &> /k 2 work/jeremy/tb-test. log & start job on node dvk [jeremy@lepton-physics jeremy]$ ssh rio /k 2 work/jeremy/test_job. sh get pid [jeremy@lepton-physics jeremy]$ ssh rio pgrep testbeam 22742 kill the job [jeremy@lepton-physics jeremy]$ ssh rio kill 22742 10/8/03

k 2 + Desktop Cluster • new user setup • common development platform •

k 2 + Desktop Cluster • new user setup • common development platform • “standard” NICADD physics apps • no more desktop installs • ample storage area • shared datasets • centralized authentication • distributed computing 10/8/03

Plans and Schemes • no more development on nicadd & individual desktops • setup

Plans and Schemes • no more development on nicadd & individual desktops • setup & packaging scripts • migrate SIO-Server • batch computing (fbs, pbs) • physics software packages • framework applications • add more cluster nodes • world hegemony (or at least Western hemisphere) 10/8/03

K 2 says “Hello” 10/8/03

K 2 says “Hello” 10/8/03