INFN Padova michele michelotto at pd infn it

  • Slides: 25
Download presentation
INFN - Padova michele. michelotto at pd. infn. it HS 06 on last generation

INFN - Padova michele. michelotto at pd. infn. it HS 06 on last generation of HEP worker nodes Berkeley, Hepix Fall ‘ 09

HEP-SPEC 06 • • 471. omnetpp 473. astar 483. xalancbmk 444. amd 447. deal.

HEP-SPEC 06 • • 471. omnetpp 473. astar 483. xalancbmk 444. amd 447. deal. II 450. soplex 453. povray Integer tests Floating Point tests • Geometric average on 7 tests. Sum on all cores • Sum on all Worker nodes Hepix Fall 09 michele michelotto - INFN Padova 2

“old cpu” Hepix Fall 09 michele michelotto - INFN Padova 3

“old cpu” Hepix Fall 09 michele michelotto - INFN Padova 3

Modern 4 core processor HS 06/Clock/ Core/ core Logical cpu Intel Clovertown 53 xx

Modern 4 core processor HS 06/Clock/ Core/ core Logical cpu Intel Clovertown 53 xx 53 -60 23 -26 2. 90 -3. 20 8 Intel Harpertown 54 xx 60 -70 25 -28 3. 20 -3. 50 8 AMD Shanghai 23 xx 60 -74 25 -27 3. 20 -3. 60 8 AMD Instanbul 24 xx 96 -99 40 -44 3. 34 -3. 73 12 Intel Gainestown 5520 80 -95 -120 43 -53 3. 33 -5. 39 8 -16 • nehalem DC-QC About 60 Measurement from Brunengo, Macorini, Crescente, Calzolari (all INFN), Srinivasan (LBNL), Iribarren (CERN), Alef (Grid. Ka), PIC, RAL, Nikhef Xeon Hepix Fall 09 michele michelotto - INFN Padova 4

Measuring Nehalem • Phase space complicated – 32 -64 bit – Hyperthreading ON -

Measuring Nehalem • Phase space complicated – 32 -64 bit – Hyperthreading ON - OFF – Memory (Size and number of channels) – Turbo Mode ON - OFF Hepix Fall 09 michele michelotto - INFN Padova 5

The official HS 06: 32 bit • HS 06 HT is on 118. 30

The official HS 06: 32 bit • HS 06 HT is on 118. 30 (16 t) 81. 81 (8 t) Hepix Fall 09 michele michelotto - INFN Padova 6

64 bit • HS 06 HT is on 136. 74 (16 t) 95. 14

64 bit • HS 06 HT is on 136. 74 (16 t) 95. 14 (8 t) Hepix Fall 09 michele michelotto - INFN Padova 7

32 vs 64 Hepix Fall 09 michele michelotto - INFN Padova 8

32 vs 64 Hepix Fall 09 michele michelotto - INFN Padova 8

64 bit Memory 48 GB (6 x 8) 24 GB (3 x 8) 16

64 bit Memory 48 GB (6 x 8) 24 GB (3 x 8) 16 GB (2 x 8) Hepix Fall 09 32 bit michele michelotto - INFN Padova 9

HT OFF 32 bit • With HT OFF I’d imagine saturation after 8 th

HT OFF 32 bit • With HT OFF I’d imagine saturation after 8 th thread • Will HT OFF 1 -8 = HT ON? Hepix Fall 09 michele michelotto - INFN Padova 10

HT ON vs HT OFF HT ON: 81. 81 HT OFF: 95. 96 HT

HT ON vs HT OFF HT ON: 81. 81 HT OFF: 95. 96 HT OFF is better up to 11 t Hepix Fall 09 michele michelotto - INFN Padova 11

HT OFF 64 bit • At 64 bit: same behaviour Hepix Fall 09 michele

HT OFF 64 bit • At 64 bit: same behaviour Hepix Fall 09 michele michelotto - INFN Padova 12

Turbo mode • Turn off the voltage on idle cores and overclock +133 MHz

Turbo mode • Turn off the voltage on idle cores and overclock +133 MHz or even +266 MHz the actives cores if temperature is ok – 5520 Default clock is 2266 MHz – 5520 3 of 4 core +1 bin 2400 MHz – 5520 1 or 2 core +2 bin 2533 MHz • New half-generation e. g. Xeon 3500 up to 4 bin Hepix Fall 09 michele michelotto - INFN Padova 13

Turbo mode • Benefit of Turbo mode decrease when number of active core increase

Turbo mode • Benefit of Turbo mode decrease when number of active core increase Hepix Fall 09 michele michelotto - INFN Padova 14

Opteron 2427 32 bit • HS 06: 98. 05 (12 t) Hepix Fall 09

Opteron 2427 32 bit • HS 06: 98. 05 (12 t) Hepix Fall 09 michele michelotto - INFN Padova 15

Opteron 2427 – 64 bit • HS 06: 111. 46 (12 t) Hepix Fall

Opteron 2427 – 64 bit • HS 06: 111. 46 (12 t) Hepix Fall 09 michele michelotto - INFN Padova 16

Instanbul 2 x exacore • Opteron 2427 – 2200 MHz – 32 GB •

Instanbul 2 x exacore • Opteron 2427 – 2200 MHz – 32 GB • 2 P x 6 cores Hepix Fall 09 michele michelotto - INFN Padova 17

Overbooking? • 5520 with HT OFF increased performance even after 8 cores • 2247

Overbooking? • 5520 with HT OFF increased performance even after 8 cores • 2247 doesn’t show any drop with 12 cores fully loaded • What happens if we start overloading with more processes than cores?

5520(2266) vs 2427(2200) 32 bit 2427 140 120 100 HS 06 80 60 40

5520(2266) vs 2427(2200) 32 bit 2427 140 120 100 HS 06 80 60 40 32 bit 2427 32 bit 5520 HT ON 32 bit 5520 HT OFF 20 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 core Hepix Fall 09 michele michelotto - INFN Padova 19

5520(2266) vs 2427(2200) Hepix Fall 09 michele michelotto - INFN Padova 20

5520(2266) vs 2427(2200) Hepix Fall 09 michele michelotto - INFN Padova 20

5520(2266) vs 2427(2200) Hepix Fall 09 michele michelotto - INFN Padova 21

5520(2266) vs 2427(2200) Hepix Fall 09 michele michelotto - INFN Padova 21

Todo • Compare with Atlas and CMS code – GEN, SIM, DIGI and RECO

Todo • Compare with Atlas and CMS code – GEN, SIM, DIGI and RECO • Effect of HT, Turbo Mode and Overbooking on Power Consumption

Questions? Hepix Fall 09 michele michelotto - INFN Padova 23

Questions? Hepix Fall 09 michele michelotto - INFN Padova 23

Nehalem “gainestown” • • • 45 nm Cache L 1 32+32 KB Cache L

Nehalem “gainestown” • • • 45 nm Cache L 1 32+32 KB Cache L 2 256 KB/core Cache L 3 8 MB shared 80 W: E 5502 1. 86 GHz E 5540 2. 53 GHz 95 W: X 5550 2. 66 GHz X 5570 2. 93 GHz Dual Thread (from 5520 upwards) Turbo Mode Quad core (excl. 5502 and 5508) Hepix Fall 09 michele michelotto - INFN Padova 24

Opteron Instanbul • • • 45 nm Cache L 1 128 KB Cache L

Opteron Instanbul • • • 45 nm Cache L 1 128 KB Cache L 2 512 KB/core Cache L 3 6 MB shared Power Consumption: – EE: max 40 W (1. 8 GHz) – HE: max 55 W (2. 0 -2. 1 GHz) – Standard max 75 W (2. 2 -2. 6 GHz) – SE max 105 W (2. 8 GHz) Hepix Fall 09 michele michelotto - INFN Padova 25