HIVE THE solution for Big Data and Fast

HIVE THE solution for Big Data and Fast Data Image management and processing solution

ACQUISITION Data. TRANSFER Founded 2012/ Karlsruhe, Germany

HIVE note #1 RAID Storage Data Security Hard disk drives will fail. By teaming multiple Hard disks into a RAID, we create a data redundancy that allows exchange of a faulty disk drive while the HIVE is running, with no loss of data. If a drive in the array fails, remaining data on the other drives can be re-combined to reconstruct the missing data. RAID 6 A 1 B 1 C 1 Dp Eq A 2 B 2 Cp Dq E 1 A 3 Bp Cq D 2 E 2 Ap Bq C 2 D 2 E 3 Aq B 3 C 3 D 3 Ep Disk 0 Disk 1 Disk 2 Disk 3 Disk 4

HIVE note #2 RAID Types in HIVE uses two RAID systems: • RAID 5 on HIVE-CORE for speed With one redundant “parity stripe”, one disk can fail without data loss. • RAID 6 on HIVE-DATA for security With two redundant “stripes”, two disks can fail without data loss. BTW All Disks are monitored for performance and temperature. In case of unusual readout values, a notification will be provided to indicate which drive is affected. With simple Plug-and-Play hardware, replacing a defective disk takes seconds. RAID 5 A 1 B 1 C 1 Dp A 2 B 2 Cp D 1 A 3 Bp C 2 D 2 Ap B 3 C 3 Disk 0 Disk 1 Disk 2 Disk 3 One parity stripe RAID 6 A 1 B 1 C 1 Dp Eq A 2 B 2 Cp Dq E 1 A 3 Bp Cq D 2 E 2 Ap Bq C 2 D 2 E 3 Aq B 3 C 3 D 3 Ep Disk 0 Disk 1 Disk 2 Disk 3 Disk 4 Two parity stripes

HIVE note #3 Battery Backup All components of the HIVE are secured by the uninterrupted power supply (UPS) located in the NET. Battery backup is important because power system instability can be fatal for data storage. RAID systems are sensitive to voltage fluctuations which could result in severe loss of data. With the built-in battery pack, the operating system can initiate a safe shut down process instead of just a blackout.

HIVE note #4 Connect large Data Volumes with HBA An HBA (Host Bus Adapter) is a hardware device, that provides I/O processing and physical connectivity between a server host (HIVE-CORE), and external storage, (HIVE-DATA). It can transfer data with 12 GBps. The HBA transmits data between the CORE RAID 5 and the DATA RAID 6. The HBA architecture operates as a unified storage area network (SAN), relieving the principal HIVE processor of data transfer tasks. The result of using HBA is improved server performance, improved data streaming from high speed devices, and in general a more stable system.

HIVE note #5 Cats and cables connection How to choose for the right network connection cable? • • • Cat 5 supports speeds up to 100 Mb/s (100 MHz) Cat 5 e supports speeds up to a Gigabit Ethernet (1, 000 Mb/s) (100 MHz) Cat 6 supports speeds up to 10 Gigabit Ethernet and can be connected at a distance of less than 50 meters (1, 000 Mb/s) (250 MHz) Cat 6 A supports speeds up to 10 Gigabit Ethernet with distance up to 100 meters (10, 000 Mb/s)(500 MHz) Cat 7 & Cat 7 A support speeds up to 10 Gigabit Ethernet with distance up to 100 meters (10, 000 Mb/s)(1000 Mhz) HIVE supports up to Cat 7 A, but the hardware in any attached acquisition computers must be matched to the hardware in the HIVE to achieve maximum data transfer rates. Cat 6 A or higher is strongly recommended!!

HIVE note #6 Cable Selection Copper Optical Fibre Advantages • • • Power over Ethernet Less expensive electronics Flexibility Local cable assembly is easy Use existing infrastructure Disadvantages • • • Fragility Inefficient data transmission Local cable assembly can easily be done incorrectly • • Transmission and power efficiency No Electromagnetic Interference High Bandwidth Cost – Fibre is less expensive than copper Lightweight compared with copper Transmission distance much greater than copper Ease of installation – higher tension limits when pulling cable (10 kg for copper, 40 -80 kg for optical) Security – cannot be easily tapped (impossible to tap with an EM antenna) Disadvantages • • Cost of electronics Cable assembly requires more skill

HIVE note #6 Cable Selection In general, stick to the existing infrastructure!! Copper Optical Fibre When do you want to use copper? When do you want to use fibre? • • • Short distance communication When cabling construction can be assured Long distance transmission of large amounts of data Short distance transmission of very large amounts of data Requirement for data integrity Why would you want to use copper? Why would you want to use fibre? • • • Cost of components and assembly Ease of system assembly Total system cost Transmission of large amounts of data over long distances Availability of existing optical infrastructure and maintenance skills

HIVE note #7 GPU High Performance Graphic Board For the highest available performance, we provide the latest NVidia Quadro P 6000 display adapter. This card utilizes the latest technology in video display adapters and will be more than adequate to enable your demanding graphical display requirements. GPU Memory 24 Gb GDDR 5 X System Interface PCI Express 3. 0 x 16 Max Simultaneous Displays 4 direct, 4 DP 1. 4, Multi-Stream Additional Features: 3840 CUDA (GPU) cores for fast GPU-based image visualization and analysis routines

HIVE note #8 Monitor Specification What kind of display system do we suggest? • • 27” LED monitor Single or Dual monitor system Resolution equivalent to 2560 x 1440 @ 60 Hz VESA-compliant monitor mount Quickly and securely attach the monitor head to a variety of stands, brackets, arms or wall mounts to suit your laboratory requirements. Built-in USB 3. 0 hub VGA, Display. Port 1. 2 (1. 1 compatible), DVI-D; HDMI 1. 4; We currently offer the HP Z 27 i IPS LED monitor, which meets or exceeds all of these requirements

HIVE note #9 Antivirus and Security • • • Security and firewall provided by router Intrusion protection provided by Dray. Tek Vigor 2960 No antivirus so the data transfer speed is sufficient (800 MB/s) for a s. CMOS camera at full speed/full frame Encapsulate the microscope network from the Internet Firewall in between the Internet and internal microscope network, configured by user.

ACQUIFER note #10 Single processor vs. Multi-processor • Image Analysis software was originally developed for single processor – It benefits more from high clock speed than from multi-processor • • • As time comes, more and more IA software multithreaded More and more software transferring work load to GPU HIVE offers multi-processor with high clock speed, as well we high power GPU, to maximize the performance of different IA software packages.

HIVE OVERVIEW • CORE, DATA, NET • EXAMPLE CONFIGURATIONS • SETUP EXAMPLES

HIVE CORE Storage – processing – visualization – network – data sharing Central computing unit • Single or dual CPU up to 44 Cores • Up to 1 TB RAM • Ready for clustering with additional units • Single or Dual GPU • Super-silent • Windows 2012 R 2 Server Fast storage 450 – 800 MByte/sec Fast Network 2 x 10 Gbit/sec Silent Cooling Win 2012 Server R 2

HIVE DATA Storage pods – daisy chain connected Storage unit • SAS storage unit up to 104 TB usable space • Combine more storage unit´s to one virtual partition • RAID 6 technology for data security • Double the read/write speed with 2 DATA modules • 24/7 technology 15 x 3, 5’’ HDD Raid 6 52 TByte – 76 TByte – 104 TByte in any combination

HIVE NET Vigor Router – Firewall – DHCP – UPS Networking unit • 10 Gbit/s network switch for up to 13 microscopes • Firewall and gateway functionality • Secured VPN access • Uninterruptable Power Supply (UPS) for all units Draytek Vigor Router / DHCP / Fire. Wall 10 Gbit/sec switch – 320 GBit/s backbone/capacity Battery pack UPS for CORE and DATA module

Example Architecture • • • ©ACQUIFER No data movement, no data duplication (!) Remote access to data for processing via desktop computing Low maintainence requirement Better security (No need for portable drives Extendable with more storage & computing units

Examples Configurations Example 1 Computing Storage Network Example 2 Computing Storage Network Computing III Example 3 Computing I Storage I Network Computing III Storage III Computing IV

Security Example Setup I Institute network Private network Internet Secured Institute Internet ©ACQUIFER VPN

Security Example Setup II Institute network Private network Internet Institute Internet ©ACQUIFER VPN

Security Example Setup III Institute network Private network Internet VPN Secured VPN Institute Internet ©ACQUIFER VPN

HIVE data machine Increases productivity and access time to microscope • A simplified IT infrastructure • No data movement • No data duplication • Remote access to data for deconvolution & more
- Slides: 23