VISUAL INSPECTION SYSTEMS TRAFFIC MONITORING SYSTEMS Image and

VISUAL INSPECTION SYSTEMS TRAFFIC MONITORING SYSTEMS Image and Signal Processing CAMEA, spol. s r. o. Headquarters: Kořenského 25, 621 00, Brno Branch offices: Prague, Lanškroun Tel. : +420 5 4122 8874 Czech Republic WWW. CAMEA. CZ WWW. UNICAM. CZ

VISUAL INSPECTION SYSTEMS Automatic identification of railway carriages 2

VISUAL INSPECTION SYSTEMS Automatic identification of railway carriages § § Train speed up to 160 km/h Height of captured area 2300 Detection and recognition of UIC codes Line-scan camera with parameters: § resolution: 5100 px § LPS: 11 k. Hz § Use of other sensors (scale, bearing test, …) 3

VISUAL INSPECTION SYSTEMS Line-scan camera systems evolution CAMEA uses line-scan cameras in 2 domains: Automatic identification of railway carriages Instalace Vojkovice Web inspection (nonwoven textiles, paper…) 4

VISUAL INSPECTION SYSTEMS Line-scan camera systems evolution § Every 8 years – available cameras with 10 -times bigger datarate (resolution & speed) § § § 2002 – 2568 pix @ 7 k. Hz -> datarate 17 MB/s (Mfg. CAMEA) 2010 – 4096 pix @ 70 k. Hz -> datarate 280 MB/s (Mfg. BASLER, DALSA) 2018 – 11000 pix @ 200 k. Hz -> datarate 2200 MB/s (Mfg. TELEDYNE e 2 v) 5

VISUAL INSPECTION SYSTEMS Line-scan camera systems evolution § It allows monitoring faster objects/materials with higher resolution… § But: § Smaller pixel size and higher linerate need to evolve better illumination § Most camera systems operate in real time need to manage and process higher data rate in real time 6

VISUAL INSPECTION SYSTEMS 1 st quest - Illumination units § Todays top line-scan cameras § typical pixel size 25µm 2 § linerate 200 k. Hz (shutter speed 1/250000 s, 4µs) § Quantum efficiency 50% § Need illumination unit with approx. 10 Mlx § (direct sunlight in noon is 70 klx) 7

VISUAL INSPECTION SYSTEMS § New designed illumination unit § 10 W LED chips (CREE), 4 mm pitch, 250 LEDs/m § 5 m long unit = 12. 5 k. W power consumption § Need water cooling (propylene-glycol), otherwise DPS will be unsoldered during 5 s § Final light intensity = 12 Mlx 8

VISUAL INSPECTION SYSTEMS § New designed illumination unit 9

VISUAL INSPECTION SYSTEMS 2 nd quest – fast and robust algorithms preprocessing 1 – vertical image equalisation - DFT - 50 Hz compensation (DFT), vibration of material 10

VISUAL INSPECTION SYSTEMS preprocessing 2 – horizontal image equalisation - - Lenses and CMOS sensor vignetting - Illumination nonhomogenity 11

VISUAL INSPECTION SYSTEMS Processing time optimization § Requirements § Datarate of 1 camera = 2. 2 GB/s § As many cameras as possible on one computer § Data transfered via DMA from camera directly to memory § Techniques § § Multithreaded processing of one camera’s data High-end CPU (more than 6 cores) SSE and AVX instructions CUDA (planned for future) § Results § i 7 -8700 K can manage up to 4 cameras § Total datarate 8. 8 GB/s § 60% CPU utilization 12

VISUAL INSPECTION SYSTEMS § First tests on real material (11/2017) § Nonwoven, 1250 m/min production speed Material texture recognition test 13

VISUAL INSPECTION SYSTEMS § First tests on real material (11/2017) § Nonwoven, 1250 m/min production speed Simulated pattern recognition test 14

VISUAL INSPECTION SYSTEMS § First tests on real material (11/2017) § Nonwoven, 1250 m/min production speed Real „contamination“ recognition test (Drosophila hydei 2. 5 mm) 15

Real installation 9. 4. 2018 § 4 x camera e 2 v 11000 pix @ 200 k. Hz, difuse illumination § 4 x camera Basler 4096 pix @ 70 k. Hz, dark field illumination § Total data rate 9. 92 GB/s 16

VISUAL INSPECTION SYSTEMS TRAFFIC MONITORING SYSTEMS Thank you for your attention!