University of Ljubljana Faculty of Maritime Studies and

University of Ljubljana, Faculty of Maritime Studies and Transport, 28 Oct 2009 1 Maritime surveillance in European context Harm Greidanus European Commission – Joint Research Centre

University of Ljubljana, Faculty of Maritime Studies and Transport, 28 Oct 2009 Contents 1. European context of maritime surveillance 2. Maritime surveillance systems 3. Satellite images • Application examples 4. Future research 2

University of Ljubljana, Faculty of Maritime Studies and Transport, 28 Oct 2009 Why maritime surveillance? • Problems • Threats • Illegal activities - Safety - Security - Compliance • Search & rescue • Maritime traffic control • Piracy • Terrorism • Fisheries control • Illegal immigration • Smuggling (narcotics) • Marine pollution (oil) • … 3

European context 4 University of Ljubljana, Faculty of Maritime Studies and Transport, 28 Oct 2009 European Union (27 Member States) European Commission Agriculture Transport Fisheries R&D Industry Energy Aid … Defence JRC Police & Judicial co-oper. Research funding in Europe Joint Research Centre: • Scientific and technical support for European Union policies (conception, development, implementation and monitoring) • Reference centre of science and technology for the EU • Serves the common interest of the Member States • Independent of special interests (private or national) • 2800 Staff, 7 Institutes http: //ec. europa. eu/dgs/jrc

5 University of Ljubljana, Faculty of Maritime Studies and Transport, 28 Oct 2009 EU policies (maritime) • Marine strategy (environment) • Common Fisheries Policy • Maritime transport – VTMIS directive • Directive on ship source pollution • Border security: EUROSUR, European Border Surveillance system • Border control up to same standards • Interoperability and connections between countries • Now, focus on southern maritime borders • European Security & Defence Policy • Operation Atalanta in Gulf of Aden • … • New: Integrated Maritime Policy http: //ec. europa. eu/maritimeaffairs/policy_documents_en. html

University of Ljubljana, Faculty of Maritime Studies and Transport, 28 Oct 2009 EU policies, supporting • Space • Earth observation from space (GMES – Global Monitoring for Environment and Security) • Galileo: Navigation (European GPS) • Satellite communications (mostly commercial) • Research & Development: FP 7 • Partial (50 %) funding of R&D projects 6

University of Ljubljana, Faculty of Maritime Studies and Transport, 28 Oct 2009 Maritime surveillance systems • Reporting (cooperative) systems • Observation (non-cooperative) systems 7

University of Ljubljana, Faculty of Maritime Studies and Transport, 28 Oct 2009 Maritime surveillance systems • Reporting (cooperative) systems • • Fishing vessels – VMS Large cargo & passenger vessels – AIS and LRIT Ships in problems – GMDSS, SSAS Reporting to ports and special areas • Observation (non-cooperative) systems • • • Camera (optical, infrared) Lidar (laser-radar) Radar Radio Direction Finder Sonar, underwater acoustics 8

AIS: Automatic Identification System University of Ljubljana, Faculty of Maritime Studies and Transport, 28 Oct 2009 • Designed for maritime traffic safety (collision avoidance) • Each merchant ship carries a transponder that automatically communicates to all neighbouring ships by VHF radio link • Introduced by International Maritime Organisation (IMO) • IMO is a UN organisation • International Convention for the Safety of Life at Sea (SOLAS) • Implemented in national (and EU) legislation • ID, position, speed, heading; cargo, draught, origin, destination, … • Ships >300 GT, tankers, passenger vessels 9

AIS for vessel monitoring University of Ljubljana, Faculty of Maritime Studies and Transport, 28 Oct 2009 • AIS receiver on the coast will give local picture • Line-of-sight, i. e. out to 30 -50 nm (dept. receiver height) • Can be even further due to ducting • Many countries are installing coastal AIS network • International networks collect data from many shores 10

US / NATO’s MSSIS 11 University of Ljubljana, Faculty of Maritime Studies and Transport, 28 Oct 2009 Maritime Safety & Security Information System • Global data sharing network of government AIS systems Picture source: Office of Global Maritime Situational Awareness

Satellite AIS – Early results University of Ljubljana, Faculty of Maritime Studies and Transport, 28 Oct 2009 COMDEV / exact. Earth 12

University of Ljubljana, Faculty of Maritime Studies and Transport, 28 Oct 2009 13 LRIT: Long Range Identification and Tracking • Send vessel ID, location to Flag State • Every 6 hour (can be changed) • Globally, so by satellite communication • Cargo vessels > 300 GT, passenger • For maritime security; quickly introduced after 9/11 • IMO regulation • SOLAS • From 1 Jan 2008 • Confidential • Coastal state has access out to 1, 000 nm • In Europe, centralised by European Maritime Safety Agency (EMSA)

VMS: Vessel Monitoring System University of Ljubljana, Faculty of Maritime Studies and Transport, 28 Oct 2009 • Designed for fisheries management and control • Automatic position reports from fishing vessels, sent to Flag State’s fisheries inspection authorities (FMC, Fisheries Monitoring Centre) • Flag State forwards to Coastal State • “Blue box”, GPS receiver + communications unit • Global coverage thanks to satellite communications • Treated as confidential 14

VMS details University of Ljubljana, Faculty of Maritime Studies and Transport, 28 Oct 2009 • Started 1988 • Implementation to national law • EU (CFP; since 1996, last 2006): • All fishing vessels > 15 m • Report every 1 -2 hour • Vessel ID, position, course, speed • Satellite communication can be e. g. INMARSAT-C or ARGOS • Implemented in many countries (Russia, US, Canada, Peru, Chile, Australia, New Zealand, …) • International leading role of UN FAO 15

University of Ljubljana, Faculty of Maritime Studies and Transport, 28 Oct 2009 Maritime surveillance systems • Reporting (cooperative) systems • • Fishing vessels – VMS Large cargo & passenger vessels – AIS and LRIT Ships in problems – GMDSS, SSAS Reporting to ports and special areas • Observation (non-cooperative) systems • • • Camera (optical, infrared) Lidar (laser-radar) Radar Radio Direction Finder Sonar, underwater acoustics 16

17 University of Ljubljana, Faculty of Maritime Studies and Transport, 28 Oct 2009 Satellite remote sensing Polar orbit • Basis for VDS (Vessel Detection System) • Images from satellite • Will show vessels on the sea • One snapshot as the satellite passes; no continuous monitoring • Typically, 1 image every few days Polar orbit (Equatorial orbit) 36, 000 km 400 -800 km

Radar and optical images 18 University of Ljubljana, Faculty of Maritime Studies and Transport, 28 Oct 2009 Radar satellite images • Low resolution (8 -50 m) • Wide area (up to 400 km) • Indept. clouds, night • Use for detection Pre fer Line of fishing vessels in NE Atlantic RADARSAT satellite Optical satellite images • High resolution (<1 -10 m) • Small area (10 -60 km) • Daytime, clear skies • Use for recognition red Cargo ships in Istanbul IKONOS satellite

University of Ljubljana, Faculty of Maritime Studies and Transport, 28 Oct 2009 19 SPOT-5 10 m color Optical satellite images SPOT-5 10 m multispectral SPOT footprint, 60 x 60 km

University of Ljubljana, Faculty of Maritime Studies and Transport, 28 Oct 2009 20 SPOT-5 10 m color Optical satellite images SPOT-5 2. 5 m b/w

Optical satellite images 21 University of Ljubljana, Faculty of Maritime Studies and Transport, 28 Oct 2009 Sub-meter resolution, ~15 km swath EROS 1. 8 m b/w Quick. Bird Tuna cages

Synthetic Aperture Radar (SAR) University of Ljubljana, Faculty of Maritime Studies and Transport, 28 Oct 2009 • Radar, suitable for use on satellite • Wide area, low resolution • Narrow area, high resolution • High resolution (<10 m) only when sea is calm 22

23 University of Ljubljana, Faculty of Maritime Studies and Transport, 28 Oct 2009 Satellite radar image – Wide 50 -150 m resolution 300 -400 km swath ENVISAT-ASAR © ESA only to show relative size, not actual zoom

24 University of Ljubljana, Faculty of Maritime Studies and Transport, 28 Oct 2009 Satellite radar image – Standard 25 m resolution 100 km swath ENVISAT-ASAR © ESA RADARSAT © CSA/MDA

25 University of Ljubljana, Faculty of Maritime Studies and Transport, 28 Oct 2009 Satellite radar image – High resolution 10 m resolution 50 km swath RADARSAT © CSA/MDA

26 University of Ljubljana, Faculty of Maritime Studies and Transport, 28 Oct 2009 Ships in 100 x 100 km SAR images (25 m resolution) 20 m fishing boat 26 m fishing boat 33 m fishing boat

EADS Astrium, JRC, EUSC, SPOT Image, Nev@ntropic 27 University of Ljubljana, Faculty of Maritime Studies and Transport, 28 Oct 2009 Terra. SAR-X Scansar 15 m resolution Caribbean, June 2008 230 m Terra. SAR-X Stripmap 3 m resolution Caribbean, June 2008 160 m Merchant Vessel

SAR – High resolution in narrow swaths Sailing boat University of Ljubljana, Faculty of Maritime Studies and Transport, 28 Oct 2009 Fishing vessel 28 18 m RADARSAT © CSA/MDA 2009 5 -12 m Radarsat-2 Ultra. Fine HH Jan 2009 Terra. SAR-X Spotlight 1. 5 m resolution Caribbean, June 2008 Terra. SAR-X © Infoterra 2008

Sea surface backscatter 29 University of Ljubljana, Faculty of Maritime Studies and Transport, 28 Oct 2009 • Backscatter when surface roughness has wavelength of the same order as radar wavelength (5 cm) • Backscatter proportional to roughness amplitude • “Bragg backscattering” Wind Surface roughness Radar backscatter

Oil spills and slicks 30 University of Ljubljana, Faculty of Maritime Studies and Transport, 28 Oct 2009 Natural slicks ERS-1 Envisat Wide Swath VV 16 Sept 2003 20: 03 UTC Radarsat-1 Scan. SAR Narrow A 17 Sept 2003 16: 13 UTC

Ocean features 31 University of Ljubljana, Faculty of Maritime Studies and Transport, 28 Oct 2009 Tidal area Wind front Internal waves Ocean waves Wind effect

Ocean features 32 University of Ljubljana, Faculty of Maritime Studies and Transport, 28 Oct 2009 Sea bottom topography North Sea Rhine outflow ERS image Heavy rain cells Baltic Sea RADARSAT Std River outflow fronts

Backscatter by vessels 33 University of Ljubljana, Faculty of Maritime Studies and Transport, 28 Oct 2009 • Direct reflections from objects • Reflections from sea surface • Indirect effects Direct Sea Indirect

Ship wakes 34 University of Ljubljana, Faculty of Maritime Studies and Transport, 28 Oct 2009 Wave and current pattern set up by passing ship Types of wakes • Kelvin • Turbulent • Narrow-V • Internal wave Image from C. V. Swanson Current 3 D Surface current Surface roughness contrasts Wind Surface roughness Radar image contrasts

Ship wakes (II) University of Ljubljana, Faculty of Maritime Studies and Transport, 28 Oct 2009 35 Optical: SPOT Radar: ERS-2 Corsica

Ship traffic survey 36 University of Ljubljana, Faculty of Maritime Studies and Transport, 28 Oct 2009 97 18 43 85

Traffic routes University of Ljubljana, Faculty of Maritime Studies and Transport, 28 Oct 2009 37

Pompei, April 2009 Use of Satellite AIS

39 University of Ljubljana, Faculty of Maritime Studies and Transport, 28 Oct 2009 MSSIS S 07° 04’ 20”, E 39° 42’ 53” 12 Aug 2009, 02: 53 UT Radarsat-2 SCN © MDA/CSA 2009 • Tracking the “Jolly Verde”: Genova – Horn of Africa – South Africa and back • Coastal AIS, Satellite AIS, Ship-logged AIS, Satellite SAR D’Appolonia, JRC, EADS Astrium, Telespazio, KSAT, EUSC

Vessel Detection System (VDS) 40 University of Ljubljana, Faculty of Maritime Studies and Transport, 28 Oct 2009 Downlink Acquisition Ship detection Processing FTP to JRC Correlate with VMS, AIS and surveillance reports VMS AIS Suspect positions to authorities Total: 30 min

Example: 25 July 2008 41 University of Ljubljana, Faculty of Maritime Studies and Transport, 28 Oct 2009 Two Radarsat Standard images Mediterranean Visualise results in Google Earth • 57 VDS (satellite targets) • Strong signatures • Others • Correlations with VMS & AIS data Used as pilot in Mediterranean • AIS data tuna fishing control campaigns • 2 cargo vessels • all correlated to direct Member State patrol vessels • VMS data • 9 Fishing vessels out of port • 8 correlated • 1 uncorrelated • 20 additional VDS reported to surveillance means as “suspected targets” possible illegal fishing (to check)

INTEGRATION Sat image, AIS shipping, HF currents and Wind Stress on top Navigational chart ISRSE-33 – Stresa, 07. 05. 2009 42 INGV – NASCUM project on HF currents ESA - ENVISAT/MERIS PISCES 2 - Transas Technology

Backtracking the polluter - animation ISRSE-33 – Stresa, 07. 05. 2009 43 M. Perkovic et al. , ISRSE 33, 4 -8 May 2009

University of Ljubljana, Faculty of Maritime Studies and Transport, 28 Oct 2009 Way ahead – research needed • Improvement of sensors • Detecting small boats over wide areas • More flexible / cheaper platforms • Unmanned Aerial Vehicles (UAV), balloons, … • Better processing • Automatic flagging of anomalies • Further integration of data • From different sensors • By different users 44

45 University of Ljubljana, Faculty of Maritime Studies and Transport, 28 Oct 2009 The end Harm. Greidanus @ jrc. europa. eu EC Joint Research Centre TP 670 21020 Ispra (VA), Italy T +39 -0332 -78 9739 http: //ipsc. jrc. europa. eu http: //maritimeaffairs. jrc. europa. eu