UAV CINEMATOGRAPHY CONSTRAINTS IMPOSED BY VISUAL TARGET TRACKING
UAV CINEMATOGRAPHY CONSTRAINTS IMPOSED BY VISUAL TARGET TRACKING Iason Karakostas, Ioannis Mademlis, Nikos Nikolaidis, Ioannis Pitas Dpt. Artificial Intelligence and Information Analysis Computer Science Aristotle University of Thessaloniki Greece This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731667 (MULTIDRONE)
UAV in Cinematography • UAVs have revolutionized aerial cinematography • Can replace helicopters, cranes, etc. • UAVs support autonomous functionalities based on machine learning and computer vision • Autonomous UAVs may visually track and actively follow a specific target of interest • We present common UAV target-tracking trajectories and shot types • We study the constraints in maximum focal length for successful target tracking 10/9/2020 This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731667 (MULTIDRONE) 2
UAV in Cinematography • We standardized and geometrically modeled a number of common, target-following UAV motion types • We identified the compatible shot types • We analytically determined the maximal permissible camera focal length, so that 2 D visual tracking does not get lost, for each UAV motion type. 10/9/2020 This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731667 (MULTIDRONE) 3
UAV/Camera Shot Types • The desired shot type is defined by the percentage of the video frame that is covered by the target Region Of Interest (ROI) 10/9/2020 Shot Type Percentage of ROI Extreme Long Shot (ELS) <5% Very Long Shot (VLS) 5 % – 20 % Long Shot (LS) 20 % – 40 % Medium Shot (MS) 40 % – 60 % Medium Close-Up (MCU) 60 % - 75 % Close-Up (CU) > 75 % This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731667 (MULTIDRONE) 4
UAV/Camera Motion Types • 5 UAV industry- standard camera motion types are detailed and geometrically modeled • • • 10/9/2020 Lateral Tracking Shot (LTS) Vertical Tracking Shot (VTS) Fly-Over (FLYOVER) Fly-By (FLYBY) Chase/Follow Shot (CHASE) This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731667 (MULTIDRONE) 5
UAV/Camera Motion Types VTS LTS FLYOVER 10/9/2020 FLYBY This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731667 (MULTIDRONE) CHASE 6
Constraints On Maximum Focal Length • 10/9/2020 This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731667 (MULTIDRONE) 7
Constraints On Maximum Focal Length • 10/9/2020 This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731667 (MULTIDRONE) 8
Constraints On Maximum Focal Length • 10/9/2020 This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731667 (MULTIDRONE) 9
Constraints On Maximum Focal Length • 10/9/2020 This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731667 (MULTIDRONE) 10
Constraints On Maximum Focal Length • 10/9/2020 This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731667 (MULTIDRONE) 11
Constraints On Maximum Focal Length • 10/9/2020 This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731667 (MULTIDRONE) 12
Constraints On Maximum Focal Length • 10/9/2020 This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731667 (MULTIDRONE) 13
Constraints On Maximum Focal Length • 10/9/2020 This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731667 (MULTIDRONE) 14
Constraints On Maximum Focal Length 10/9/2020 This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731667 (MULTIDRONE) 15
Constraints On Maximum Focal Length • 10/9/2020 This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731667 (MULTIDRONE) 16
Constraints On Maximum Focal Length FLYOVER 10/9/2020 CHASE This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731667 (MULTIDRONE) VTS 17
Conclusions • Industry-standard target-tracking UAV/camera motion types have been formalized and geometrically modelled • Maximum focal length constraints for computer vision-assisted UAV physical target following have been extracted • The derived formulas can be readily employed as low-level rules in intelligent UAV shooting and cinematography planning systems 10/9/2020 This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731667 (MULTIDRONE) 18
Acknowledgement • The research leading to these results has received funding from the European Union’s European Union Horizon 2020 research and innovation programme under grant agreement No 731667 (MULTIDRONE). 10/9/2020 This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731667 (MULTIDRONE) 19
Thank you! Q&A This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731667 (MULTIDRONE)
- Slides: 20