Imageprocessing Technologies for Digital Content Creation Luc robertautodesk

CORPORATE INFORMATION REALVIZ: Founded March 98 Exclusive technology from INRIA Sophia-Antipolis § Technology from the Robotvis group Headquarters and R&D in Sophia Antipolis, Southern France 90% of revenue outside France, 50% in the USA Just acquired by Autodesk (PSEB division) © 2006 Autodesk 2

MISSION Image-based technologies empower designers and graphic artists to efficiently create the most effective visual content based on digital photographs and videos. Post-production Multimedia Digital Imaging Architecture CAD Video Games Dinotopia - Courtesy of Framestore CFC Monkey – Courtesy of Quiet Man © 2006 Autodesk 3

USE CASES Panoramic Photography Image Based Modeling SFX Solutions Motion Capture © 2006 Autodesk

PANORAMIC PHOTOGRAPHY Panoramic Photography © 2006 Autodesk 5

IMAGE STITCHING Creation of panoramic images up to full spheres (360° horizontal by 180° vertical) – fully automatic Thousands users : professional photographers, digital imaging hobbyists, multimedia & web designers, architects, post-production artists © 2006 Autodesk 6

FULL SPHERICAL PANORAMAS Click inside to see the full screen, full spherical Quick. Time

IMAGE BASED MODELING Bridging the gap between 2 D and 3 D Image Based

IMAGE BASED MODELING Creation of 3 D photo-textured objects from photographs (1 to many) Applications § § § © 2006 Autodesk Virtual reality: 3 D Simulation/Storytelling Urban planning & perspective matching for 3 D CAD models Photogrammetry Video games 3 D animation & special effects 10

IMAGE BASED MODELING … for photo-realistic 3 D models ! From stills… … calibrated

IMAGE BASED MODELING … to a photo-realistic 3 D environment ! From a panorarma

SPECIAL EFFECTS SFX Solutions © 2006 Autodesk 14

CAMERA TRACKING Before… Click inside to see the movie. … After Camera path & 3 D points extracted with Match. Mover 3 D content Rendered in 3 D animation software Click inside to see the movie. Courtesy of Platige Image 2005 © 2006 Autodesk Click inside to see the movie. Courtesy of Platige Image 2005 15

CAPTURING 3 D RIGID MOTION - Feature points are extracted and tracked across sequences - Based on parallax and rigidity (epipolar geometry), the algorithm extracts: - Camera path and parameters (zoom, distortion) over time - 3 D point coordinates - Ready for 2 D/3 D video-montage… all in one click! © 2006 Autodesk 16

MOTION CAPTURE Motion Capture © 2006 Autodesk 19

VIDEO-BASED MOCAP Capture non-rigid 3 D motion from several videos © 2006 Autodesk 20

VIDEO-BASED MOCAP Video-based motion capture solution Applications: animation, bio-medical, ergonomy…etc Covering facial, full body, and on-set mocap Total flexibility § From 2 cameras to as many as needed § Cameras can fixed or moving. § Cameras can be of different frame rate and different definitions. § No need for a motion capture studio Computed data © 2006 Autodesk § Tracked 3 D points § Camera data 21

MATCHMOVING FROM RIGID MOTION… One moving camera observing a rigid scene : Parallax (i. e relative 2 D image motion) allows recovering 3 D camera motion and scene structure N 1. . t. . © 2006 Autodesk 23

… TO NON-RIGID MOTION - Several synchronous cameras are used - Same geometric problem as matchmoving at each time Time 1 Cam 3 Cam 2 Time N Cam 1 Cam 3 Cam 2 - Bonus: We can handle camera motion as well! © 2006 Autodesk 24