Imageprocessing Technologies for Digital Content Creation Luc robertautodesk
Image-processing Technologies for Digital Content Creation Luc. robert@autodesk. com © 2006 Autodesk 1
CORPORATE INFORMATION REALVIZ: Founded March 98 Exclusive technology from INRIA Sophia-Antipolis § Technology from the Robotvis group Headquarters and R&D in Sophia Antipolis, Southern France 90% of revenue outside France, 50% in the USA Just acquired by Autodesk (PSEB division) © 2006 Autodesk 2
MISSION Image-based technologies empower designers and graphic artists to efficiently create the most effective visual content based on digital photographs and videos. Post-production Multimedia Digital Imaging Architecture CAD Video Games Dinotopia - Courtesy of Framestore CFC Monkey – Courtesy of Quiet Man © 2006 Autodesk 3
USE CASES Panoramic Photography Image Based Modeling SFX Solutions Motion Capture © 2006 Autodesk 4
PANORAMIC PHOTOGRAPHY Panoramic Photography © 2006 Autodesk 5
IMAGE STITCHING Creation of panoramic images up to full spheres (360° horizontal by 180° vertical) – fully automatic Thousands users : professional photographers, digital imaging hobbyists, multimedia & web designers, architects, post-production artists © 2006 Autodesk 6
FULL SPHERICAL PANORAMAS Click inside to see the full screen, full spherical Quick. Time VR Panorama Courtesy of VR Way © 2006 Autodesk 7
USE CASES Panoramic Photography Image Based Modeling SFX Solutions Motion Capture © 2006 Autodesk 8
IMAGE BASED MODELING Bridging the gap between 2 D and 3 D Image Based Modeling © 2006 Autodesk 9
IMAGE BASED MODELING Creation of 3 D photo-textured objects from photographs (1 to many) Applications § § § © 2006 Autodesk Virtual reality: 3 D Simulation/Storytelling Urban planning & perspective matching for 3 D CAD models Photogrammetry Video games 3 D animation & special effects 10
IMAGE BASED MODELING … for photo-realistic 3 D models ! From stills… … calibrated in 3 D from the manual placement of matching points … © 2006 Autodesk 11
IMAGE BASED MODELING … to a photo-realistic 3 D environment ! From a panorarma or a still picture… … more demos © 2006 Autodesk 12
USE CASES Panoramic Photography Image Based Modeling SFX Solutions Motion Capture © 2006 Autodesk 13
SPECIAL EFFECTS SFX Solutions © 2006 Autodesk 14
CAMERA TRACKING Before… Click inside to see the movie. … After Camera path & 3 D points extracted with Match. Mover 3 D content Rendered in 3 D animation software Click inside to see the movie. Courtesy of Platige Image 2005 © 2006 Autodesk Click inside to see the movie. Courtesy of Platige Image 2005 15
CAPTURING 3 D RIGID MOTION - Feature points are extracted and tracked across sequences - Based on parallax and rigidity (epipolar geometry), the algorithm extracts: - Camera path and parameters (zoom, distortion) over time - 3 D point coordinates - Ready for 2 D/3 D video-montage… all in one click! © 2006 Autodesk 16
SOME MOVIES © 2006 Autodesk 17
USE CASES Panoramic Photography Image Based Modeling SFX Solutions Motion Capture © 2006 Autodesk 18
MOTION CAPTURE Motion Capture © 2006 Autodesk 19
VIDEO-BASED MOCAP Capture non-rigid 3 D motion from several videos © 2006 Autodesk 20
VIDEO-BASED MOCAP Video-based motion capture solution Applications: animation, bio-medical, ergonomy…etc Covering facial, full body, and on-set mocap Total flexibility § From 2 cameras to as many as needed § Cameras can fixed or moving. § Cameras can be of different frame rate and different definitions. § No need for a motion capture studio Computed data © 2006 Autodesk § Tracked 3 D points § Camera data 21
VIDEO-BASED MOCAP © 2006 Autodesk 22
MATCHMOVING FROM RIGID MOTION… One moving camera observing a rigid scene : Parallax (i. e relative 2 D image motion) allows recovering 3 D camera motion and scene structure N 1. . t. . © 2006 Autodesk 23
… TO NON-RIGID MOTION - Several synchronous cameras are used - Same geometric problem as matchmoving at each time Time 1 Cam 3 Cam 2 Time N Cam 1 Cam 3 Cam 2 - Bonus: We can handle camera motion as well! © 2006 Autodesk 24
VIDEO-BASED MOCAP …Result © 2006 Autodesk 25
ON-SET MOCAP -All sequences shot with -- 2 fixed cameras: HD digital (1920 x 1080) - 1 mobile camera (the main shooting cam): film, scanned at 2048 x 1536 …Result © 2006 Autodesk 26
Q&A © 2006 Autodesk 27
- Slides: 27