Interactive Inverse 3 D Modeling James Andrews Hailin
- Slides: 49
Interactive Inverse 3 D Modeling James Andrews Hailin Jin Carlo Séquin
Inspiration One object generative concept Parameterized sculpture generator
Interactive Inverse 3 D Modeling Goal: Let users impose any high level structure on model, to immediately use for redesign. Initial artifact Redesigns enabled by different imposed structure
Editing Rotational Symmetry 3 fold 4 fold 20 fold Extract one sector; collapse/expand in polar coordinates.
Editing as Surface of Revolution
Sweep
Our goals: 1. User-guided reverse engineering for broad applications - Including mechanical parts, household appliances, and freeform artistic shapes. 2. User imposes high-level structure on representation - Not error focused; user can impose conceptual model with desired degrees of freedom and parameters. 3. Fast data fitting + shape editing in same tool - Enable immediate, interactive re-design. 4. Freely allow interactive model re-interpretation - As re-design goals change, best structure changes
Related work: Reverse Engineering Obtaining a robust and versatile CAD model from a physical artifact or from images. Typically focus on a single best / versatile reconstruction
Related Work: Optimize to find high level parameters for re-design “Creating Generative Models from Range Images” Ravi Ramamoorthi and James Arvo
Pipeline Nice rendering Unstructured mesh Photos Userguided fitting modules Editable Model OBJ for CAD 3 D scans Input Data Clean STL for RP Model Hierarchy & Re-fitting Redesigned output
Input Sources • 3 D meshes • 3 D Point clouds from scanner • Photographs
User-Guided Fitting Modules • Stationary sweeps: (Surfaces of revolution, helices, etc) • Progressive sweeps: • Quadrics: • Freeform surfaces:
Stationary Sweeps Defined by a simple sweep motion (eg. Revolution, Helix, Spiral) (simple motion) (simple velocity field) If normal perp. to velocity field: … then assume point is from sweep.
Algorithm: 1. Find velocity field that fits marked data points: Minimize (subject to constraint): [Pottmann, Lee, and Randrup, 98] 2. Grow region to add more points 3. Repeat (typically converges in 2 -3 iterations)
Interactive Surface Editing • No explicit sweep profile curve is needed! Rotate all mesh vertices to a shared plane • Can just grab all surface mesh points that fall into selected (pink) region.
• [Video demo of stationary sweep edits]
Progressive Sweeps • More parameters: incremental local adjustments • Allow more complex cross-section moves (translation, rotation, scaling) • User stroke provides initial guess • Fit by iteratively extending and optimizing
Progressive Fitting 1. Starting from user stroke, optimize cross section 2. Iteratively extend and re-optimize 3. Stop when best further extension would have high error [Andrews, Joshi, Sequin 2011]
Diverse Sweeps from User Strokes
Progressive Sweep Edits • Changing the (red) cross section… …globally (shape) - or locally (scale)
Progressive Sweep Edits • Modifying the sweep path & scaling, • while preserving surface details:
• [Video demo of progressive sweep edits]
Quadric Fitting Spheres, Ellipsoids, Paraboloids, etc - Use same region-growing strategy as stationary sweeps - Using Taubin’s method to fit
Taubin’s method: minimize algebraic distance with gradient normalized to an average squared value of 1. A small generalized Eigenvalue problem. [Taubin, 91]
• [Video demo of quadric fitting]
Freeform Surfaces Workhorse to handle “everything else” - For meshes, use Laplacian surface editing
Laplacian surface editing (A standard large, symmetric linear least squares problem) = Smooth surface = Detail preserving Smooth/preserve Laplacian Approx. interpolate control points tc (solve w/ cholmod) [Sorkine et al. 2004]
• [Video demo of Laplacian surface edits]
Pipeline Nice rendering Unstructured mesh Photos Userguided fitting modules Editable Model OBJ for CAD 3 D scans Input Data Clean STL for RP Model Hierarchy & Re-fitting Redesigned output
Cleanup Self-intersection
Hierarchical Fitting 1 2 3 1. Sweep is fit to sculpture, 2. Quadric is fit to the points of a sweep path, 3. Sweep path is projected to quadric during editing.
Model Re-Fitting Ellipse crosssection; scaled by profile curve Revolve around major axis Quadric Surface of Revolution (revolution may be elliptical!) Sweep
Future Work
Acknowledgements This work was supported in part by the National Science Foundation (NSF award #CMMI-1029662 (EDI)) and by Adobe Systems. Thanks to: The Image-based 3 D Models Archive, Tlcom Paris, and to the Stanford Computer Graphics Laboratory for some of the test data used.
Slide graveyard
Reverse Engineering Obtaining a robust and versatile CAD model from a physical artifact or from images. (Canonical related work image(s) go here. ) Typically focus on a single best / versatile reconstruction
Image-based modeling
Spectrum of Methods Fully Automatic Fully Manual Reference views + CAD tools Curve tracing Single view annotation Visual hulls Multi-view stereo
Spectrum of Methods Fully Manual Fully Automatic Lots of work! Assumptions about shape or data
Spectrum of Methods Fully Manual Fully Automatic Another of these for reverse engineering methods? (what is the questionable issue? ) We want a structured model
Our goals: 1. Fast, user-guided reverse engineering 2. Integrated with modeling, for redesign
Maintaining continuity during editing: - Handle moves as a freeform surface by maintaining Laplacians.
Related Work: Preserve structure as well as detail during mesh edits i. Wires R. Gal, O. Sorkine, N. J. Mitra, D. Cohen-Or
Optimization Framework • Levenberg-Marquardt: • Minimize this: • +regularization:
Regularization Terms • +regularization: • Take big steps • Slowly-changing params • Low-wiggle sweep path
Performance (Timings) < 10 sec for all fits For stationary: speed ~ # tris (tested up to 163 k tris) For progressive: speed ~ # segs, “difficulty” of fit For quadrics: For freeform:
Model Re-Fitting Starting artifact Beautify with quadric fit Edit profile as surface of revolution Edit path as progressive sweep Multiple interpretations are useful
Related work: Artist-guided reverse engineering [Maybe skip this one] “Fitting Smooth Surfaces to Dense Polygon Meshes” Venkat Krishnamurthy, Marc Levoy
Fitting algorithm (due to: “Pottmann, Lee, and Randrup: Reconstruction of kinematic surface from scattered data. ”) Captures: Rotations Straight Line Extrusions Helical/screw Motions Cones (& more) 7 parameter velocity field:
- Role modeling theory
- Dimensional modeling vs relational modeling
- The trailside killer
- Russell odom and clay lawson
- Stance markers
- Simon andrews reading
- Rikki andrews
- Llave 5 de andrews
- St andrews st brides
- Simon andrews christies
- Donald cullivan
- Richard davidson andrews university
- Esperanza rising final project
- St andrews sustainable development
- Mathew duncan method of placental separation
- Ipseq
- Simon andrews babraham
- Saint andrews criss
- Chris andrews northwestern mutual
- St andrews thesis repository
- Dr sarah andrews
- Simone andrews cp
- Pinza tenaculo de lahey
- Simon andrews babraham
- Jorella andrews
- St andrews and st brides high school
- Modified brandt andrews method
- St andrews decisions
- Izotermele
- St andrews student union
- Oxitocina sublingual
- Kacky andrews
- Dr scott andrews
- Simon andrews reading
- Manobra de hamilton
- Simon andrews ing
- Cameron house st andrews
- Chris andrews northwestern mutual
- Edna andrews school hamilton nc
- Casey andrews
- Mrs slipslop in joseph andrews
- Sits interaktiv
- Discuss joseph andrews as “the comic epic in prose”.
- Kasey andrews
- Aka graduate information session
- Tommie lee andrews
- Principles of interactive language teaching
- What is interactive system design
- Cs 418 interactive computer graphics
- Avid interactive notebook