OptimizationLearning on the GPU supplement figure slides CIS

  • Slides: 20
Download presentation
Optimization/Learning on the GPU (supplement figure slides) CIS 665 Joe Kider

Optimization/Learning on the GPU (supplement figure slides) CIS 665 Joe Kider

Pictures/Slides thanks to… • Jonathan Shewchuk • Nico Galoppo • Jeff Bolz • (Most

Pictures/Slides thanks to… • Jonathan Shewchuk • Nico Galoppo • Jeff Bolz • (Most of this was a blackboard lecture, these slides supplement that, since drawing the graphs of quadratic forms can be difficult. For the most part the lecture came from the following 3 sources: – Jonathan Richard Shewchuk, An Introduction to the Conjugate Gradient Method Without the Agonizing Pain – Nico Galoppo et Al. , LU-GPU: Efficient Algorithms for Solving Dense Linear Systems on Graphics Hardware – Bolz et Al. , Sparse Matrix Solvers on the GPU: Conjugate Gradients and Multigrid

Gauss-Jordon

Gauss-Jordon

Graph of a quadratic form f(x) The minimum point of this surface is the

Graph of a quadratic form f(x) The minimum point of this surface is the solution to Ax=b

Contours of the quadratic form

Contours of the quadratic form

Gradient f’(x) of the quadric form

Gradient f’(x) of the quadric form

Gradient Descent

Gradient Descent

Problem graphs

Problem graphs

Method of Orthogonal Directions

Method of Orthogonal Directions

Conjugate Directions

Conjugate Directions

Gram-Schmidt Conjugation

Gram-Schmidt Conjugation

Conjugate Directions Conjugate directions using the Axial unit vectors, also know As Gaussian Elimination

Conjugate Directions Conjugate directions using the Axial unit vectors, also know As Gaussian Elimination

Conjugate Gradients

Conjugate Gradients

Conjugate Gradients

Conjugate Gradients

Conjugate Gradients

Conjugate Gradients

Conjugate Gradients on the GPU

Conjugate Gradients on the GPU

Conjugate Gradients on the GPU

Conjugate Gradients on the GPU

Example Applications • Just a few uses: – GPU sim demo – Heart wave

Example Applications • Just a few uses: – GPU sim demo – Heart wave demo – Flesh Simulation – Water Simulation