MATH 685 CSI 700 OR 682 Lecture Notes
- Slides: 78
MATH 685/ CSI 700/ OR 682 Lecture Notes Lecture 6. Eigenvalue problems.
Eigenvalue problems l Eigenvalue problems occur in many areas of science and engineering, such as structural analysis l Eigenvalues are also important in analyzing numerical methods l Theory and algorithms apply to complex matrices as well as real matrices l With complex matrices, we use conjugate transpose, AH, instead of usual transpose, AT
Formulation Matrix expands or shrinks any vector lying in direction of eigenvector by scalar factor Expansion or contraction factor is given by corresponding eigenvalue Eigenvalues and eigenvectors decompose complicated behavior of general linear transformation into simpler actions
Examples
Characteristic polynomial
Example
Companion matrix
Characteristic polynomial l Computing eigenvalues using characteristic polynomial is not recommended because of l l work in computing coefficients of characteristic polynomial sensitivity of coefficients of characteristic polynomial work in solving for roots of characteristic polynomial Characteristic polynomial is powerful theoretical tool but usually not useful computationally
Example
Diagonalizability
Eigenspaces
Some relevant definitions
Examples
Examples
Properties of eigenvalue problems l Properties of eigenvalue problem affecting choice of algorithm and software l l l l Are all eigenvalues needed, or only a few? Are only eigenvalues needed, or are corresponding eigenvectors also needed? Is matrix real or complex? Is matrix relatively small and dense, or large and sparse? Does matrix have any special properties, such as symmetry, or is it general matrix? Condition of eigenvalue problem is sensitivity of eigenvalues and eigenvectors to changes in matrix Conditioning of eigenvalue problem is not same as conditioning of solution to linear system for same matrix Different eigenvalues and eigenvectors are not necessarily equally sensitive to perturbations in matrix
Conditioning of eigenvalues
Conditioning of eigenvalues
Problem transformations
Similarity transformation
Similarity transformation
Diagonal form l Eigenvalues of diagonal matrix are diagonal entries, and eigenvectors are columns of identity matrix l Diagonal form is desirable in simplifying eigenvalue problems for general matrices by similarity transformations l But not all matrices are diagonalizable by similarity transformation l Closest one can get, in general, is Jordan form, which is nearly diagonal but may have some nonzero entries on first superdiagonal, corresponding to one or more multiple eigenvalues
Triangular form
Block triangular form
Forms attainable by similarity
Power iteration
Convergence of Power iteration
Example
Limitations
Normalized Power iteration
Example
Geometric interpretation
Power Iteration with Shift In earlier example, for instance, if we pick shift of σ = 1, (which is equal to other eigenvalue) then ratio becomes zero and method converges in one iteration In general, we would not be able to make such fortuitous choice, but shifts can still be extremely useful in some contexts, as we will see later
Inverse iteration converges to eigenvector corresponding to smallest eigenvalue of A. Eigenvalue obtained is dominant eigenvalue of A− 1, and hence its reciprocal is smallest eigenvalue of A in modulus
Example
Shifted inverse iteration
Rayleigh Quotient
Example
Rayleigh Quotient iteration
Rayleigh Quotient iteration
Deflation
Deflation
Deflation
Simultaneous Iteration
Orthogonal iteration
QR iteration
QR iteration
Example
QR iteration with shifts
Example
Preliminary reduction
Preliminary reduction
Preliminary reduction
Cost of QR iteration
Krylov subspaces methods
Krylov subspaces methods
Arnoldi iteration
Arnoldi iteration
Arnoldi iteration
Lanczos Iteration
Lanczos iteration
Lanczos iteration
Krylov subspace methods cont.
Example of Lanczos iteration
Jacobi method
Jacobi method
Plane rotation
Jacobi method cont.
Jacobi method cont.
Jacobi method example
Process continues until off-diagonal entries reduced to as small as desired Result is diagonal matrix orthogonally similar to original matrix, with the orthogonal similarity transformation given by product of plane rotations
Other methods (spectrum-slicing)
Sturm sequence
Divide-and-conquer algorithm
Relatively robust representation
Generalized eigenvalue problems
QZ algorithm
Computing SVD
- Api 682 mechanical seal data sheet excel
- 01:640:244 lecture notes - lecture 15: plat, idah, farad
- 1000-685
- 8476851447
- Mth 685
- Cs 685
- Cs 685
- Training data
- Mth 685
- Mth 685
- Cs 685
- Cs 685
- Cs 685
- Cs 685
- Cs 685
- Acuerdo 648
- Project procurement management lecture notes
- Theology proper lecture notes
- Advantages of government accounting
- Software project management handwritten notes
- Electricity and magnetism lecture notes
- Classical mechanics
- Physical science lecture notes
- Power system dynamics and stability lecture notes
- Microbial physiology and metabolism lecture notes
- Sensors and actuators ppt
- Limits fits and tolerances
- Financial engineering lecture notes
- Bjt lecture notes
- Software engineering lecture notes
- Ofdm lecture notes
- Land use planning lecture notes
- Project management lecture notes doc
- Lecture notes on homiletics
- Foundation engineering lecture notes
- Image processing lecture notes
- Intermediate microeconomics lecture notes
- Cloud computing lecture
- Decision theory lecture notes
- Nonlinear regression lecture notes
- Advanced inorganic chemistry lecture notes
- 50h8 tolerance
- Stiffness matrix method lecture notes
- Flood routing
- Stat root word
- Shape memory alloys lecture notes
- Research methods notes kenya
- Financial markets and institutions - ppt
- What is a harmonic wave in physics
- Om306
- Natural language processing lecture notes
- Linux lecture notes
- Helminthology notes
- Introduction to biochemistry lecture notes
- Stern-gerlach experiment lecture notes
- Land economics lecture notes
- Exploratory data analysis lecture notes
- Slidetodoc. com
- Interior design lecture notes+ppt
- Bayesian classification in data mining lecture notes
- Data mining lecture notes
- Computer architecture notes
- Franck-condon principle slideshow
- Biopotential electrodes lecture notes
- Erzeng
- Bayesian decision theory lecture notes
- Gujarati basic econometrics lecture notes ppt
- Anderson localization lecture notes
- Operating systems lecture notes
- Microwave remote sensing lecture notes
- Lecture notes tiu
- Natural language processing nlp - theory lecture
- Sensitivity analysis lecture notes
- Foetotomy
- Translation studies lecture notes
- Optical amplifiers lecture notes
- Land use planning lecture notes
- Environmental sociology examples
- Factor analysis lecture notes