SolitaryRoad.com

Website owner:  James Miller


[ Home ] [ Up ] [ Info ] [ Mail ]

Quadratic forms, Equivalence, Reduction to canonical form, Lagrange’s Reduction, Sylvester’s law of inertia, Definite and semi-definite forms, Regular quadratic form



Quadratic form. A quadratic form is a homogeneous polynomial of degree two. The following are quadratic forms in one, two and three variables:

 

F(x) = ax2

F(x,y) = ax2 + by2 + cxy  

F(x,y,z) = ax2 + by2 + cz2 + dxy + exz + fyz


The polynomial consists of squared terms for each of the variables plus cross-products terms for all combinations of the variables.


Quadratic forms occur in many branches of mathematics and its applications. They are encountered in the theory of numbers, in crystallography, in the study of surfaces in analytic geometry, and in various problems of physics and mechanics.


It is customary to represent the quadratic form as a symmetric bilinear form



           ole.gif



                                        ole1.gif ole2.gif   ole3.gif   



                                   = XTAX


where A is a symmetric matrix of the coefficients. Note that in this representation each cross-product term appears twice. For example, the x1x2 term appears as both an x1x2 term and a x2x1 term. Because we want the matrix to be symmetric we allocate half of the value of the coefficient to each term. The motivation behind representing the quadratic form in this manner is to facilitate matrix analysis and treatment.


The matrix A is called the matrix of the quadratic form and the rank of A is called the rank of the form. If the rank is less than n the quadratic form is called singular. If the rank is equal to n it is nonsingular.



Change of variables. Let us consider the effect of a change of variables on the form. Let X = BY. Then


                        XTAX = (BY)T A(BY) = YT(BTAB)Y


Thus the linear transformation X = BY carries the quadratic form XTAX with a symmetric matrix A into the quadratic form YT(BTAB)Y with symmetric matrix BTAB. Matrix B may be either singular or nonsingular. If B is nonsingular matrix A is congruent to matrix BTAB.



Equivalence of quadratic forms. Two quadratic forms are said to be equivalent over a field F if and only if there exists a nonsingular linear transformation X = BY that carries one of the forms into the other.


Two quadratic forms over a field F are equivalent over F if and only if their matrices are congruent over F.




Reduction to canonical form.


Any quadratic form over a field F of rank r can be reduced to the form  


(1)                                ole4.gif


by a non-singular linear transformation X = BY.





Connection to quadric surfaces of solid analytic geometry. Let XTAX be the quadratic form associated with some quadric surface in three-dimensional space. Let us say it is some ellipsoid. in 3-space. Let Y = PX represent that change of variables that reduces the quadratic form to


                                     ole5.gif


where P is orthogonal. Then this change of variables Y = BX represents that change of basis that reduces the expression of the quadric surface to its canonical form. The numbers k1, k2, .... ,kr are the eigenvalues of A. The eigenvectors of matrix A correspond to directions of the principal axes of the quadric surface.




Lagrange’s Reduction. The reduction of a quadratic form to the form (1) above can be carried out by a procedure known as Lagrange’s Reduction, which consists essentially of repeated completing of the square. 


Example.

  ole6.gif                                                                          

      ole7.gif  

      ole8.gif

      ole9.gif

      ole10.gif

      ole11.gif  

 

Inspection of this last expression for q shows those substitutions that will reduce q to the canonical form of (1) above.


Let 

             ole12.gif


Substituting y1, y2 and y3 into the last expression for q gives


    ole13.gif


which is of the canonical form (1) above where q is expressed in terms of the new variables y1, y2 and y3.

 





Real quadratic forms.


Theorem. Any quadratic form over the field of real numbers can be reduced by a non-singular linear transformation to the canonical form


 (2) ole14.gif


where the number p of positive terms is called the index and r is the rank of the quadratic form. The number of positive terms minus the number of negative terms, p - (r - p), is called the signature of the quadratic form.


Index and signature of symmetric and Hermitian matrices. The index of a symmetric or of a Hermitian matrix is the number of positive elements when it is transformed to diagonal form. The number of positive elements minus the number of negative elements is the signature and the total number of nonzero elements is the rank.


Sylvester’s law of inertia. Let a real quadratic form be reduced by two different real non-singular transformations to canonical forms of type (2). Then the two canonical forms to which it is reduced have the same rank and the same index.


Thus the number p of positive terms which appear in the reduced form (2) is an invariant of the given form, in the sense that p depends only on the form and not on the method used to reduce it. In other words, two quadratic forms (or two symmetric or Hermitian matrices) have the same rank and the same index if and only if they are congruent, i.e. if one can be transformed into the other by an invertible linear transformation.


Two real quadratic forms each in n variables are equivalent over the real field if and only if they have the same rank and the same index or the same rank and the same signature.



 



Complex quadratic forms.


Every quadratic form over the complex field of rank r can be reduced by a nonsingular transformation over the complex field to the canonical form


              ole15.gif



Two complex quadratic forms each in n variables are equivalent over the complex field if and only if they have the same rank.



 



Definite and semi-definite forms.



Positive definite quadratic form. A real non-singular quadratic form q = XTAX in n variables is called positive definite if its rank and index are equal. Because it is nonsingular its rank r is equal to n. Thus, in the real field, a positive definite quadratic form can be reduced to y12 + y22 + ... + yn2. Its value q is greater than zero for any non-trivial value of X i.e. any value of X with the exception of the trivial case


  ole16.gif




Positive semi-definite quadratic form. A real singular quadratic form q = XTAX in n variables is called positive semi-definite if its rank and index are equal. Because it is singular its rank r is less than n. Thus, in the real field, a positive semi-definite quadratic form can be reduced to y12 + y22 + ... + yr2 where r < n.. Its value q is greater than or equal to zero for any non-trivial value of X.



Negative definite quadratic form. A real non-singular quadratic form q = XTAX in n variables is called negative definite if its index p = 0. Because it is nonsingular its rank r is equal to n. Thus, in the real field, a negative definite quadratic form can be reduced to -y12 - y22 - ... - yn2. Its value q is less than zero for any non-trivial value of X.


Negative semi-definite quadratic form. A real singular quadratic form q = XTAX in n variables is called negative semi-definite if its index p = 0. Because it is singular its rank r is less than n. Thus, in the real field, a negative semi-definite quadratic form can be reduced to -y12 - y22 - ... - yr2 where r < n.. Its value q is less than or equal to zero for any nontrivial value of X .




Principal minor. A minor of a matrix A is called a principal minor if it is obtained by deleting selected (i.e. arbitrarily chosen) rows and the same numbered columns of A. Thus, the diagonal elements of a principal minor are diagonal elements of the matrix.


Theorem. Every symmetric matrix of rank r has at least one principal minor of order r different from zero.



Definite and semi-definite matrices. The matrix A of a real quadratic form

q = XTAX is called definite or semi-definite according as the quadratic form is definite or semi-definite.


Theorems


1] A real symmetric matrix A is positive definite if and only if there exists a nonsingular matrix C such that A = CTC.


2] A real symmetric matrix A of rank r is positive semi-definite if and only if there exists a matrix C of rank r such that A = CTC..


3] If A is positive definite, every principal minor of A is positive.


4] If A is positive semi-definite, every principal minor of A is non-negative.





Leading principal minors of a symmetric matrix. The leading principal minors of a symmetric matrix


                      ole17.gif


are defined as  


     ole18.gif        




5] Any n-square nonsingular matrix A can be rearranged by interchanging certain rows and the corresponding columns so that not both pn-1 and pn-2 are zero.


6] If A is a symmetric matrix and if pn-2 pn ≠ 0 but pn-1 = 0, then pn-2 and pn have opposite signs.




Regularly arranged symmetric matrix. A symmetric matrix is said to be regularly arranged if no two consecutive p’s in the sequence p0, p1, .... ,pr are zero.




Regular quadratic form. A regular quadratic form is one whose matrix is regularly arranged.



7] Any symmetric matrix (quadratic form) of rank r can be regularly arranged.


8] A real quadratic form XTAX is positive definite if and only if its rank is n and all leading principal minors are positive.


9] A real quadratic form XTAX of rank r is positive semi-definite if and only if each of the leading principal minors p0, p1, .... ,pr is positive.




References.

  Ayres. Matrices (Schaum).



More from SolitaryRoad.com:

The Way of Truth and Life

God's message to the world

Jesus Christ and His Teachings

Words of Wisdom

Way of enlightenment, wisdom, and understanding

Way of true Christianity

America, a corrupt, depraved, shameless country

On integrity and the lack of it

The test of a person's Christianity is what he is

Who will go to heaven?

The superior person

On faith and works

Ninety five percent of the problems that most people have come from personal foolishness

Liberalism, socialism and the modern welfare state

The desire to harm, a motivation for conduct

The teaching is:

On modern intellectualism

On Homosexuality

On Self-sufficient Country Living, Homesteading

Principles for Living Life

Topically Arranged Proverbs, Precepts, Quotations. Common Sayings. Poor Richard's Almanac.

America has lost her way

The really big sins

Theory on the Formation of Character

Moral Perversion

You are what you eat

People are like radio tuners --- they pick out and listen to one wavelength and ignore the rest

Cause of Character Traits --- According to Aristotle

These things go together

Television

We are what we eat --- living under the discipline of a diet

Avoiding problems and trouble in life

Role of habit in formation of character

The True Christian

What is true Christianity?

Personal attributes of the true Christian

What determines a person's character?

Love of God and love of virtue are closely united

Walking a solitary road

Intellectual disparities among people and the power in good habits

Tools of Satan. Tactics and Tricks used by the Devil.

On responding to wrongs

Real Christian Faith

The Natural Way -- The Unnatural Way

Wisdom, Reason and Virtue are closely related

Knowledge is one thing, wisdom is another

My views on Christianity in America

The most important thing in life is understanding

Sizing up people

We are all examples --- for good or for bad

Television --- spiritual poison

The Prime Mover that decides "What We Are"

Where do our outlooks, attitudes and values come from?

Sin is serious business. The punishment for it is real. Hell is real.

Self-imposed discipline and regimentation

Achieving happiness in life --- a matter of the right strategies

Self-discipline

Self-control, self-restraint, self-discipline basic to so much in life

We are our habits

What creates moral character?


[ Home ] [ Up ] [ Info ] [ Mail ]