Misplaced Pages

Inner product space: Difference between revisions

Article snapshot taken from Wikipedia with creative commons attribution-sharealike license. Give it a read and then ask your questions in the chat. We can research this topic together.
Browse history interactively← Previous editNext edit →Content deleted Content addedVisualWikitext
Revision as of 22:29, 27 December 2001 editAxelBoldt (talk | contribs)Administrators44,499 edits switch definition to being linear in the second entry← Previous edit Revision as of 01:09, 25 January 2002 edit undoTarquin (talk | contribs)14,993 editsmNo edit summaryNext edit →
Line 37: Line 37:
*Theorem (Cauchy-Schwarz): |<''x'', ''y''>| &le; ||''x''||&middot;||''y''|| for any ''x'', ''y'' in ''V'' *Theorem (Cauchy-Schwarz): |<''x'', ''y''>| &le; ||''x''||&middot;||''y''|| for any ''x'', ''y'' in ''V''


*Theorem (Triangle Inequality): ||''x'' + ''y''|| &le; ||''x''|| + ||''y''|| *Theorem (]): ||''x'' + ''y''|| &le; ||''x''|| + ||''y''||


*Theorem (Pythagoras): Whenever ''x'', ''y'' are in ''V'' and <''x'', ''y''> = 0, then ||x||<sup>2</sup> + ||y||<sup>2</sup> = ||x+y||<sup>2</sup>. *Theorem (Pythagoras): Whenever ''x'', ''y'' are in ''V'' and <''x'', ''y''> = 0, then ||x||<sup>2</sup> + ||y||<sup>2</sup> = ||x+y||<sup>2</sup>.

Revision as of 01:09, 25 January 2002

An inner product space is a vector space with additional structure, an inner product or scalar product, which allows to talk about angles and lengths of vectors. Inner product spaces are generalizations of Euclidean space.


Formally, an inner product space is a real or complex vector space V together with a map f : V x VF where F is the ground field (either R or C). We write <x, y> instead of f(x, y) and require that the following axioms be satisfied:


  1. for any x in V, <x, x> ≥ 0 and <x, x> = 0 if and only if x = 0
  1. <z, ax+y> = a <z, x> + <z, y> for any a in F and x, y in V.
  1. <x, y> = <y, x> whenever x, y are in V. Here denotes complex conjugation; if F = R, we have <x, y> = <y, x>.


A function which follows the second and third axioms is called a sesqui-linear operator

(one-and-a-half linear operator). A sesqui-linear operator which is positive

(<x, x> ≥ 0) is called a semi inner product.


Note that many authors require an inner product to be linear in the first and conjugate-linear in the second argument, contrary to the convention adopted above. This change is immaterial, but the definition above ensures a smoother connection to the bra-ket notation popular in quantum mechanics.


Here and in the sequel, we will write ||x|| for √<x, x>. This is well defined by axiom 1 and is thought of as the length of the vector x.


From these axioms, we can conclude the following:


  • Theorem (Cauchy-Schwarz): |<x, y>| ≤ ||x||·||y|| for any x, y in V
  • Theorem (Pythagoras): Whenever x, y are in V and <x, y> = 0, then ||x|| + ||y|| = ||x+y||.


An induction on Pythagoras yields:


  • Theorem (Pythagoras): If x1, ..., xn are orthogonal vectors, that is, <xj, xk> = 0 whenever jk, then
∑ ||xk|| = ||∑ xk||


Because of the triangle inequality and because of axiom 2, we see that ||·|| is a norm which turns V into a normed vector space and hence also into a metric space. The most important inner product spaces are the ones which are complete with respect to this metric; they are called Hilbert spaces.


In view of the Cauchy-Schwarz inequality, we also note that <·,·> is continuous from V x V to F. This allows us to extend Pythagoras' theorem a tiny bit more, and rename it:


  • Theorem (Parseval's Identity): If xk are mutually orthogonal vectors in V and if ∑ xk converges to x in V, then
∑ ||xk|| = ||x||


Another consequence of the Cauchy-Schwarz inequality is that it is possible to define the angle φ between two non-zero vectors x and y (at least in the case F = R) by writing

cos(φ) = <x, y> / (||x||·||y||)

in analogy to the situation in Euclidean space.


Several types of maps A : V -> W between inner product spaces are of relevance:

  • Linear maps, i.e. A(ax + y) = a A(x) + A(y) for all a in F and all x and y in V.
  • Continuous linear maps, i.e. A is linear and continuous with respect to the metric defined above, or equivalently, A is linear and the set { ||Ax|| : x in V with ||x|| ≤ 1 } is bounded.
  • Isometries, i.e. A is linear and <Ax, Ay> = <x, y> for all x, y in V, or equivalently, A is linear and ||Ax|| = ||x|| for all x in V.
  • Isometrical isomorphism, i.e. A is a surjective isometry.


From the point of view of inner product space theory, there is no need to distinguish between two spaces which are isometrically isomorphic.