Linear Functionals and Dual Spaces PDF
Linear Functionals and Dual Spaces PDF
Linear Functionals and Dual Spaces PDF
Shruti Sharma
Shruti Sharma
1 / 70
Table of Contents
Linear Functionals
Linear functionals and Subspaces
Annihilators
Double Dual
Hyperspaces
Shruti Sharma
2 / 70
Linear Functionals
Shruti Sharma
3 / 70
Linear Functionals
Definition
If V is a vector space over the field F, a linear transformation f : V F is
called linear functional on V i.e. f is a function from V into F s.t.
f (c + ) = cf () + f ()
for all vectors and in V and all scalars c in F.
Shruti Sharma
4 / 70
Linear Functionals
Example
Let F be a field and let a1 , ..., an be scalars in F. Define a function f on F n
by:
f (x1 , ..., xn ) = a1 x1 + ... + an xn
Then f is a linear functional because
f (cx1 + y1 , ..., cxn + yn ) = c(a1 x1 + ... + an xn ) + (a1 y1 + ... + an yn )
= cf (x1 , ..., xn ) + f (y1 , ..., yn )
It is the linear dunctional represented by matrix [a1 , ..., an ] relative to the
standard basis for F n and basis {1} for F:
aj = f (j ) j = 1, ..., n
Shruti Sharma
5 / 70
Linear Functionals
Remark
Every linear functional on F n is of this form, for some scalars a1 , ..., an
because:
X
f (x1 , ..., xn ) = f
xj j
j
xj f (j )
aj xj
Shruti Sharma
6 / 70
Linear Functionals
Example
Let n be a positive integer and F a field. If A is an n n matrix with
entries in F, the trace of A:
tr (A) = A11 + ... + Ann
Trace function is a linear functional on the matrix space F nn because:
tr (cA + B) =
n
X
(cAii + Bii )
i=1
n
X
=c
i=1
Aii +
n
X
Bii
i=1
Shruti Sharma
7 / 70
Linear Functionals
Example
Let V be the space of all polynomial functions from the field F into itself.
Let t be an element of F. If we define
Lt (p) = p(t)
then Lt is a linear functional on V.
Evaluation at t is a linear functional on the space of all functions from
F into F.
(cf + g )(t) = cf (t) + g (t)
Shruti Sharma
8 / 70
Example
Example
Let [a, b] be a closed interval on the real line and let C ([a, b]) be the space
of continuous real-valued functions [a,b]. Then
Z
g (t)dt
L(g ) =
a
L(cg + h) =
(cg + h)(t)dt
Z b
Z b
=
cg (t)dt +
h(t)dt
a
= cL(g ) + L(h)
Shruti Sharma
9 / 70
Dual Space
Definition
If V is a vector space, the collection of all linear functionals on V denoted
by L(V,F) forms a vector space in a natural way. This space V is called
dual space of V.
V = L(V , F )
and dim(V )=dim(V)
Recall
Let V be an n-dim vector space over the field F, and let W be an m dim
vector space over F. Then the space L(V,W) is finite dimensional and has
dim mn.
Shruti Sharma
10 / 70
Dual Space
Shruti Sharma
11 / 70
Dual Space
These
Pfunctionals are linearly independent. For, suppose
f = ni=1 ci fi , then
f (j ) =
=
n
X
i=1
n
X
ci fi (j )
ci ij = cj
i=1
Shruti Sharma
12 / 70
Dual Space
Theorem
Let V be a finite dimensional vector space over the field F, and let
B = {1 , ..., n } be a basis for V. Then there is a unique dual basis
B = {f1 , ..., fn } for V s.t. fi (j ) = ij . For eacch linear functional f on V
we have
f =
n
X
f (i )fi
i=1
n
X
fi ()i
i=1
Shruti Sharma
13 / 70
Dual Space
Proof.
If =
Pn
i=1 xi i
is a vector in V, then
fj () =
=
n
X
i=1
n
X
fj (i )xi
xi ij = xj
i=1
Suppose f =
Pn
i=1 ci fi ,
then
f (j ) =
n
X
ci fi (j ) = cj
i=1
Shruti Sharma
14 / 70
Dual Space
n
X
fi ()i
i=1
Shruti Sharma
15 / 70
Dual space
(1)
Shruti Sharma
16 / 70
Dual Space
Example
Let V be the vector space of all polynomial functions from R into R which
have degree less than or equal to 2. Let t1 , t2 , t3 be any distinct real no.
and let
Li (p) = p(ti )
Then L1 , L2 , L3 are linear functionals on V. These functionals are linearly
independent; for suppose
L = c1 L1 + c2 L2 + c3 L3
Shruti Sharma
17 / 70
Dual Space
Example (Contd.)
If L=0, i.e. if L(p)=0 for each p V , then applying L to the
particular polynomial functions 1, x, x 2 , we obtain
c1 + c2 + c3 = 0
t1 c1 + t2 c2 + t3 c3 = 0
t12 c1 + t22 c2 + t32 c3 = 0
It follows that c1 = c2 = c3 = 0 as the matrix
1 1 1
t1 t2 t3
t12 t22 t32
is invertible when t1 , t2 , t3 are distinct.
Shruti Sharma
18 / 70
Dual Space
Example (Contd.)
Now, Li are independent and since V has dimension 3, these
functionals form a basis for V . What is the basis for V of which this
is the dual?
Such basis {p1 , p2 , p3 } must satisfy:
Li (pj ) = pj (ti ) = ij
Shruti Sharma
19 / 70
Dual Space
Example (Contd.)
These polynomials can be seen to be:
(x t2 )(x t3 )
(t1 t2 )(t1 t3 )
(x t1 )(x t3 )
p2 (x) =
(t2 t1 )(t2 t3 )
(x t1 )(x t2 )
p3 (x) =
(t3 t1 )(t3 t2 )
p1 (x) =
Shruti Sharma
20 / 70
Dual Space
Example (Contd.)
Thus, if c1 , c2 , c3 are any real no., there is exactly one polynomial
function p over R which has degree at most 2 and satisfies
p(tj ) = cj j = 1, 2, 3
This polynomial function is
p = c1 p1 + c2 p2 + c3 p3
Shruti Sharma
21 / 70
Remark
Each d-dimensional subspace of n-dim space is the intersection of the null
spaces of (n-d) linear functionals.
Shruti Sharma
22 / 70
Annihilators
Definition
If V is a vector space over the field F and S is a subset of V, the
annihilator of S is the set S 0 of linear functionals f on V s.t. f () = 0 for
every S. i.e.
S 0 = {f : f () = 0, S V , f V }
Shruti Sharma
23 / 70
Annihilators
Remark
S 0 is a subspace of V whether S is a subspace of V or not. For
suppose: Let f1 , f2 be distinct annihilators on space V s.t.
f1 () = f2 () = 0, then
(c1 f1 + c2 f2 )() = c1 f1 () + c2 f2 () = 0
If S = {0}, then S 0 = V .
If S = V , then S 0 = {0}.
Shruti Sharma
24 / 70
Annihilators
Theorem
Let V be a finite dim vector space over the field F, and let W be a
subspace of V. Then
dim(W ) + dim(W 0 ) = dim(V )
Shruti Sharma
25 / 70
Annihilators
Proof:
Let dim(W)=k and 1 , ..., k be a basis for W.
Choose vectors k+1 , ..., n in V s.t. 1 , ..., n is a basis for V.
Let {f1 , ..., fn } be the basis for V which is dual basis for V. Claim is
k+1 , ..., n is a basis for annihilator W 0 .
Certainly fi W 0 for i k + 1 and j k as:
fi (j ) = 0
It follows fi () = 0 for i k + 1 whenever is a linear combination of
1 , ..., k
Shruti Sharma
26 / 70
Annihilators
The functionals fk+1 , ..., fn are independent, and claim is they span
W 0:
Suppose f V . Now,
f =
n
X
f (i )fi
i=1
n
X
f (i )fi
i=k+1
Shruti Sharma
27 / 70
Annihilators
Corollary (1)
If W is a k-dim subspace of an n dim vector space V, then W is the
intersection of (n-k) hyperspaces in V.
Proof.
W is exactly the set of vectors s.t. fi () = 0, i = k + 1, ..., n.
In case k=n-1, W is the null space of fn .
Shruti Sharma
28 / 70
Annihilators
Corollary (2)
If W1 and W2 are subspaces of a finite dim vector space then W1 = W2 iff
W10 = W20 .
Proof.
If W1 = W2 , then of course W10 = W20 .
If W1 6= W2 , then one of the two subspaces contains a vector which is
not in the other.
Let W2 but
/ W1 .
There is a linear functional f s.t. f () = 0 for all W1 but f () 6= 0.
Then f W10 but not in W20 and hence W10 6= W20 .
Shruti Sharma
29 / 70
Annihilators
Corollary 1 says if we select some ordered basis for the space, each
k-dim subspace can be described by specifying (n-k) homogeneous
linear conditions on the coordinates relative to that basis.
From the point of linear functionals, suppose we have a system of
linear equations:
A11 x1 + . . . + A1n xn = 0
..
.
Am1 x1 + . . . + Amn xn = 0
for which we wish to find the solutions.
Shruti Sharma
30 / 70
Annihilators
Shruti Sharma
31 / 70
Annihilators
The n-tuple (Ai1 , ..., Ain ) gives the coordinates of the linear functional
fi relative to the basis which is dual to the standard basis for F n .
Row space of the coefficient matrix may also be regarded as the space
of linear functionals spanned by f1 , ..., fm .
Solution space is the subspace annihilated by this space of functionals.
Shruti Sharma
32 / 70
Aij cj = 0 i = 1, ..., m
j=1
33 / 70
Double Dual
Shruti Sharma
34 / 70
Double Dual
Dual space of V V .
If V , then induces a linear functional L on V defined by:
L (f ) = f () f V
L is linear as:
L (cf + g ) = (cf + g )()
= (cf )() + g ()
= cf () + g ()
= cL (f ) + L (g )
Shruti Sharma
35 / 70
Double Dual
Shruti Sharma
36 / 70
Double Dual
Theorem
Let V be a finite dim vector space over the field F. For each vector V
define:
L (f ) = f () f V
The mapping 7 L is then an isomorphism of V onto V .
Shruti Sharma
37 / 70
Double Dual
Proof.
For each , the function L is linear. Suppose and are in V and c
is in F, and let = c + . Then for each f in V :
L (f ) = f ()
= f (c + )
= cf () + f ()
= cL (f ) + L (f )
This shows that the mapping 7 L is a linear transformation from
V to V .
Transformation is non-singular; for L = 0 iff = 0.
dim(V)=dim(V )=dim(V) which means transformation is onto.
Shruti Sharma
38 / 70
Double Dual
Corollary
Let V be a finite dim vector space over the field F. If L is a linear functional
on the dual space V of V, then there is a unique vector in V s.t.
L(f ) = f ()
for every f in V .
Shruti Sharma
39 / 70
Double Dual
Corollary
Let V be a finite dim vector space over the field F. Each basis for V is
the dual of some basis for V.
Proof.
Let B = {f1 , ..., fn } be a basis for V . There is a basis {L1 , ..., Ln }
for V s.t. Li (fj ) = ij .
So, for each i there is a vector i in V s.t.
Li (f ) = f (i )
for every f in V , i.e. s.t. Li = Li .
It follows that {1 , ..., n } is a basis for V and that B is the dual of
this basis.
Shruti Sharma
40 / 70
Double Dual
Shruti Sharma
41 / 70
Double Dual
Theorem
If S is any subset of a finite dim vector space V, then (S 0 )0 is the
subspace spanned by S.
Proof.
Let W be the subspace spanned by S. Clearly, W 0 = S 0 . Claim is
W = W 00 .
Since
dim(W ) + dim(W 0 ) = dim(V )
dim(W 0 ) + dim(W 00 ) = dim(V )
Since, dim(V ) = dim(V ) we get dim(W ) = dim(W 00 ). Since, W is
a subspace of W 00 , we see W = W 00 .
Shruti Sharma
42 / 70
Hyperspaces
Definition
If V is a vector space, a hyperspace in V is a maximal proper subspace of
V.
Theorem
If f is a non-zero linear functional on the vector space V, then the null
space of f is a hyperspace in V. Conversely, every hyperspace in V is the
null space of a (not unique) non-zero functional on V.
Shruti Sharma
43 / 70
Hyperspaces
Proof: Let f 6= 0 V and Nf is its null space. Let V which is not in
Nf i.e. a vector s.t. f () 6= 0.
Claim is that every vector in V is in the subspace spanned by Nf
and i.e. = + c Nf , c F .
Let be in V. Define
c=
f ()
f ()
Shruti Sharma
44 / 70
Hyperspaces
Let N be a hyperspace in V.
Fix some vector which is not in N.
Since N is maximal proper subspace, the subspace spanned by N and
is the entire space V.
So each vector in V has the form = + c where N and
c F . Here, vector and scalar c is uniquely determined by . For if
suppose = 0 + c 0 then (c 0 c) = 0 .
If c 0 c 6= 0 then would be in N; hence, c 0 = c and 0 = .
Q.E.D.
Shruti Sharma
45 / 70
Hyperspaces
Remark
If V , there is a unique scalar c s.t. c is in N. Call scalar g ().
Then g is a linear functional on V and N is the null space of g. i.e.
f ( g ()) = 0
f ()
g () =
f ()
For pa + b V and p scalar in F,
f (pa + b
f ()
pf (a) + f (b)
=
= pg (a) + g (b)
f ()
g (pa + b) =
Shruti Sharma
46 / 70
Hyperspaces
Lemma
If f and g are linear functionals on a vector space V, then g is a scalar
multiple of f i.e. g=cf iff the null space of g contains the null space of f,
i.e. iff f () = 0 implies g () = 0. Equivalently, if g=cf then Nf Ng .
Shruti Sharma
47 / 70
Hyperspaces
Proof.
If f=0 then g=0 and thus g is trivially a scalar multiple of f.
Suppose f 6= 0, so that null space Nf is a hyperspace in V. Choosing
V with f () 6= 0 and let
c=
g ()
f ()
Shruti Sharma
48 / 70
Hyperspaces
Lemma
If f and g are linear functionals on a vector space V s.t. null space of f is
equal to null space of g then g is a scalar multiple of f i.e. g=cf.
Proof.
Let N be null space and be vector outside H, then span(N,)=V.
All x V can be written as x = n + t with n N, then f () and
g () uniquely determine function f and :
f (x)
f (n + t)
f ()
=
=
=c
g (x)
g (n + t)
g ()
Hence, f=cg.
Shruti Sharma
49 / 70
Hyperspaces
Theorem
Let g, f1 , ..., fr be linear functionals on a vector space V with respective
null space N, N1 , ..., Nr . Then g is a linear combination of f1 , ..., fr iff N
contains the intersection N1 ... Nr .
Proof:
If g = c1 f1 + ... + cr fr and fi () = 0 for each i, then clearly g () = 0.
So, N contains N1 ... Nr .
Converse is proved by induction. From prev lemma, r=1 case is
handled i.e. if g and f are linear functionals with null space Ng and
Nf , then g is scalar multiple of f iff Ng contains Nf .
Suppose we know the result is true for r=k-1, and let f1 , ..., fk be
linear functionals with null spaces N1 , ..., Nk s.t. N1 ... Nk is
contained in N.
Shruti Sharma
50 / 70
Hyperspaces
0
0
Let g 0 , f10 , ..., fk1
to the subspace Nk . Then g 0 , f10 , ..., fk1
are linear
functionals on the vector space Nk .
If Nk and fi 0 () = 0 i=1,...k-1, then N1 ... Nk and so
g 0 () = 0.
By induction, there are scalars ci s.t.
0
g 0 = c1 f10 + ... + ck1 fk1
Now let
h=g
k1
X
ci fi
i=1
k
X
ci fi
i=1
Q.E.D.
Shruti Sharma
51 / 70
Shruti Sharma
52 / 70
Shruti Sharma
53 / 70
Shruti Sharma
54 / 70
Theorem
Let V and W be vector spaces over the field F. For each linear
transformation T : V W , there is a unique linear transformation
T t : W V s.t.
(T t g )() = g (T )
for every g in W and in V. T t is called Transpose or adjoint of T.
Shruti Sharma
55 / 70
Theorem
Let V and W be vector spaces over the field F and let T is linear
transformation T : V W . The null space of T t is the annihilator of the
range of T. If V and W are finite dimensional, then
(1) rank(T t )=rank(T)
(2) the range of T t is the annihilator of the null space of T.
Shruti Sharma
56 / 70
Shruti Sharma
57 / 70
Q.E.D.
Shruti Sharma
58 / 70
Theorem
Let V and W be finite dim vector spaces over the field F. Let B be an
ordered basis for V with dual basis B , and let B 0 be an ordered basis for
W with dual basis B 0 . Let T be a linear transformation T : V W ; let
A be the matrix of T relative to B and B 0 and let B be the matrix of T t
relative to B 0 , B. Then Bij = Aji .
Shruti Sharma
59 / 70
B 0 = {1 , ..., m }
B 0 = {g1 , ..., gm }
By definition
T j =
T t gj =
m
X
i=1
n
X
Aij i j = 1, ..., n
Bij fi j = 1, ..., m
i=1
Shruti Sharma
60 / 70
=
=
m
X
k=1
m
X
Aki gj (k )
Aki jk
k=1
= Aji
Shruti Sharma
61 / 70
n
X
f (i )fi
i=1
n
X
Aji fi
i=1
Shruti Sharma
62 / 70
Definition
If A is an m n matrix over the field , the transpose of A is the m n
matrix At defined by Atij = Aji .
Remark
If T is a linear transformation T : V W , the matrix of which in some
pair of bases is A, then the transpose transformation T t : W V is
represented in the dual pair of bases by the transpose of matrix At .
Shruti Sharma
63 / 70
Shruti Sharma
64 / 70
Since, T and T t have same rank, thus row rank of A is equal to the
column rank of A.
Q.E.D.
Shruti Sharma
65 / 70
n
X
Aij i
i=1
(2)
October 16, 2016
66 / 70
Example (Contd.)
What happens when we change basis?
Suppose,
B 0 = {10 , ..., n0 }
is another basis for B with dual {f10 , ..., fn0 }.
If B is the matrix of T in the ordered basis B 0 , then from eq2.
Bij = fi 0 (T j0 )
Shruti Sharma
67 / 70
Shruti Sharma
68 / 70
Shruti Sharma
69 / 70
Example (Contd.)
In other words,
[T ]B0 = [U 1 TU]B
= [U 1 ]B [T ]B [U]B
= [U]1
B [T ]B [U]B
which is precisely the change-of-basis formula.
Shruti Sharma
70 / 70