Another Linear Algebra question.

Page 2 - Seeking answers? Join the AnandTech community: where nearly half-a-million members share solutions and discuss the latest tech.

StormRider

Diamond Member
Mar 12, 2000
8,324
2
0
In other words, the transpose of the product is equal to the product of the transpose of the product of the transposes.
 

StormRider

Diamond Member
Mar 12, 2000
8,324
2
0
Not quite. Transpose works for vectors too. If M is a matrix and x is a vector then (Mx) ^T = x^T M^T
 

MetalMat

Diamond Member
Jun 14, 2004
9,687
36
91
Originally posted by: StormRider
Not quite. Transpose works for vectors too. If M is a matrix and x is a vector then (Mx) ^T = x^T M^T

Ok, I did not remember that.
 

MetalMat

Diamond Member
Jun 14, 2004
9,687
36
91
So it would turn into this:

(ABx)^T (ABx) = [A^T B^T x ^T] [A B x] = x^T x

right?
 

StormRider

Diamond Member
Mar 12, 2000
8,324
2
0
Originally posted by: MetalMat
So it would turn into this:

(ABx)^T (ABx) = [A^T B^T x ^T] [A B x] = x^T x

right?

Yes, but you have to reverse the things in the first bracket:

[x ^T B^T A^T][A B x] = ?

 

MetalMat

Diamond Member
Jun 14, 2004
9,687
36
91
Originally posted by: StormRider
Originally posted by: MetalMat
So it would turn into this:

(ABx)^T (ABx) = [A^T B^T x ^T] [A B x] = x^T x

right?

Yes, but you have to reverse the things in the first bracket:

[x ^T B^T A^T][A B x] = ?

Ax^T B B^T xA^T
 

StormRider

Diamond Member
Mar 12, 2000
8,324
2
0
And then you multiple the inner stuff to get the identity.

|ABx| = (ABx)^T (ABx) = [x^T B^T A^T] [A B x] = x^T B^T (A^T A) B x = x^T B^T I B x = x^T B^T B x = x^T I x = x^T x = |x|
 

MetalMat

Diamond Member
Jun 14, 2004
9,687
36
91
Originally posted by: StormRider
And then you multiple the inner stuff to get the identity.

|ABx| = (ABx)^T (ABx) = [x^T B^T A^T] [A B x] = x^T B^T (A^T A) B x = x^T B^T I B x = x^T B^T B x = x^T I x = x^T x = |x|

I dont quite understand how you got from x^T B^T A^T] [A B x] to x^T B^T (A^T A) B x

Thanks for being patient :thumbsup:
 

MetalMat

Diamond Member
Jun 14, 2004
9,687
36
91
Originally posted by: MetalMat
Originally posted by: StormRider
And then you multiple the inner stuff to get the identity.

|ABx| = (ABx)^T (ABx) = [x^T B^T A^T] [A B x] = x^T B^T (A^T A) B x = x^T B^T I B x = x^T B^T B x = x^T I x = x^T x = |x|

I dont quite understand how you got from x^T B^T A^T] [A B x] to x^T B^T (A^T A) B x

Thanks for being patient :thumbsup:

Oh wait wait, duh. you have to go from left to right. Mixing up my laws, long day today.
 

MetalMat

Diamond Member
Jun 14, 2004
9,687
36
91
Originally posted by: MetalMat
Originally posted by: MetalMat
Originally posted by: StormRider
And then you multiple the inner stuff to get the identity.

|ABx| = (ABx)^T (ABx) = [x^T B^T A^T] [A B x] = x^T B^T (A^T A) B x = x^T B^T I B x = x^T B^T B x = x^T I x = x^T x = |x|

I dont quite understand how you got from x^T B^T A^T] [A B x] to x^T B^T (A^T A) B x

Thanks for being patient :thumbsup:

Oh wait wait, duh. you have to go from left to right. Mixing up my laws

I understand. A^T A = 1, so you go to x^T B^T B x -> B^T B =1 -> x^T x = |x|
 

StormRider

Diamond Member
Mar 12, 2000
8,324
2
0
Matrice multiplication is associative.

So, you can group the inner terms to muliply first. Like with numbers. (CBA) (ABC) = CB(AA)BC

So, I grouped the A^T and A to mulitply to get the identity I

|ABx| = (ABx)^T (ABx) = [x^T B^T A^T] [A B x] = x^T B^T (A^T A) B x = x^T B^T (I) B x = x^T (B^T B) x = x^T(I) x = x^T x = |x|
 

StormRider

Diamond Member
Mar 12, 2000
8,324
2
0
Originally posted by: MetalMat
Originally posted by: MetalMat
Originally posted by: MetalMat
Originally posted by: StormRider
And then you multiple the inner stuff to get the identity.

|ABx| = (ABx)^T (ABx) = [x^T B^T A^T] [A B x] = x^T B^T (A^T A) B x = x^T B^T I B x = x^T B^T B x = x^T I x = x^T x = |x|

I dont quite understand how you got from x^T B^T A^T] [A B x] to x^T B^T (A^T A) B x

Thanks for being patient :thumbsup:

Oh wait wait, duh. you have to go from left to right. Mixing up my laws

I understand. A^T A = 1, so you go to x^T B^T B x -> B^T B =1 -> x^T x = |x|

Yep! You got it!
 

MetalMat

Diamond Member
Jun 14, 2004
9,687
36
91
Thanks bro :)

If you are ever down in Lafayette, Louisiana I'll buy you a beer :beer: