Linear Algebra

Transpose and Properties

1. The Transpose of a Matrix (ATA^T)

Definition

The transpose of an (m×n)(m \times n) matrix AA, denoted by ATA^T, is an (n×m)(n \times m) matrix obtained by swapping the rows and columns.

  • The first row of AA becomes the first column of ATA^T.
  • The second row of AA becomes the second column of ATA^T.

Theorems of the Transpose

(A+B)T=AT+BT(A + B)^T = A^T + B^T
(AB)T=ATBT(A - B)^T = A^T - B^T

(AT)T=A(A^T)^T = A (Flipping it twice puts it back to normal)

(cA)T=cAT(cA)^T = cA^T

CRITICAL: (AB)T=BTAT(AB)^T = B^T A^T (Notice the order swaps! You cannot just distribute the TT without flipping the matrices).

2. Pro-Tips for Exams

The Trace of a Product Shortcut

If an exercise asks you to find the trace of a multiplied matrix, like tr(AB)\text{tr}(AB), do not waste time computing the entire matrix ABAB.

Because the trace is only the sum of the main diagonal, you only need to calculate the main diagonal entries of ABAB (which are c11,c22,c33c_{11}, c_{22}, c_{33}, etc.) and add them together. Ignore the rest of the matrix!

3. The Identity Matrix and Algebraic Properties

The Identity Matrix (In\mathbb{I}_n)

A square matrix with 1s on the main diagonal and 0s everywhere else is called an identity matrix. It acts like the number "1" for matrices!

Example (I2\mathbb{I}_2): [1001]\begin{bmatrix} 1 & 0 \\ 0 & 1 \end{bmatrix}

Crucial Property: Any matrix multiplied by the identity matrix remains unchanged. AI=AA \cdot \mathbb{I} = A and IA=A\mathbb{I} \cdot A = A.

Algebraic Properties of Matrix Operations

Assuming matrix sizes allow these operations to be performed, matrix arithmetic follows these rules:

  • Commutative (Addition): A+B=B+AA + B = B + A
  • Associative (Addition): (A+B)+C=A+(B+C)(A + B) + C = A + (B + C)
  • Associative (Multiplication): (AB)C=A(BC)(AB)C = A(BC)
  • Distributive (Scalar over Matrix Addition): c(A±B)=cA±cBc(A \pm B) = cA \pm cB
  • Distributive (Scalar Addition over Matrix): (a±c)A=aA±cA(a \pm c)A = aA \pm cA
  • Associative (Scalar Multiplication): (ac)A=a(cA)(ac)A = a(cA)
  • Scalar Identity: 1A=A1 \cdot A = A
Back to Linear Algebra