GATE CS - ENGINEERING MATHEMATICS:Linear Algebra

Mastering linear algebra concepts and implementation.

Linear Algebra for GATE CS

Linear Algebra usually contributes about 3–4 marks. Questions are short and formula-driven: eigenvalues of a small matrix, determinant shortcuts, rank / consistency of a linear system, and trace–determinant links. Treat this as easy marks if you can compute carefully under time pressure.

Recurring asks:

  • Eigenvalues / eigenvectors (mostly 2×22 \times 2)
  • Determinant properties
  • Rank and system consistency
  • Trace = sum of eigenvalues; det = product

Matrix fundamentals

A matrix is best seen as a linear transformation, not just a grid of numbers.

Think of a matrix AA as an operation that:

  • Rotates
  • Scales
  • Shears

a vector in some direction.

Eigenvalues tell how much it scales vectors in special directions (eigenvectors).


2.1 Matrix Operations (as required for GATE)

You must be fluent in:

  • Addition / subtraction – only for same-sized matrices
  • Multiplication – row of AA × column of BB
  • Transpose – flips rows and columns
  • Inverse – only for square, non-singular matrices
  • Orthogonal matrices – AT=A−1A^T = A^{-1}

Tip:

If det⁡(A)≠0\det(A) \neq 0 → AA is invertible → rank is full → unique solution to Ax=bAx = b.

Fast 2×2 Multiplication Example

Let

  • A=[1234]A = \begin{bmatrix} 1 & 2 \\ 3 & 4 \end{bmatrix}
  • B=[5678]B = \begin{bmatrix} 5 & 6 \\ 7 & 8 \end{bmatrix}

Then

AB=[1⋅5+2⋅71⋅6+2⋅83⋅5+4⋅73⋅6+4⋅8]=[19224350]A B = \begin{bmatrix} 1\cdot 5 + 2\cdot 7 & 1\cdot 6 + 2\cdot 8 \\ 3\cdot 5 + 4\cdot 7 & 3\cdot 6 + 4\cdot 8 \end{bmatrix} = \begin{bmatrix} 19 & 22 \\ 43 & 50 \end{bmatrix}

For 2×22 \times 2 matrices in exam, use diagonal and cross products directly to save time.

Also remember: multiplication is not commutative, i.e. AB≠BAAB \neq BA in general.


3. Determinants

The determinant is a single number that tells you:

  • Whether a matrix is invertible
  • How area/volume scales under the transformation
  • Whether a system has unique / infinite / no solution

3.1 Determinant of 2×22 \times 2

For

A=[abcd]A = \begin{bmatrix} a & b \\ c & d \end{bmatrix}

the determinant is:

∣A∣=ad−bc|A| = ad - bc

GATE will almost surely ask at least one direct question using this.

3.2 Determinant Properties (GATE Goldmine)

Worth knowing cold:

  • det⁡(AB)=det⁡(A)det⁡(B)\det(AB) = \det(A)\det(B)
  • det⁡(AT)=det⁡(A)\det(A^T) = \det(A)
  • Swapping two rows → changes sign of determinant
  • Multiplying a row by kk → determinant is multiplied by kk
  • Two identical (or proportional) rows → det⁡(A)=0\det(A) = 0
  • If a row is a linear combination of others → det⁡(A)=0\det(A) = 0

GATE Hack:

If det⁡(A)=0\det(A) = 0 →

  • Matrix is singular
  • Rank is not full
  • System Ax=bAx = b has infinite or no solutions

This lets you kill options very quickly.


4. Eigenvalues & Eigenvectors (Most Tested Area)

Eigenvalues tell how a matrix scales certain special directions (eigenvectors).

Definition:

Av=λvAv = \lambda v

where:

  • λ\lambda = eigenvalue
  • vv = eigenvector (non-zero)

4.1 Characteristic Equation

Eigenvalues are roots of:

∣A−λI∣=0|A - \lambda I| = 0

For a 2×22 \times 2 matrix, the characteristic polynomial can be written using trace and determinant:

λ2−(trace) λ+det⁡(A)=0\lambda^2 - (\text{trace})\,\lambda + \det(A) = 0

where:

  • trace=a+d\text{trace} = a + d (sum of diagonal entries)
  • det⁡(A)=ad−bc\det(A) = ad - bc

GATE Hack:

Avoid full expansion – use trace and determinant directly.

4.2 Exam-Type Example

Let

A=[3214]A = \begin{bmatrix} 3 & 2 \\ 1 & 4 \end{bmatrix}
  • trace=3+4=7\text{trace} = 3 + 4 = 7
  • det⁡(A)=3⋅4−2⋅1=10\det(A) = 3\cdot 4 - 2\cdot 1 = 10

Characteristic equation:

λ2−7λ+10=0\lambda^2 - 7\lambda + 10 = 0

Solving:

(λ−5)(λ−2)=0⇒λ=5,2(\lambda - 5)(\lambda - 2) = 0 \Rightarrow \lambda = 5, 2

This is a 15‑second question in the exam.

4.3 Key Eigenvalue Properties

  • Sum of eigenvalues =trace(A)= \text{trace}(A)
  • Product of eigenvalues =det⁡(A)= \det(A)
  • Eigenvalues of AkA^k are λk\lambda^k
  • Eigenvalues of A−1A^{-1} are 1/λ1/\lambda (for non-zero λ\lambda)
  • If AA is triangular (upper/lower), eigenvalues are just the diagonal entries
  • If AA is orthogonal, then ∣λ∣=1|\lambda| = 1

These shortcuts solve most eigenvalue questions without heavy calculation.


5. System of Linear Equations (Using Rank)

Consider a system:

Ax=bAx = b

Possibilities:

  • Unique solution
  • Infinite solutions
  • No solution

Use rank to classify:

  • Unique solution: rank(A)=rank([A∣b])=n\text{rank}(A) = \text{rank}([A|b]) = n
  • Infinite solutions: rank(A)=rank([A∣b])<n\text{rank}(A) = \text{rank}([A|b]) < n
  • No solution: rank(A)<rank([A∣b])\text{rank}(A) < \text{rank}([A|b])

GATE frequently tests this classification.


6. Rank of a Matrix

Rank = number of linearly independent rows or columns.

6.1 Quick Rank Clues (GATE Pattern)

  • A row/column of all zeros → reduces rank
  • Two proportional rows → dependence → reduces rank
  • If det⁡(A)≠0\det(A) \neq 0 for an n×nn \times n matrix → full rank \(= n\)
  • Elementary row operations do not change rank

These ideas are enough for most GATE rank questions.


7. GATE PYQ‑Style Questions (Solved)

Q1. Eigenvalues of a Triangular Matrix

Let

A=[2103]A = \begin{bmatrix} 2 & 1 \\ 0 & 3 \end{bmatrix}

Since AA is upper triangular, eigenvalues are just the diagonal entries:

  • Eigenvalues = 2, 3

No computation needed → instant marks.

Q2. Rank / Consistency

System:

{x+y+z=12x+2y+2z=2x+y+z=3\begin{cases} x + y + z = 1 \\ 2x + 2y + 2z = 2 \\ x + y + z = 3 \end{cases}
  • Row 2 is 2 × Row 1 (proportional)
  • Row 1 and Row 3 contradict (same left side, different right side)

⇒ System is inconsistent → no solution.

Q3. Determinant Scaling

If det⁡(A)=5\det(A) = 5, find det⁡(3A)\det(3A) for a 3×33 \times 3 matrix.

For n×nn \times n:

det⁡(kA)=kndet⁡(A)\det(kA) = k^n \det(A)

Here, n=3,k=3n = 3, k = 3:

det⁡(3A)=33⋅5=27⋅5=135\det(3A) = 3^3 \cdot 5 = 27 \cdot 5 = 135

8. Common Mistakes (Mark Destroyers)

Avoid these:

  • Assuming \(AB = BA\) for arbitrary matrices
  • Forgetting sign change when swapping rows in determinants
  • Expanding big determinants instead of using properties
  • Ignoring the fact that triangular matrices have eigenvalues on the diagonal
  • Thinking rank changes under elementary row operations (it does not)
  • Using full inverse formulas for 3×33 \times 3 in the exam (usually a waste of time)

9. Rapid Revision Sheet (Night Before Exam)

Determinant

  • 2×22 \times 2: ∣A∣=ad−bc|A| = ad - bc
  • det⁡(AB)=det⁡(A)det⁡(B)\det(AB) = \det(A)\det(B)
  • det⁡(AT)=det⁡(A)\det(A^T) = \det(A)

Eigenvalues

  • From trace/determinant: λ2−(trace)λ+det⁡(A)=0\lambda^2 - (\text{trace})\lambda + \det(A) = 0
  • Triangular matrix → eigenvalues = diagonal entries
  • Eigenvalues of AkA^k: λk\lambda^k
  • Eigenvalues of A−1A^{-1}: 1/λ1/\lambda

Rank

  • Full rank ⇔det⁡(A)≠0\Leftrightarrow \det(A) \neq 0
  • Zero/proportional rows reduce rank

System \(Ax = b\)

  • Unique: rank(A)=rank([A∣b])=n\text{rank}(A) = \text{rank}([A|b]) = n
  • Infinite: rank(A)=rank([A∣b])<n\text{rank}(A) = \text{rank}([A|b]) < n
  • None: rank(A)<rank([A∣b])\text{rank}(A) < \text{rank}([A|b])

10. Practice Question Ideas (for Schoolabe)

You can turn these into quiz items:

  1. Find eigenvalues of

[41−23]\begin{bmatrix} 4 & 1 \\ -2 & 3 \end{bmatrix}

  1. If det⁡(A)=−4\det(A) = -4 for a 3×33 \times 3 matrix, find det⁡(2A)\det(2A).
  2. Determine rank of

[1224]\begin{bmatrix} 1 & 2 \\ 2 & 4 \end{bmatrix}.

  1. For what value of kk is the system
x+y=2,2x+2y=kx + y = 2,\quad 2x + 2y = k

inconsistent?

  1. If eigenvalues of AA are 1 and −2-2, find eigenvalues of A3A^3.