Linear Algebra · Undergraduate

Solution Sets of Linear Systems

Quick answer

Once a system is in reduced echelon form, its pivots describe the whole solution set. A pivot in the augmented column means no solution. Otherwise every variable with a pivot is determined by the free variables, the ones whose columns have no pivot. With no free variables the solution is unique; with free variables there are infinitely many, and they are written in parametric vector form as one particular solution plus multiples of the solutions of the matching homogeneous system.

What you'll learn

  • Classify a system as inconsistent, uniquely solvable or underdetermined
  • Identify basic and free variables from pivot positions
  • Write a solution set in parametric vector form
  • Relate the solutions of Ax = b to those of Ax = 0

Three possibilities, no others

Two lines in the plane miss each other, cross once, or coincide. That is the whole story for every linear system, in any number of unknowns:

Reduced formSolutions
a pivot in the augmented columnnone: the system is inconsistent
a pivot in every variable columnexactly one
consistent, with a column lacking a pivotinfinitely many

Nothing else can happen. Two different solutions of the same system can be averaged, or extended past each other, to produce more solutions, so the moment there are two there are infinitely many.

A variable whose column holds a pivot is a basic variable. A variable whose column holds none is a free variable: it may take any value, and the basic variables adjust to match.

Why free variables give a line, a plane, or more

Suppose a consistent system reduces to

[12030011]\left[\begin{array}{ccc|c} 1 & 2 & 0 & 3\\ 0 & 0 & 1 & 1 \end{array}\right]

Columns 11 and 33 hold pivots, so x1x_1 and x3x_3 are basic and x2x_2 is free. The rows say x1=3−2x2x_1 = 3 - 2x_2 and x3=1x_3 = 1. Writing x2=tx_2 = t and collecting the three components into one vector:

x=[3−2tt1]=[301]+t[−210]\mathbf{x} = \begin{bmatrix} 3 - 2t \\ t \\ 1 \end{bmatrix} = \begin{bmatrix} 3 \\ 0 \\ 1 \end{bmatrix} + t\begin{bmatrix} -2 \\ 1 \\ 0 \end{bmatrix}

This is parametric vector form: a fixed vector plus tt times a direction. As tt runs over the real numbers the solutions trace a line through (3,0,1)(3, 0, 1). Each free variable contributes one direction vector, so the solution set is a point, a line, a plane, or a higher-dimensional flat, one dimension per free variable.

The homogeneous system

Setting every right-hand side to zero gives Ax=0A\mathbf{x} = \mathbf{0}, a homogeneous system. It is always consistent, since x=0\mathbf{x} = \mathbf{0} works; that is the trivial solution. The interesting question is whether there are others, and the answer is yes exactly when there is a free variable.

The two problems are linked. If p\mathbf{p} solves Ax=bA\mathbf{x} = \mathbf{b} and v\mathbf{v} solves Ax=0A\mathbf{x} = \mathbf{0}, then p+v\mathbf{p} + \mathbf{v} solves Ax=bA\mathbf{x} = \mathbf{b} as well, and every solution arises this way.

The solution set of Ax=bA\mathbf{x} = \mathbf{b}, when it is not empty, is a translate of the solution set of Ax=0A\mathbf{x} = \mathbf{0}.

In the example above, (3,0,1)(3, 0, 1) is the translation and t(−2,1,0)t(-2, 1, 0) is the line of homogeneous solutions.

Solutions run from (3, 0) in the direction (−2, 1) A line falling gently from left to right, crossing the horizontal axis at (3, 0). An arrow along the line from (3, 0) to (1, 1) shows the direction vector (−2, 1), and both marked points lie on the line. -2246-2-11234xy (3, 0) (1, 1)
  • x₁ + 2x₂ = 3
Solutions run from (3, 0) in the direction (−2, 1)

Worked examples

Common mistakes

Practice problems

  1. A system in 44 unknowns reduces to a consistent form with pivots in columns 1, 2 and 4. Which variables are free?

    Answer

    x3x_3 only

    Full solution

    Every column without a pivot belongs to a free variable, and here that is the third.

  2. How many solutions does that system have?

    Answer

    Infinitely many

    Full solution

    One free variable gives a line of solutions, one solution for each value of x3x_3.

  3. Write the solution set of x1+3x2=6x_1 + 3x_2 = 6 in parametric vector form.

    Answer

    x=[60]+t[−31]\mathbf{x} = \begin{bmatrix} 6 \\ 0 \end{bmatrix} + t\begin{bmatrix} -3 \\ 1 \end{bmatrix}

    Full solution

    x2=tx_2 = t is free and x1=6−3tx_1 = 6 - 3t. Collecting the components gives a particular solution plus tt times a direction.

  4. Write the solution set of x1+3x2=0x_1 + 3x_2 = 0 in parametric vector form.

    Answer

    x=t[−31]\mathbf{x} = t\begin{bmatrix} -3 \\ 1 \end{bmatrix}

    Full solution

    The homogeneous version has the same direction and no particular solution: it is the same line moved to pass through the origin.

  5. Does Ax=0A\mathbf{x} = \mathbf{0} always have a solution?

    Answer

    Yes, x=0\mathbf{x} = \mathbf{0}

    Full solution

    The zero vector satisfies every homogeneous equation, so such a system is never inconsistent. It is the trivial solution.

  6. A system of 22 equations in 44 unknowns is consistent. What can you say about its solutions?

    Answer

    It has infinitely many, with at least two free variables.

    Full solution

    At most two pivots fit in two rows, leaving at least two of the four columns without one.

  7. Solve x1+x2−x3=2x_1 + x_2 - x_3 = 2, 2x1−x2+x3=12x_1 - x_2 + x_3 = 1, x1+2x2−2x3=3x_1 + 2x_2 - 2x_3 = 3.

    Hint

    Row reduce, and watch for a zero row.

    Answer

    x=[110]+t[011]\mathbf{x} = \begin{bmatrix} 1 \\ 1 \\ 0 \end{bmatrix} + t\begin{bmatrix} 0 \\ 1 \\ 1 \end{bmatrix}

    Full solution

    Row reduction gives [100101−110000]\left[\begin{array}{ccc|c} 1 & 0 & 0 & 1\\ 0 & 1 & -1 & 1\\ 0 & 0 & 0 & 0 \end{array}\right]. So x1=1x_1 = 1, x3=tx_3 = t is free, and x2=1+tx_2 = 1 + t.

  8. Check that t=2t = 2 in exercise 7 gives a solution.

    Answer

    (1,3,2)(1, 3, 2) satisfies all three equations.

    Full solution

    1+3−2=21 + 3 - 2 = 2 ✓, 2−3+2=12 - 3 + 2 = 1 ✓ and 1+6−4=31 + 6 - 4 = 3 ✓.

  9. If p\mathbf{p} and q\mathbf{q} both solve Ax=bA\mathbf{x} = \mathbf{b}, what does p−q\mathbf{p} - \mathbf{q} solve?

    Answer

    Ax=0A\mathbf{x} = \mathbf{0}

    Full solution

    Subtracting the two systems cancels b\mathbf{b}, so the difference of two solutions solves the homogeneous system. This is why every solution set is one solution plus the homogeneous set.

  10. A student solves a consistent system with one free variable and reports the single solution found by setting the free variable to 00. What went wrong?

    Hint

    What do other values of the free variable give?

    Answer

    That is one solution among infinitely many. The answer is the whole set p+tv\mathbf{p} + t\mathbf{v}.

    Full solution

    Setting the free variable to 00 picks out a particular solution, which is a fine starting point. Every other value of the parameter gives another solution, so reporting one hides the line that the solution set actually is.

Frequently asked questions

How many solutions can a linear system have?

None, exactly one, or infinitely many. A linear system never has, say, exactly two solutions.

What is a free variable?

A variable whose column has no pivot. It can take any value, and the variables with pivots are then determined by it.

What is parametric vector form?

The solution set written as p + t₁d₁ + ⋯ + t_kd_k: one particular solution p plus multiples of direction vectors, one per free variable.

What is a homogeneous system?

One of the form Ax = 0. It is always consistent, since x = 0 is a solution, called the trivial solution.

How are the solutions of Ax = b and Ax = 0 related?

If Ax = b is consistent with one solution p, its whole solution set is p plus the solution set of Ax = 0.

What to learn next