×
Start learning today, and be successful in your academic & professional career. Start Today!

Raffi Hovasapian

Dot Product & Matrix Multiplication

Slide Duration:

Section 1: Linear Equations and Matrices
Linear Systems

39m 3s

Intro
0:00
Linear Systems
1:20
Introduction to Linear Systems
1:21
Examples
10:35
Example 1
10:36
Example 2
13:44
Example 3
16:12
Example 4
23:48
Example 5
28:23
Example 6
32:32
Number of Solutions
35:08
One Solution, No Solution, Infinitely Many Solutions
35:09
Method of Elimination
36:57
Method of Elimination
36:58
Matrices

30m 34s

Intro
0:00
Matrices
0:47
Definition and Example of Matrices
0:48
Square Matrix
7:55
Diagonal Matrix
9:31
Operations with Matrices
10:35
10:36
Scalar Multiplication
15:01
Transpose of a Matrix
17:51
Matrix Types
23:17
Regular: m x n Matrix of m Rows and n Column
23:18
Square: n x n Matrix With an Equal Number of Rows and Columns
23:44
Diagonal: A Square Matrix Where All Entries OFF the Main Diagonal are '0'
24:07
Matrix Operations
24:37
Matrix Operations
24:38
Example
25:55
Example
25:56
Dot Product & Matrix Multiplication

41m 42s

Intro
0:00
Dot Product
1:04
Example of Dot Product
1:05
Matrix Multiplication
7:05
Definition
7:06
Example 1
12:26
Example 2
17:38
Matrices and Linear Systems
21:24
Matrices and Linear Systems
21:25
Example 1
29:56
Example 2
32:30
Summary
33:56
Dot Product of Two Vectors and Matrix Multiplication
33:57
Summary, cont.
35:06
Matrix Representations of Linear Systems
35:07
Examples
35:34
Examples
35:35
Properties of Matrix Operation

43m 17s

Intro
0:00
1:11
1:12
2:30
2:57
4:20
5:22
5:23
Properties of Multiplication
6:47
Properties of Multiplication: A
7:46
Properties of Multiplication: B
8:13
Properties of Multiplication: C
9:18
Example: Properties of Multiplication
9:35
Definitions and Properties (Multiplication)
14:02
Identity Matrix: n x n matrix
14:03
Let A Be a Matrix of m x n
15:23
Definitions and Properties (Multiplication)
18:36
Definitions and Properties (Multiplication)
18:37
Properties of Scalar Multiplication
22:54
Properties of Scalar Multiplication: A
23:39
Properties of Scalar Multiplication: B
24:04
Properties of Scalar Multiplication: C
24:29
Properties of Scalar Multiplication: D
24:48
Properties of the Transpose
25:30
Properties of the Transpose
25:31
Properties of the Transpose
30:28
Example
30:29
33:25
Let A, B, C, and D Be m x n Matrices
33:26
There is a Unique m x n Matrix, 0, Such That…
33:48
Unique Matrix D
34:17
Properties of Matrix Multiplication
34:58
Let A, B, and C Be Matrices of the Appropriate Size
34:59
Let A Be Square Matrix (n x n)
35:44
Properties of Scalar Multiplication
36:35
Let r and s Be Real Numbers, and A and B Matrices
36:36
Properties of the Transpose
37:10
Let r Be a Scalar, and A and B Matrices
37:12
Example
37:58
Example
37:59
Solutions of Linear Systems, Part 1

38m 14s

Intro
0:00
Reduced Row Echelon Form
0:29
An m x n Matrix is in Reduced Row Echelon Form If:
0:30
Reduced Row Echelon Form
2:58
Example: Reduced Row Echelon Form
2:59
Theorem
8:30
Every m x n Matrix is Row-Equivalent to a UNIQUE Matrix in Reduced Row Echelon Form
8:31
Systematic and Careful Example
10:02
Step 1
10:54
Step 2
11:33
Step 3
12:50
Step 4
14:02
Step 5
15:31
Step 6
17:28
Example
30:39
Find the Reduced Row Echelon Form of a Given m x n Matrix
30:40
Solutions of Linear Systems, Part II

28m 54s

Intro
0:00
Solutions of Linear Systems
0:11
Solutions of Linear Systems
0:13
Example I
3:25
Solve the Linear System 1
3:26
Solve the Linear System 2
14:31
Example II
17:41
Solve the Linear System 3
17:42
Solve the Linear System 4
20:17
Homogeneous Systems
21:54
Homogeneous Systems Overview
21:55
Theorem and Example
24:01
Inverse of a Matrix

40m 10s

Intro
0:00
Finding the Inverse of a Matrix
0:41
Finding the Inverse of a Matrix
0:42
Properties of Non-Singular Matrices
6:38
Practical Procedure
9:15
Step1
9:16
Step 2
10:10
Step 3
10:46
Example: Finding Inverse
12:50
Linear Systems and Inverses
17:01
Linear Systems and Inverses
17:02
Theorem and Example
21:15
Theorem
26:32
Theorem
26:33
List of Non-Singular Equivalences
28:37
Example: Does the Following System Have a Non-trivial Solution?
30:13
Example: Inverse of a Matrix
36:16
Section 2: Determinants
Determinants

21m 25s

Intro
0:00
Determinants
0:37
Introduction to Determinants
0:38
Example
6:12
Properties
9:00
Properties 1-5
9:01
Example
10:14
Properties, cont.
12:28
Properties 6 & 7
12:29
Example
14:14
Properties, cont.
18:34
Properties 8 & 9
18:35
Example
19:21
Cofactor Expansions

59m 31s

Intro
0:00
Cofactor Expansions and Their Application
0:42
Cofactor Expansions and Their Application
0:43
Example 1
3:52
Example 2
7:08
Evaluation of Determinants by Cofactor
9:38
Theorem
9:40
Example 1
11:41
Inverse of a Matrix by Cofactor
22:42
Inverse of a Matrix by Cofactor and Example
22:43
More Example
36:22
List of Non-Singular Equivalences
43:07
List of Non-Singular Equivalences
43:08
Example
44:38
Cramer's Rule
52:22
Introduction to Cramer's Rule and Example
52:23
Section 3: Vectors in Rn
Vectors in the Plane

46m 54s

Intro
0:00
Vectors in the Plane
0:38
Vectors in the Plane
0:39
Example 1
8:25
Example 2
15:23
19:33
19:34
Scalar Multiplication
24:08
Example
26:25
The Angle Between Two Vectors
29:33
The Angle Between Two Vectors
29:34
Example
33:54
Properties of the Dot Product and Unit Vectors
38:17
Properties of the Dot Product and Unit Vectors
38:18
Defining Unit Vectors
40:01
2 Very Important Unit Vectors
41:56
n-Vector

52m 44s

Intro
0:00
n-Vectors
0:58
4-Vector
0:59
7-Vector
1:50
2:43
Scalar Multiplication
3:37
Theorem: Part 1
4:24
Theorem: Part 2
11:38
Right and Left Handed Coordinate System
14:19
Projection of a Point Onto a Coordinate Line/Plane
17:20
Example
21:27
Cauchy-Schwarz Inequality
24:56
Triangle Inequality
36:29
Unit Vector
40:34
Vectors and Dot Products
44:23
Orthogonal Vectors
44:24
Cauchy-Schwarz Inequality
45:04
Triangle Inequality
45:21
Example 1
45:40
Example 2
48:16
Linear Transformation

48m 53s

Intro
0:00
Introduction to Linear Transformations
0:44
Introduction to Linear Transformations
0:45
Example 1
9:01
Example 2
11:33
Definition of Linear Mapping
14:13
Example 3
22:31
Example 4
26:07
Example 5
30:36
Examples
36:12
Projection Mapping
36:13
Images, Range, and Linear Mapping
38:33
Example of Linear Transformation
42:02
Linear Transformations, Part II

34m 8s

Intro
0:00
Linear Transformations
1:29
Linear Transformations
1:30
Theorem 1
7:15
Theorem 2
9:20
Example 1: Find L (-3, 4, 2)
11:17
Example 2: Is It Linear?
17:11
Theorem 3
25:57
Example 3: Finding the Standard Matrix
29:09
Lines and Planes

37m 54s

Intro
0:00
Lines and Plane
0:36
Example 1
0:37
Example 2
7:07
Lines in IR3
9:53
Parametric Equations
14:58
Example 3
17:26
Example 4
20:11
Planes in IR3
25:19
Example 5
31:12
Example 6
34:18
Section 4: Real Vector Spaces
Vector Spaces

42m 19s

Intro
0:00
Vector Spaces
3:43
Definition of Vector Spaces
3:44
Vector Spaces 1
5:19
Vector Spaces 2
9:34
Real Vector Space and Complex Vector Space
14:01
Example 1
15:59
Example 2
18:42
Examples
26:22
More Examples
26:23
Properties of Vector Spaces
32:53
Properties of Vector Spaces Overview
32:54
Property A
34:31
Property B
36:09
Property C
36:38
Property D
37:54
Property F
39:00
Subspaces

43m 37s

Intro
0:00
Subspaces
0:47
Defining Subspaces
0:48
Example 1
3:08
Example 2
3:49
Theorem
7:26
Example 3
9:11
Example 4
12:30
Example 5
16:05
Linear Combinations
23:27
Definition 1
23:28
Example 1
25:24
Definition 2
29:49
Example 2
31:34
Theorem
32:42
Example 3
34:00
Spanning Set for a Vector Space

33m 15s

Intro
0:00
A Spanning Set for a Vector Space
1:10
A Spanning Set for a Vector Space
1:11
Procedure to Check if a Set of Vectors Spans a Vector Space
3:38
Example 1
6:50
Example 2
14:28
Example 3
21:06
Example 4
22:15
Linear Independence

17m 20s

Intro
0:00
Linear Independence
0:32
Definition
0:39
Meaning
3:00
Procedure for Determining if a Given List of Vectors is Linear Independence or Linear Dependence
5:00
Example 1
7:21
Example 2
10:20
Basis & Dimension

31m 20s

Intro
0:00
Basis and Dimension
0:23
Definition
0:24
Example 1
3:30
Example 2: Part A
4:00
Example 2: Part B
6:53
Theorem 1
9:40
Theorem 2
11:32
Procedure for Finding a Subset of S that is a Basis for Span S
14:20
Example 3
16:38
Theorem 3
21:08
Example 4
25:27
Homogeneous Systems

24m 45s

Intro
0:00
Homogeneous Systems
0:51
Homogeneous Systems
0:52
Procedure for Finding a Basis for the Null Space of Ax = 0
2:56
Example 1
7:39
Example 2
18:03
Relationship Between Homogeneous and Non-Homogeneous Systems
19:47
Rank of a Matrix, Part I

35m 3s

Intro
0:00
Rank of a Matrix
1:47
Definition
1:48
Theorem 1
8:14
Example 1
9:38
Defining Row and Column Rank
16:53
If We Want a Basis for Span S Consisting of Vectors From S
22:00
If We want a Basis for Span S Consisting of Vectors Not Necessarily in S
24:07
Example 2: Part A
26:44
Example 2: Part B
32:10
Rank of a Matrix, Part II

29m 26s

Intro
0:00
Rank of a Matrix
0:17
Example 1: Part A
0:18
Example 1: Part B
5:58
Rank of a Matrix Review: Rows, Columns, and Row Rank
8:22
Procedure for Computing the Rank of a Matrix
14:36
Theorem 1: Rank + Nullity = n
16:19
Example 2
17:48
Rank & Singularity
20:09
Example 3
21:08
Theorem 2
23:25
List of Non-Singular Equivalences
24:24
List of Non-Singular Equivalences
24:25
Coordinates of a Vector

27m 3s

Intro
0:00
Coordinates of a Vector
1:07
Coordinates of a Vector
1:08
Example 1
8:35
Example 2
15:28
Example 3: Part A
19:15
Example 3: Part B
22:26
Change of Basis & Transition Matrices

33m 47s

Intro
0:00
Change of Basis & Transition Matrices
0:56
Change of Basis & Transition Matrices
0:57
Example 1
10:44
Example 2
20:44
Theorem
23:37
Example 3: Part A
26:21
Example 3: Part B
32:05
Orthonormal Bases in n-Space

32m 53s

Intro
0:00
Orthonormal Bases in n-Space
1:02
Orthonormal Bases in n-Space: Definition
1:03
Example 1
4:31
Theorem 1
6:55
Theorem 2
8:00
Theorem 3
9:04
Example 2
10:07
Theorem 2
13:54
Procedure for Constructing an O/N Basis
16:11
Example 3
21:42
Orthogonal Complements, Part I

21m 27s

Intro
0:00
Orthogonal Complements
0:19
Definition
0:20
Theorem 1
5:36
Example 1
6:58
Theorem 2
13:26
Theorem 3
15:06
Example 2
18:20
Orthogonal Complements, Part II

33m 49s

Intro
0:00
Relations Among the Four Fundamental Vector Spaces Associated with a Matrix A
2:16
Four Spaces Associated With A (If A is m x n)
2:17
Theorem
4:49
Example 1
7:17
Null Space and Column Space
10:48
Projections and Applications
16:50
Projections and Applications
16:51
Projection Illustration
21:00
Example 1
23:51
Projection Illustration Review
30:15
Section 5: Eigenvalues and Eigenvectors
Eigenvalues and Eigenvectors

38m 11s

Intro
0:00
Eigenvalues and Eigenvectors
0:38
Eigenvalues and Eigenvectors
0:39
Definition 1
3:30
Example 1
7:20
Example 2
10:19
Definition 2
21:15
Example 3
23:41
Theorem 1
26:32
Theorem 2
27:56
Example 4
29:14
Review
34:32
Similar Matrices & Diagonalization

29m 55s

Intro
0:00
Similar Matrices and Diagonalization
0:25
Definition 1
0:26
Example 1
2:00
Properties
3:38
Definition 2
4:57
Theorem 1
6:12
Example 3
9:37
Theorem 2
12:40
Example 4
19:12
Example 5
20:55
Procedure for Diagonalizing Matrix A: Step 1
24:21
Procedure for Diagonalizing Matrix A: Step 2
25:04
Procedure for Diagonalizing Matrix A: Step 3
25:38
Procedure for Diagonalizing Matrix A: Step 4
27:02
Diagonalization of Symmetric Matrices

30m 14s

Intro
0:00
Diagonalization of Symmetric Matrices
1:15
Diagonalization of Symmetric Matrices
1:16
Theorem 1
2:24
Theorem 2
3:27
Example 1
4:47
Definition 1
6:44
Example 2
8:15
Theorem 3
10:28
Theorem 4
12:31
Example 3
18:00
Section 6: Linear Transformations
Linear Mappings Revisited

24m 5s

Intro
0:00
Linear Mappings
2:08
Definition
2:09
Linear Operator
7:36
Projection
8:48
Dilation
9:40
Contraction
10:07
Reflection
10:26
Rotation
11:06
Example 1
13:00
Theorem 1
18:16
Theorem 2
19:20
Kernel and Range of a Linear Map, Part I

26m 38s

Intro
0:00
Kernel and Range of a Linear Map
0:28
Definition 1
0:29
Example 1
4:36
Example 2
8:12
Definition 2
10:34
Example 3
13:34
Theorem 1
16:01
Theorem 2
18:26
Definition 3
21:11
Theorem 3
24:28
Kernel and Range of a Linear Map, Part II

25m 54s

Intro
0:00
Kernel and Range of a Linear Map
1:39
Theorem 1
1:40
Example 1: Part A
2:32
Example 1: Part B
8:12
Example 1: Part C
13:11
Example 1: Part D
14:55
Theorem 2
16:50
Theorem 3
23:00
Matrix of a Linear Map

33m 21s

Intro
0:00
Matrix of a Linear Map
0:11
Theorem 1
1:24
Procedure for Computing to Matrix: Step 1
7:10
Procedure for Computing to Matrix: Step 2
8:58
Procedure for Computing to Matrix: Step 3
9:50
Matrix of a Linear Map: Property
10:41
Example 1
14:07
Example 2
18:12
Example 3
24:31

• ## Related Books

### Dot Product & Matrix Multiplication

Lecture Slides are screen-captured images of important points in the lecture. Students can download and print out these lecture slide images to do practice problems as well as take notes while watching the lecture.

• Intro 0:00
• Dot Product 1:04
• Example of Dot Product
• Matrix Multiplication 7:05
• Definition
• Example 1
• Example 2
• Matrices and Linear Systems 21:24
• Matrices and Linear Systems
• Example 1
• Example 2
• Summary 33:56
• Dot Product of Two Vectors and Matrix Multiplication
• Summary, cont. 35:06
• Matrix Representations of Linear Systems
• Examples 35:34
• Examples

### Transcription: Dot Product & Matrix Multiplication

Welcome back to linear algebra, so we have talked about linear systems, we have talked about matrix addition, we have talked about scalar multiplication, things like transpose, diagonal matrices.0000

Now we are going to talk about dot product and matrix multiplication, so matrix multiplication is not numerical multiplication, yes it does involve not just standard multiplying of numbers, but it's handled differently.0011

And one of the things that you are going to notice about this is that matrix multiplication does not commute.0028

In other words, I know that 5 times 6 = 6 times 5, I can do the multiplication in any order and it ends up being 30.0035

However if I take the matrix A and multiply by a matrix B, it's actually not the same as the matrix B multiplied by A.0041

It might be, but there is no guarantee that it will be, and in fact most of the time it won't be, so that's the one thing that's actually different about matrices and then numbers.0049

Le's just jump in, get started and see what we can do, okay.0058

Let's go ahead and start with a definition and this is going to be our definition of dot product, which is going to be very important and it shows up in all areas of science., so we will let...0065

... equal, A1, A2, A3, let me erase this A3 and just use ... all the way to AN.0083

And B = B1, B2..... BN, okay so let me just explain what these notations means here.0102

Whenever we see a normally a lowercase letters a, b, c, d, x we will often use x with an arrow on top, that means it's a vector, and a vector is just a list of numbers.0116

A1, A2 all the way to AN in this particular case we are talking about an N vector, which means it has N entries, so 5 vector would have 5 entries.0131

An example might be, let's say the vector V might be 1, 3, 7, 6, that's all this means, this is the vector in these the components of that vector.0140

It's composed of (1, 3, 7, 6), it's a four vector, because it has four entries in it, that's all this notation means, this is just a generalized version of it.0153

Okay, so let A, the vector A = A1 to An, let the vector B = B1 through BN, now we defines something called the dot product as the following, A.B.0163

The product of two vectors is equal to A1 times B1 + A2 times B2 + ... +AnBn and I am going to write this in σ notation.0180

σ notation, I'll explain in just a minute, if you guys haven't seen it, I am sure you have, but you just, I know that you don't deal with it all too often.0196

Okay, so if the vector A is composed of A1 through AN, B is the list, B1 through BN, the dot product A.B = the product of the corresponding entries added together.0205

When I add these together, I end up with a number, so the dot product of two vectors gives me a scalar; it gives me a number, so I just add them all up.0222

This σ notation is the capital Greek letter S, and stands for sum, and it says take the sum of the Ith entry of A, the Ith entry of B.0233

Multiply them together and add them, so A1B1, 1I = 1, and then go to the next one, I = 2 + A2B2 abd then go to I = 3 + A3B3.0246

This is just a short hand notation for this, we won't deal with σ notation all that much, what end our definitions, whatever we do I'll usually write this explicitly.0260

I just want you to be aware that in your book, you'll probably see this; you'll definitely see it in the future.0270

That's all this means, it's a short hand notation for a very long sum, so don't let the symbolism intimidate you, scare you, confuse you, anything like that, it's very simple.0275

Okay, let's just do an example of a dot product and everything should make sense, so example; we will let...0285

... Vector A = (1, 2, -3 and 4), so this is a four vector, and will let B = (-2, 3, 2, 1), notice I wrote one of them in row form, one of them in column form.0298

This is also a four vector because we have four entries, I wrote it this way because in a minute when we talk about matrix multiplication, it's going to make sense, it will make sense why it is that I wrote it this way, but just for now understand that there is no real difference between these two.0319

I could have written this as a column, I could have written this as a row, it's just a question of corresponding entries.0335

But I did like this because in a minute when we do matrix multiplication, symbolically, its going to help make sense when you move your fingers across a row and down a column, just sort of keep things straight, because matrix multiplication, there is lot, a of lot of arithmetic involved.0340

Okay, so our dot product A.B here, A.B, we just go back to our definition, it says take corresponding entries and just multiply it together, that's you got to do,0356

I take A1 times B1, so which is 1 times -2, which is -2 + 2 times 3, which is 6 + -3 times 2, which is -6...0370

... + 4 times 1, which is 4.0392

Well, that equals, so the 6 is cancelled, -2 + 4 gives me a 2, so I have a vector of 4 vector, times of 4 vector and I end up with a number 2.0396

The dot product of two vectors is a scalar, and all I am doing is multiplying corresponding entries and adding them all up, that's it simple arithmetic, nice and easy, no worries.0408

Let's go ahead and move forward now on to matrix multiplication, okay.0423

Let me go ahead and write down the definition of matrix multiplication and then we wi do some examples.0429

We will let A = that matrix A IJ, B...0439

... M by P, so this is an M by P, be 3 by 2.0448

Let B be the IJth P...0458

P by N, so A is M by P and B is P by N, notice that the number of columns of the matrix A equal to the number of rows of the matrix B, that's going to be very important.0468

Then AB is the...0482

... M by N matrix.0493

C equals C IJ, such that the IJth entry of C is equal to Row I of A.0498

In other words, the Ith row of A dotted with the Jth column of B.0517

let's take a look at the definition again, A is a matrix, A IJ, it is M by P, B is a matrix, B IJ is P by N.0526

when I multiply those two matrices the, essentially what happens is that the column of the first matrix, the one on the left cancels the column accounts with the row of the matrix on the right an what you end up with is a matrix which is M by N.0536

And that matrix is such that the IJth entry = Ith of A dot end with the Jth column of B, that's why this P and this P have to be the same.0554

In order to multiply two matrices, let's write this one out specifically, okay.0573

In order to multiply two matrices....0581

... The number of columns of the first...0596

... Must equal...0603

... The number of rows of the second and that's what this says M by P, P by N, the number of columns of the first has to equal the number of rows.0611

That's the only way that matrix multiplication is defined and what we mean when we say is defined, means if they are not the same, you can't do the multiplication.0623

That's what defined means, it's the only way you can do it if that's the case, okay.0632

let's see what we have got, so for example if I have a 2 by 3 matrix and I want to multiply it by a 3 by 2 matrix, yes I can do that because the number of columns of the first one is equal to the number of columns of the second one, and essentially they go away.0639

What I am left with is the final matrix which is 2 by 2, this is kind of interesting.0661

Now notice if I reverse them and if I did a 3 by 2 matrix, and if I multiply that by a 3 by 2 matrix, I am sorry 2 by 3...0666

... Now, it is defined, number of columns of the first equals the number of rows of the second, so now I end up with a 3 by 3 matrix, okay.0686

These are all defined, that will work.0698

Let's see 2 by 3, 3 by 2, 3 y 2, 2 by 3, so notice what's happened here, take a quick look, I have a 2 by 3 times the 3 by 2 gives me a 2 by 2.0703

If I switch these, a 3 by 2 by a 2 by 3 I'll let them switch them, I get a 3 by 3, a 3 by 3 and a 2 by 2 are not the same.0714

In general not only do the dimensions not match, it won’t work, AB is not equal to BA, that’s the take on lesson for this, matrix multiplication does not commute.0725

AB does not equal BA, and we will actually do an example later on where we can actually do AB and BA, but they end up being completely different matrices.0737

Okay, let's do some examples, let's let A = (1, 2, -1, 3, 1, 4) when doing much matrix multiplication goes very slowly and go systematically.0747

Lot of arithmetic, lots of room for mistake, (-2, 5, 4, -3, 2, 1) okay.0767

We said that the IJth entry = Ith row of A times the Jth column of B, well we are looking at here, A, let me use black, this is a 2 by 3, 2 by 3 matrix and this is a 3 by 2.0779

Yes, it is defined because this 3 and this 3 are the same, so we should end up with a 2 by 2 matrix, okay.0799

Lets go ahead and put little thing here for our 2 by 2 matrix, now for our...0810

.. This, the first row first column, this entry it's going to equal the first row of A dotted with the first column of B, so it's going to be that row and that column, so I take 1 times -2.0820

Let me actually write over here or let's call this the, so now we are doing the A11 entry, this one right up here, A11 entry equals 1 times -2, which is -2, 2 times 4 which is 8, -1 times 2, -2.0838

-2 - 2 + 8, answer should be 4, so 4 goes there.0861

Now let's do this entry which is the first row, second column, well the first row, second column means I take the dot product of the first row of A and the second column.0870

A12 Entry = 1 times 5, which is 5, 2 times -3, which is -6, -1 times 1, which is -1.0882

That means, let's try this again without these little extra lines, 1 times 5 is 5, 2 times -3 is -6, -1 times 1, -1.0895

5 - 6 is -1, -2, so this becomes -2, now we are going to go to the second row, first column, which means we do second row first column.0909

This is A21, 3 times -2 is -6, 1 times 4 is 4, 4 times 2 is 8, so 8 + 4 is 12 - 6 is 6, so this entry is 6.0922

And now we have our last entry which is the 2,2, so the 2,2 entry, second row, second column, which means we dot product the second row with the second column, second row of A, second column of B.0941

3 times 5 is 15, 1 times -3 is -3, 4 times, oops, that's nice.0955

4 times, is that a -1, I don’t even know, no that's 1...0972

4 times 1, is 4, so we get 15 + 4,., which is 19, 19 - 2 is 16, so this entry is 6.0983

The product so, AB = 4 - 2, 6, 16, 2 by 3 matrix multiplied by a 3 by 2 matrix gives us a 2 by 2 matrix, and we get that by this row this column, this row this column, and then this row this column, this row this column.0996

That's all you are doing, rows and columns, now you know why I arranged it, remember a little bit back when we did dot product, I arranged it, the first one horizontally and the other one vertically.1021

This is the reason why, because when we multiply, we are doing this times that, this times that, this times that, we can move one this way, one this way, it seems sort of, it's a way to keep things separate, as one hand, one finger moves across a row.1031

The other finger should move down a column as used to going this way or this way., okay.1047

Lets do another example here, we will...1058

... Okay, let A equal, this is going to be a 3 by 3, so it's 1(1, -2, 3, 4, 2, 1, 0, 1, -2)1066

And B is equal to, let's make it a 3 by 2, so this is a 3 by 3, and then we have (1, 4, 3, -1, -2, and 2) , so this is a 3 by 2, so AB.1084

A times be is defined, so AB is defined and it's going to be well, 3 goes away, the 2 inside 1's, so we are left with a 3 by 2, so AB is a 3 by 2 matrix.1105

Okay, well let's just multiply it out, this time we are not going to write everything out we are just going to do the multiplication and keep it straight, they are final numbers.1121

We know that we are looking for a 3 by 2, so let's just start putting in entries, well the first entry; first row first column is going to be first row first column.1131

1 times 1 is 1, -2 times so 1 times, that's 1, -6 is going to be a -5, and then -6 is going to be -11.1142

This is going to be -11, there and now we are going to do the second entry, okay, first row second column, which means first row of A, second column.1161

One times 4 is 4, -2 times -1 is 2, 4 + 2 is 6, and then 3 times 2 is 6, that becomes 12.1172

When we continue ion this way, we end up with 8, we end up with 16, we end up with 7, we end up with -5, that's our AB.1185

Okay, now let's try something.1196

Let's let A =(1, 2, -1, 3) and we will let B = (12, 1, 0, 1) in this case, because this is 2 by 2, and because this is 2 by 2, both AB and BA, they are both defined.1203

I can do the multiplication, well let's do the multiplication and see if AB = BA.1224

There are two ways that you can, there are certain demonstrate non-commutivity, is if the dimensions don't match when you switch them or if it's defined, multiplication is defined and doable this way and that way.1229

Then you might end up with different matrices, again proving that it doesn't commute, alright.1246

Let's see what we have got, when we do AB, okay we end with the following, we end up with (2, 3, -2, 2) and when we do BA, we said it is defined.1252

We end up with (1, 7, -1, 3).1266

AB and BA are not the same, AB is not equal to BA, matrix multiplication does not commute.1271

Okay, so now let's talk about matrices and linear systems, so we introduced linear systems in our first lesson, we talked about matrices in our second, and we have just introduced matrix multiplication.1283

Now let's combine them together to see if we can take a matrix and represent it as a linear system, or a linear system and represent it in matrix form.1297

Let's let me go back to blue here, we will let, excuse me, A = A11, A12, A13, A21, A22, A23, A31, A32, A33.1307

And we will let X with the little line, the vector be our vector, let's call it X1, X2, X3, this is the vector formulation, this is the component form, it's just a 3 vector.1332

Okay, so this is a, we can do this in red, this is a 3 by 3 matrix, and this is a 3 by 1, right, so if I multiply this matrix by that vector X, well it's just a 3 by 3 times a 3 by 1.1346

Well those are the same, so I end up with a 3 by 1, it is defined and it's going to equal some vector b, which is going to be a 3 by 1 vector, just something with 3 entries in it.1366

And let's let B therefore equal, we will call it B1, B2, B3, so again we have a matrix.1383

We have this 3 vector, I can multiply them because matrix multiplication is defined, their answer is going to be a 3 vector, so we will call that 3 vector B, and will call it's components B1, B2, B3.1394

Okay, well let's actually do the multiplication here, so A1 X, I am sorry, AX.1407

When i do this multiplication, this row, this column, this row, this column, this row, this column.1415

Here is what I get, A11 times X1 + A12 times X2 + A13 times X 3, that's what I get, that's the multiplication.1423

A11 X1 + A12 X2 + A13 X3, and then I do this second row, that column again, I get A21 X1 + A22 X2 + A2 X3.1435

And then I will do the third row, which is A33 X1 + A32 X2 + A33 X3, that's going to be my matrix.1455

That's my actual matrix multiplication; well I know that equals this B, so I write B1, B2, and B3.1469

Well, this thing = this thing, this thing = equals this thing, this thing = this thing, that's what this says, this is just a 3 by 1 in its most expanded form.1481

That's the A times the X, this thing is the B, that are equals, and so now I am just going to set corresponding entries equal to each other, this whole thing is equal to that.1491

I write A11 X1 + A12 X2 + A13 X3 = B1.1500

A21 X1 + A22 X2 + A23 X3 = B2, and I am sorry that I have got extra little lines here that are showing up.1514

Try to spread a little bit slower, A31 X1 + A32 X2 + A33 X3 = B3.1528

Well take a look at this, this is just a linear system, that's it, it's just a linear system, you have seen this before.1544

This is three equations in three variables...1554

...X1, X2, X3, X1, X2, X3, X1, X2, X3, these A11 's A2, all of these are coefficients and these are the actual solutions.1561

You can actually write a linear system as a matrix, so it looks like A11, A12, A13, this is the coefficient, the matrix of coefficients for the linear system.1581

A21, A22, A23, A31, A32, A33, and then you multiply it by the variables, which are X1, X2, X3, and it equals B1, B2, B3.1602

We can take a linear system and represent it in matrix form; we take the matrix of coefficients, so this is the coefficient matrix.1626

M by N in this case is 3 by 3m, but it can be anything, this is the matrix of variables, it's the variable matrix, and it's always going to be some N vector.1640

And this is just the you might call the solution matrix, it's not really the solution matrix, the solution matrix is once you find X1, X2, X3, those are going to be your solutions, so you know what let's not even give this a name, let's just say this happens to be the, whatever it is.1657

It's the B that makes up linear system on the right side of the equality, okay now given this; we can actually form as it turns out.1678

We can form a special matrix...1692

... If we attach...1701

... B1, B2, B3 to the coefficient matrix...1709

... Okay, now we are going to write this out one more time, so I am going to take this thing and I am going to add up another column to this matrix.1723

I end up with, (A11, A12, A13), B1, (A21, A22, A23), B2, (A31, A32, A33) B3.1732

And sometimes we put like a little dotted line there, just to let you know that this is, and this is called an augmented matrix.1752

All I have done is I have augmented my coefficient matrix with my solutions on the right for the linear system, and we do separate it.1759

Sometimes you can see a solid, I tend to put a solid line, that's just my personal preference, some people don't put anything at all, again it's, it's completely up to you.1770

Therefore any linear system can be represented in matrix form and vice versa, any matrix with more than one column can be thought of as forming a linear system.1780

Let's see what we have here, example -2X as a system -2X + 0Y + Z = 5, and then we have 2X + 3Y -4Z =7.1796

We have 3X + 2Y + 2Z = 3, so this is our linear system and now let's break it up and in matrix form, so we want to write it this way, AX = B, this is the matrix representation.1821

A matrix A times a vector B gives us a vector B, so A the matrix A is going to be the coefficients, it' going to be , excuse me, the 2, the 0, the 1, the 2, the 3, the -4, the 3, the 2, the 2.1842

(-2, 0, 1, 2, 3, -4, 3, 2, 2) that’s our coefficient matrix, X let me do this in red, oops.1861

X is going to be our variables, our variables happen to be X, Y and Z, that's going to be X, Y, and Z, and B, let me go back to red, B vector is going to be (5, 7, 3).1881

That's it, you can represent, now we will do the augmented matrix, which means take the coefficient matrix and add this to it, so we end up with A augment with B, symbolized like that.1903

It is equal to (-2, 0, 1, 5) and I'll go ahead and do a solid line, because I like solid lines.1918

(2, 3, -4, 3, 2, 2), you have your coefficient matrix and you have your matrix that represents the linear system, that was originally given to you like that.1928

Now, let's see, now let's go the other way, let's say we have a matrix, (2, -1, 3, 4, 3, 0, 2, 5) let's say you are given this particular matrix, this particular matrix actually can represent a linear system.1946

We could take a linear system, represent it in matrix form, which we just did, we can take a matrix and represent it as a linear system, if we need to.1977

This ends up being, so let's say that this is the augmented matrix, so that means this is (1, 2, 3), that means we have 3 variables, that's what the column represent are the variables, and these are the equations.1986

We have 2X - 1Y + 3Z = 4, and then 3X + 0Y + 2Z = 5.2001

Linear system, matrix form, matrix represent a linear system.2023

Excuse me,, there you go, okay now let's talk about what we did today, recap our lesson.2030

We talked about the dot product of two vectors and a vector is just an N by 1 matrix, either as a column or row, it doesn't really matter.2042

What you do is you multiply the corresponding entries in the two vectors and you add up the total.2051

The dot product gives you a single number, a scalar, it's also called the scalar product, so dot product, scalar product, as you go on in mathematics you will actually refer to it as a scalar product not necessarily an dot product.2056

After that we talked about matrix multiplication where we actually invoke the dot product, so with matrix multiplication you can only multiply two matrices if the number of columns in the first matches the number of rows in the second.2070

Matrix multiplication does not commute, in other words A times B does not equal B times A in general.2084

It might happen accidentally, but it's not true in general.2091

The IJth entry in the product is the dot product of the Ith row of the first and the Jth column of the next.2095

Okay, now matrix representations of linear systems, any linear systems of equations can be represented as an augmented matrix, you take the matrix of coefficients and you add the column of solutions.2107

Any matrix with more than one column can represent a linear system of equations, that last column is going to be your solutions, that's the augment.2122

Okay, so let's do one more example here, so we will let A = (3, 5, 2, 4, 9, 2, excuse me.2134

And B = (1, 0, 1, 6), oh she knows, (2, 1, 3, 7) so here we have a 3 by 2 matrix and here we have a 2 by 4 matrix.2153

Yes, the 2's on the inside are the same, they end p cancelling and it's going to end up giving up a 3 by 4 matrix, so we are left with 2 outside.2172

We are going to be looking for a matrix which is 3 by 4, this is kind of interesting if you think about it, 3 by 2, 2by 4, now you get a 3 by 4, you get something that's bigger than both in some sense, okay.2182

AB equal to, well we take the first row and first column, 3 times 1 + 5 times 2, 3 times 1 is 3, 5 times 2 is 10, you end up with 13, first row, second column.2195

Well you take the first row, dot product of the second column, 3 times 0 is 0, 5 times 1 is 5, so you end you with 5., then you keep going.2214

you end up (18, 53, 8, 4, 14, 40, 13, 2, 15 and 69), so our product AB = this matrix.2224

Notice 8 times B is defined if I did B times A, well B times is equal to a 2 by 4 times the 3 by 2.2243

This 4 and this 3 aren't equal, BA is not even defined, we can't even do the multiplication, leave alone and find out whether it equals or not, which in general it doesn't, so in this case it's not even defined.2256

It only works when A and B are such that A is on the left of B, B is on the right of A, and they will often say that, we will often say in linear algebra, multiply by this on the left, multiply by this on the right.2267

We don't do that with numbers, we just say multiply the numbers, okay now let's let the variable that's the X, the vector = X, Y and Z and let's let the vector Z = (4, 2, 9).2279

Now we want to express...2300

.. Well actually we don't want it, let's go ahead...2308

... We want to express AX = Z as a linear system and as an augmenting matrix, both, so we have a matrix A, that's this one; we have a matrix X, we have a matrix Z.2314

We want to express AX = Z as a linear system in augmented matrix, okay, we’ll wait a minute, let's try it to bring it, it works.2332

We can't even do, this is, this has 3 and 2, so this can be XYZ, this is going to have to be XY, my apologies.2346

XY, there we go, because this is 3 by 2, this is 2 by 1, yes we want them at, the multiplication to be defined, so we end up with (3, 5, 2, 4, 9, 2)...2356

... Times XY = (4, 2, 9) so you end up with, well 3X + 5Y = 4.2375

3X + 5Y = 4, because you are doing the first row, first entry, first row first column, 2X + 4Y, 2X + 4Y = 2.2392

And 9X + 2Y, 9X + 2Y = (, all we have done is go this times that, equals that, this times that equals that, this times that equals that.2409

And we end up with our linear system, now we want to convert that to an augmented matrix; well we take 3, 2, 9, (3, 2, 9, 5, 4, 2).2422

I'll start coefficient matrix, right, and we have augmented with our solution matrix 4, 2, 9, (4, 2, 9).2438

That's all we have done AB, A times B, it is defined, we can find the multiplication.2451

We can take given X and given Z, this is a two vector, this is a three vector, we can take AXC represented as a linear system.2459

We express it this way, we do the matrix multiplication, we said corresponding things equal to each other, and we have actually converted this to a linear system.2469

This and this are equivalent, we can take this linear system and express it completely just as a matrix, an augmented matrix by adding the solutions as the augment on the right, and we end up with that.2477

Okay, thank you for joining us today for linear algebra, and our discussion of dot products and matrix multiplication on linear systems.2493

Thank you for joining us at educator.com, we will see you next time, bye, bye.2499

OR

### Start Learning Now

Our free lessons will get you started (Adobe Flash® required).