Matrix Fundamentals

Matrices are central objects in linear algebra, representing collections of numbers arranged in a rectangular grid. A matrix is defined by its dimensions: the number of rows (horizontal lines) and columns (vertical lines). For instance, a matrix with 2 rows and 3 columns is called a "2 by 3" matrix, written as $2×3$.

Matrices can be categorized by their structure:

• Row matrix: a matrix with only one row: $$\begin{bmatrix}1&2&3\end{bmatrix}$$
• Column matrix: a matrix with only one column: $$\begin{bmatrix}1\\2\\3\end{bmatrix}$$
• Square matrix: a matrix with the same number of rows and columns: $$\begin{bmatrix}1&2&3\\4&5&6\\7&8&9\end{bmatrix}$$
• Zero matrix: a matrix in which every entry is zero: $$\begin{bmatrix}0&0&0\\0&0&0\\0&0&0\end{bmatrix}$$
• Identity matrix: a special square matrix with ones on the main diagonal (from top-left to bottom-right) and zeros elsewhere: $$\begin{bmatrix}1&0&0\\0&1&0\\0&0&1\end{bmatrix}$$

Understanding these types is crucial because different matrix types have unique properties and uses. For example, identity matrices act as multiplicative identities, much like the number 1 does for real numbers.

The code above demonstrates how to represent matrices as nested lists in Python and perform basic operations. Element-wise addition is carried out by adding corresponding elements from two matrices of the same dimensions, while scalar multiplication multiplies each element of a matrix by the same number.

Matrix operations are stricter than vector operations in terms of shape: you can only add matrices if they have the same number of rows and columns. Attempting to add or multiply matrices of incompatible sizes leads to errors. Unlike vectors, matrices involve two indices (row and column), so it is easy to confuse positions or mix up dimensions. Always double-check matrix shapes before performing operations to avoid common pitfalls.