Summary  
This chapter demonstrates how to compute a matrix’s singular value decomposition, reconstruct it from its singular values, and apply truncation for dimensionality reduction.

General domain of usage  
Dimensionality reduction

Singular Value Decomposition, or **SVD**, is a powerful matrix factorization technique that plays a fundamental role in data science and signal processing. With SVD, you can break down any real or complex matrix into three distinct matrices, revealing important structure in your data. Applications of SVD include noise reduction in signals, collaborative filtering in recommendation systems, topic modeling in natural language processing, and, most commonly, dimensionality reduction for large datasets. By understanding SVD, you gain a versatile tool for extracting features, compressing information, and improving the efficiency of your data workflows.

import numpy as np
from scipy.linalg import svd

# Create a sample matrix
A = np.array([[3, 1, 1], 
              [-1, 3, 1]])

# Compute the Singular Value Decomposition
U, s, VT = svd(A)

print("U matrix:\n", U)
print("Singular values:", s)
print("VT matrix:\n", VT)

import numpy as np
from scipy.linalg import svd

# Original matrix
A = np.array([[3, 1, 1], 
              [-1, 3, 1]])

# Full SVD
U, s, VT = svd(A)

# Reconstruct the original matrix from all singular values
S_full = np.zeros((U.shape[1], VT.shape[0]))
np.fill_diagonal(S_full, s)
A_reconstructed = np.dot(U, np.dot(S_full, VT))
print("Reconstructed matrix (all singular values):\n", A_reconstructed)

# Truncate to keep only the largest singular value
S_truncated = np.zeros_like(S_full)
S_truncated[0, 0] = s[0]
A_truncated = np.dot(U, np.dot(S_truncated, VT))
print("Reconstructed matrix (truncated):\n", A_truncated)


SVD is especially valuable for **dimensionality reduction**. By keeping only the largest singular values and their corresponding vectors, you can approximate the original matrix with far fewer dimensions. This process removes noise and redundant information, making your data easier to visualize and process while retaining its most important features. In practical terms, this means you can compress datasets, speed up machine learning algorithms, and uncover the underlying structure of your data.

What are the three matrices produced by SVD?

How can SVD be used for data compression?

Which SciPy function is used for singular value decomposition?

A comprehensive course designed for students with strong math backgrounds and intermediate to advanced Python skills, focusing on leveraging SciPy for scientific computing, optimization, integration, and advanced mathematical operations.

Explore the structure, core modules, and essential features of SciPy for scientific computing.

Dive into SciPy's powerful linear algebra capabilities for solving real-world mathematical problems.

Master optimization techniques and root-finding algorithms using SciPy for scientific and engineering problems.

Explore advanced mathematical operations including integration, interpolation, and basic signal processing with SciPy.

Singular Value Decomposition (SVD)

1. What are the three matrices produced by SVD?

2. How can SVD be used for data compression?

3. Which SciPy function is used for singular value decomposition?