Why Covariance Stays Positive

For any real matrix XX (data matrix, rows = samples), the matrix X⊤XX^\top X is always symmetric positive semi-definite. Why?

A

Because covariance matrices are always diagonal

B

Because eigenvalues of X are always real

C

For any vector z, z⊤(X⊤X)z=∥Xz∥2z^\top(X^\top X)z = |Xz|^2 which is always ≥0\geq 0

D

Because X itself is always positive semi-definite

E

Because X⊤XX^\top X always has determinant 1