Determines if a matrix is approximately special orthogonal.

A matrix is special orthogonal if it is square and real and its transpose is its inverse and its determinant is one.

matrix The matrix to check.
rtol The per-matrix-entry relative tolerance on equality.
atol The per-matrix-entry absolute tolerance on equality.

Whether the matrix is special orthogonal within the given tolerance.