Why Shouldn't I Invert That Matrix?