Is it safe to enter my SOCIAL SECURITY NUMBER on the phone?

i have a checking acccount at sovereign bank (machusetts) and i call their automated banking service at 877-SOV-BANK. i need to enter my social security number to access my account information. is that safe to do (i do this just about every day)? is it easy for unauthorized people to gain access to this information?