I have used this speaker switch before:

http://www.monstercable.com/home_av/audio_cables/speaker_switchers.asp

sounds ok, with no problems