The RF coax output (the "cable TV") will carry audio and video. You should be able to connect that to the coax antenna input on your TV and use the TV's speakers for sound from the VCR. I'd avoid a splitter in the audio if I could.
------------------
Gonk