Expanding slightly on Altec's answer.

You will still reap the benefits of differential design as the input circuitry takes the input signal from the RCA connector and after appropriate buffering inverts it and feeds the original to one half of the amp and the inverted signal to the other half. The amp will still function as designed.