In general, I think it's always better to minimize *any* amount of conversions to an audio/video signal. There's always the chance that signal quality will degrade. (I still even have my doubts as to how well upsampling say, 16/44.1 LPCM to 24/192 can be done. "Upsampling" isn't the problem, it's the "re-sampling" from 44.1 to 48 or from 177.6 to 192 kHz where the problem comes in, for example.)

And especially when any type of PCM format is involved, where jitter *does* come into play.