Not really in modern amps. The difference between 800 and 400 will be swamped by the wire in almost all cases.

For reference, a damping factor of 800 with 25 feet of #12 wire will result in an effective damping factor of about 89, whereas a damping factor of 400 with the same wire will result in a damping factor of about 80.

Bump it to 100 and it's STILL a net DF of 50 I think. And as you note, after a point higher DF is paid for pretty dearly.

Check my math, but I'm pretty sure that's in the right ballpark.