Pick up a good used pre-amp with headphone jack off ebay. Something like the NAD 1130. Very clean headphone output that matches up well with both high and low impedance headphones. They can be had for as low as $50. It'll also provide you with an excellent phono stage if you are still into vinyl.

Jeff Mackwood