Well ... Since I'm too cheap to buy TV EARS, I decided to connect my amp to my TV and plug my headphones into the audio out jack. This way I can get audio through the TV and headphones simultaneously, if I'm w/ friends. I also had issues watching Downton Abbey, so watched it all on my computer. Maybe when the new season airs I will try to watch it w/ using the headphone solution.
Probably not the best solution (hopefully it doesn't cause hearing damage), but I don't watch much TV anyways.
For those of you that are tech savvy, the Roku 3 streaming box has a remote control with a built in audio jack too. However, I think it cancels the audio coming from the TV, so it probably works best when you're alone. It's a great device that plays Netflix, Amazon Prime Video, HBO, among others. It also has a great free app called PLEX that streams local content from your computer.