Well I used to all the time, that's for sure. Plus I actually have nice headphones now, that I can't use with my phone because for some reason on every single phone I've ever owned the USB port eventually stops working for audio adapters, and I don't know why.
I do have a wireless charger, but when the audio inevitably stops working, charging is still always fine. I've barely even used the port on this phone, but the audio cord in my car just quit the other day.