I have my location turned off for everything and keep mine in a Faraday bag. That said, there was one tip in this article I wasn't aware of: deleting my advertising ID, so everyone should read it and see if you can't improve your own privacy.
It feels good when I have to use it and, for a moment it says "no service", like kicking the tech assholes in the dick.
You won't, it's a conscious trade off. Some people never put a sim or esim in their phone and have a separate dumb phone for calls, or separate hotspot