I'm like this too. Unless it's obvious I'm taking photos of my dog, I feel really weird about it. I like taking photos of random things I find interesting or pleasing to look at while we're out for walks. Like a random forgotten plushie, or a nice tree, or the lake, or a rock, or a stump. Anything really. If there's people around though, I tend to not pull my phone out because it feels invasive.
I think the most impressive thing about them is that they're just "point and shoot" photos with my phone. I'm not a photographer, but it's easy for me as just a regular user to take photos that are decent enough to have printed and framed. It's even more fun to see what actual photographers, who master technique and have an eye for subjects do.
I don't worry that people will think I'm creeping on them, but I worry that they'll find out what I'm taking a picture of and either be weirded out or laugh at me. I don't know why that bothers me because I wouldn't care if it actually happened.
Anticipation is its own thing. Anticipation of travel is the main reason I never travel. I'm rarely bothered by the actual journey; I just don't want to have it hanging over me.