I've made a graveyard playlist. The songs that always get skipped will be moved to this separate playlist, that way they are still there but at the same time, not there.
I aaaalways skip the first song in the playlist because only then the shuffle kicks in...can't delete that first song though or I'll just get bored/hate the next one.
It would be nice if Spotify had a way to search for the song in your playlist so you can remove it or transplant it to a graveyard playlist. It's easier to skip the task than scroll and scroll searching for it.