I definitely have issues with the episodes where they decide it's better to let civilisations die than interfere, if it were up to me they'd be retconned away or at least rewritten.
But in general I think it's a good idea, including not interfering with the politics of other space-faring civiliations. The Federation respects life but it also respects culture. The prime directive relates to the latter. Having the development of warp technology as the cutoff point for no interactions at all kind of makes sense since it allows those societies to develop a unique culture of their own. Letting civilisations die is silly, having a slightly interfered-with culture is better than no culture at all, unless perhaps the people within that culture would rather it die.
I see the prime directive as a way to prevent imperialism. Being on good terms with other cultures is one thing, but being on good terms because you've interfered means something intangible has been lost about their society and culture.
I also consider the fact that everyone thinks they themselves are the "good guys", even people who do bad things. If the Federation just abandoned the prime directive every time they thought "oh it's the moral thing to do this time" then they may as well not have the prime directive at all.
Think about it this way: you come across a society that believes in sacrificing innocent people to the gods. Is it okay to interfere to prevent the loss of life? But what if it was the other way around and you were the smaller civlisation and a large empire that believes in sacrifices finds it abhorrent that you don't sacrifice anyone, and tries to force that culture on you?
I'm not equating not-sacrificing and yes-sacrificing as moral equals, that's just an example to demonstrate that the action of the interference by a larger society could be dangerous. If we interfere because it's "the right thing to do" we run the risk that in a couple of hundred years' time our own culture has progressed to the point where we consider our previous beliefs to be wrong and that it was wrong to force smaller cultures to adopt them. I'm sure you can find examples by looking at real life empires vs. what the modern versions of those countries now believe.