I understand your sentiment but don't you think they would do the world more good in an exhibit or museum that explains the cultural context? Those who forget are doomed etc.
Generally I would say yes but a lot of confederate monuments were made after the war so aren't so much history but an attempt to rewrite it to make themselves look more favorable.
Robert E Lee statues exist despite Lee stating he believes no statues of the Confederacy should be built and all should be torn down, as historically he recognized that it only sows division and takes a country longer to heal from.
All such statues (especially of him) would clearly be an act to not allow the country to heal quickly.
Personally that feels like a slippery slope to me. I agree destroying history just because it has become distasteful is not a good solution. At the same time museum context is not always as good as it should be. It is often written by someone who doesn't have any personal experience.