I find that insulting to the cultures and people who have used it for a thousand years and continue to do so. I'd rather be pedantic than dismissive of their much older beliefs.
A Nazi swastika is tilted at 45°, and points to the right (though the one in this cake could point either direction depending on which side you're looking at).
A swastika in this style is a religious symbol used in many eastern faiths and belief systems, including Buddhism.