Yeah but for most people who aren't knowledgeable about history, the connotation isn't necessarily negative.
It should be, but it isn't. "Settlers of Catan" is probably one of the most popular board games ever, and it's all just friendly people trading sheep and wood and shit.