He doesn't seem to have a very firm grasp on reality so I could easily see people not taking some of the shit he says seriously. But yes he already gave plenty of reason to cancel him.
Just saying that to a certain extent, I can understand how a fan might say "yeah he says crazy nonsense all the time you shouldn't take it too seriously" but this doubling down makes that an even more untenable position.