First, if there's one thing the federal government is good at doing, it's getting normal people to pay their taxes. Besides, you've probably already had the taxes withheld from your payroll and you're just stalling on the end of year balancing of books.
Second, I know nobody has told them yet, but we print the money. Not paying your taxes is going to hurt you a lot more than it hurts them. If anything it just gives them a valid excuse to go after the people they wanted to go after anyway.