Definitely; in fact, if given a choice, that would be my default decision. There is a town that actually springs to mind: Estes Park Colorado. Admittedly, it is larger than you would probably want (6000+ people as of last year) and it has some big roads going in/out.
The mountains are pretty good with lakes and streams, and you can grow food there. The reason I mentioned Estes Park is that I actually hauled hay bales for my uncle/aunt who raised cattle there on the side of their construction business.
It also is near Rocky Mountain State Park; so wood for fires, and hunting would be no trouble. If anything, the elk practically claim the town during parts of the year.
So what this means is you can easily find even smaller, better defendable locations if you wish.