Mice don't bug me so much, although I think you have to worry about what they get into, what diseases they can spread, etc. Before we moved into our home in the country, we had the house inspected. While the assmunch missed a major design flaw and leak in a window overhang (I got to fix it in a downpour), he did spot a dead rat under the house. Rats! Ugh.
We had an exterminator out before we moved in. After builders cleared the lot next door, we had more. We now have exterminators out quarterly (drop rat bait, spray for yellow jackets, flying ants, etc.). Best money we've spent. Never seen a rat since, and the bastids were taking poison blocks two at a time each night for three weeks from us!
BTW, the neighbors don't seem to have a problem either. I'd guess the rats we didn't get are being grabbed by the barred owls that roost in the neighborhood from time to time. Very cool birds, those owls.