Gotta admit i do all my hunting with deer/big game rifles, of which i have three currently - but one is strictly for visitors. I shoot everything from cottontails to wapiti with my two rifles - and the odd buffalo as well. For me, shooting rabbits and other vermin is just practice for big game hunting. In fact, i went thru a stage of "plinking" rabbits with a 375 H&H, because it was good practice for when it really mattered that every shot counted. It is much easier to kill a buffalo with a 375 H&H than it is a little bunny! Admittedly, my nearest neighbour was 10 miles away, so noise pollution wasn't really a consideration. Nevertheless, you get out in the backyard plinking bunnies with a 375 H&H, and i would suggest it is highly unlikely any of your neighbours will come over and complain!
Essentially, i have a little browning .308 pump for "woods hunting" and general plinking, and a single bolt-actioned rifle for everything else. I'd rather have fewer rifles rather than more. Every now and again i get the longing for a SxS 20g for rabbits, but then i always figure i am just as likely to see a deer, so it is always the 308 that will go out with me - i can foresake the odd bunny for the chance of venison (we don't have wingshooting). And hitting running bunnies with the 308 is excellent practice. I have an allergy to heavy barrels and "tactical" rifles - my rifles and glass must be simple and efficient with no unnecessary weight or gimmickry, and optimised to work quickly from 3 to 300 yards in any field position that might come up (including a quick offhand shot at close range in heavy cover), and the rifle must not impede my mobility. But the most important thing is that i am proficient with my rifle, and that means using just one or two rifles and using them for everything. I am even very simplistic with my reloading - i only need one or two loads, and i just ensure that i know the ballistics of each load backwards.
My experience is far more folks suffer from having too many guns, rather than too few. And similarly, far more folks suffer from having unnecessarily complicated guns and glass, rather than suffering for lack of "functions" or "aids".