Yes, do be choosy and take your time. Not only for your rifles but any shotguns you might want too. Obviously you'll have an idea what rifle(s) you want Calibre-wise. But consider the use you will put them to. Will you do a lot of walking with it, for example and the odd shot? If so, don't get a heav barrelled rifle. What ranges will you be shooting at? Will the range vary a lot or is a fixed scope a better bet? As for shotguns, also consider your use. No good having a semi if you intend game shooting. Or a heavy gun with a long barrel or rough shooting, but that might suit you for clay busting. Maybe a nice spotter that. Would do everything would be a goo first buy, then you can concentrate on rifles.
either way, buy the best you can reasonably afford, don't be too keen to fill your slots immediately and spend a bit of time researching. It's all fun, so enjoy!