I’m in a similar position to the OP. I’m relatively new to the world of CF rifles, and have a .243 conditioned for fox and AOLQ. I guess technically I have a deer calibre, and my experience with the .243 is limited to stalking CWD and Muntjac.
However, my longer term aim is to get a further variation for a different deer calibre to use in different situations and locations - and think that will be .308. I’ve only shot .308 and .270 alongside my .243, so have not much to compare it to, and it may well not be my final position and a long term rifle. It could also be seen as a ‘safe’ or ‘boring’ choice - but starting out, that’s surely a good thing?
I started driving 35 years ago, and in that time I’ve lost count of the number of cars I’ve had, some bought on a whim and some bought for practical reasons. However, I now know what works for me and have settled on a type and indeed make. I’m sure other people won’t agree with my choice, but works for me.
Think it will be the same for me with finding a final calibre. Further down the line as my experience and knowledge grows, I could well end up hand loading a more exotic or rare calibre that meets my needs, but to get on the ladder, and to start to gather what you need to settle on a final choice, the 308 looks like a solid and dependable starting position.
A Ford Escort got me going, and I think the .308 will do likewise. But hopefully with less rust, and definitely more reliability

.