That is where I am as well.
I have five AR's for if/when the SHTF but have little desire to shoot them much. Even though .223 brass is cheap, why go hunting for it and pick it up after doing all the prep work? Prefer bolt actions and lever actions when shooting off the bench.
Wolf makes a good point about being able to have a bunch of different calibers by swapping uppers for those who like lots of "toys". When I got my first AR, I was going to travel that road. I used to be like that when I was younger but am a minimalist now.
My CF rifle needs are simple. The .223 and .308 cover self-defense close or far (as far as I can shoot anyway) and varmints/game. I have a few .30/30's but they are there in case the idiots ban AR's and I need an effective "combat rifle."
If I miss a 300 yard shot at a varmint due to wind drift, that I would have hit with a 6mm ARC, it is not the end of the world. Plus, I prefer carrying my little Howa mini-Mauser instead of lugging around an 8+ lb AR that makes me look like a mall ninja.
ARs have their place. I am "old school" when it comes to shooting and hunting.