First off I am a big bore fan too. I LOVE big booms and big recoil. I have the .460 and had - past tense - the .500 X frame. It remains THE only handgun that I have ever fired that bruised the palm of my hand. The classic S&W grip frame is not ideal for massive handgun recoil. I'd much rather shoot full house loads in a BFR or SRH or FA 83 - I'm actually most partial to the Ruger Bisley grip than any other - over the S&W.
If you want one, get one! It is the biggest revolver any of us are likely to ever own. Just don't forget that you can download it so that you can actually shoot it and there is absolutely nothing wrong with wearing a shooting glove when you do!
FWIW the .460 recoil is entirely different. Even shooting heavier bullets than the hotrod 200gr pointy ones, it is not the same as the .500 S&W. Listen to Whitworth, 44Man and Subsonic. They have forgotten more about big bore shooting than I shall ever know. The other posters I simply don't know.
I'l parrot the advice on the Ultra Dot. Mine has held up to both X frames just fine!