From what I understand, small rifle primers just have a beefier cup, but otherwise throw no more flame nor is it hotter than small pistol primers.
I tried a couple empty cases in my 9mm and the hammer strike is sufficient to ignite them so misfires shouldn't be excessive. So is it crazy to use small rifle in lieu of small pistol primers for 9mm and .357 mag?