Well, after looking over the Remington #4 in .32 rimfire at the local gun shop, I was able to snag it for $275. The loading gate wouldn't go down unless the hammer was just slightly pulled back. Well, I got it home and took it apart and found that there was a small burr on the hammer almost like a "ding" at one time where the loading gate slid down. Sure enough, I lightly stoned with, polished more so and now it works like a charm. The action is very firm and the hammer comes back to half cock and full cock just like it should.
I ordered a few of the cases from Dixie Gun Works to try loading the rimfire round that way, I'll see how it works and go from there. I plenty of .310 round balls which is what Dixie recommends and black powder.