My .02 cents (and you can keep the change). Start with a measured .452 diameter sized boolit.
1) Make sure you have adequate flair on the cases so you aren't swaging down your boolit diameter when seating them.
2) Don't over taper crimp, this can possibly reduce diameter.
3) Use more lube. Straight Alox works fine with a very thin coating applied. You can mix it 50/50 with mineral spirits, but I wouldn't dilute it more than that.
4) No need to bake the boolits, just let them air dry. A small fan helps with this.
Hope this helps!