You will want to drill then REAM for a tolerance fit. I seriously doubt will probably not find a standard A-Z/fractional drill of the right size. and then there is the truth to drilling "triangular" holes! That is why you always STEP DRILL. If you step drill (6-8 sizes) to just under the size you need for the bearing and then ream to tolerance-required size for your bearings, that will get you there.
This IS normally a machine shop function (milling machine) and not something normally attempted by a sloppy quill 30 year old foreign-made drill press.
Best of luck to you in your quest.
banger