Okay, so I changed several things, so I'm not sure what was wrong, but I am happy with today's limited shooting.
I put a Vortex scope on, took the center out of the Tromix Linear Comp, and switched to CFE-BLK.
I can use the same loads tomorrow with the Linear Comp put back in to see if that has any effect on the groups.
The velocity was lower with CFE-BLK. I think there's still room to go higher. The bolt wasn't locking back all the time.
I ran out of prepped brass, so I didn't load anything higher than 36.5gns.