I would cast them much softer than that. Maybe even cut the range scrap with pure lead. Low pressure, low velocity rifle loads benefit from easily conforming to the interior of the barrel. If you can't nick the bullet with your thumbnail it's probably too hard for optimum accuracy.
Also, try using your bullets without gas checks and without sizing. Just cast, hand lube, and load them.