Take it anywhere you like, I went to the bottom of the groves so I could put ball and patch flush with the bore which gave me more control of ram and barrel. Less than that caused more pressure on the ramrod and uncentering the sprue.
My answer is why not! You do yours where you are comfortable with.