Try this:
Do your best to get it lined up on 1 attempt. Move back. Survey your results. Set up to the ball accounting for the error you observed in your alignment aid. Putt.
This is what I do. The line is still really helping me even if I end up with the line pointing a little left. I know that when I line up on the ball I need to be "a little right" relative to where the line is pointed. How much is fairly easy to assess from behind the ball after the first lineup attempt.
I always screwed myself by lining up, wiggling around a little for comfort, and ending up right enough of my target that I'd miss right. Now, even if I'm not dead in the line, I know what the margin is and where to keep myself aligned.
This is definitely faster than remarking and re-aiming the little line five times, and the resulting success has been about the same for me. I needed a visual aid when standing over the ball that was independent of the putter itself, and this did it.
You'll get better at getting the line close, and still benefit even when it's a little off. You'll know how much to adjust once you're over the ball because you went back and looked.
If it's way off, yeah, suck it up and re-aim it. After 2 efforts you'll be close enough to be confident that you can adjust your line relative to the line in the ball and give it a run.