Not a difficult task...yes a drill press is preferred but I've done it by hand on a few sets
The amount that is needed to be removed is minimal.
Just make sure the head is secured in a vice and you do your best to keep the drill straight although the hosel being .370 at the top will serve as a guide.
a variable speed drill is a must and go slowly with cutting oil