Well dudes, here's what worked:
Started with 400 grit waterproof sandpaper, wrapped around a piece of paint stir stick, and light machine oil. It removed the scratches and left a finish that matched the rest of the barrel. Didn't have to move on to 600 or finer. The light machine oil helps with the cutting action and the stir stick keeps the surface flat.