A dremel tool or B&D Wizard is ideal for this sort of thing. Just be very careful not to get any dust inside the engine or it will do a wonderful job of eating the engine up. It's best to pull the jug if you do it. Cleaning up the rough spots in the ports will not hurt, and may give you a slight increase in performance.