Dan,
Your problem is not too much oil, it is too much fuel/oil mix relative to the amount of air. You could have a sticky or sunk float or a blocked air passage in the carb or your choke could be partially on. If you have an idle mixture adjustment, this could be set too rich.
Ron