If you're having high rpm and no speed, lighter weights won't help. Did you deburr the inside after you ground it down? You'll want to ensure it still slides. If it does, the you'll actually need heavier weights to make it variate again. But that makes less sense than there being another reason you're not variating.
Also, what are the washers for?