Unless you make a new pulley you’re fucked.
It’s the gy6 pulley that’s fucked. Not anyone’s machining of adaptors.
The horizontal minarelli pulleys are much better but again, they’re meant to rotate on bearings not be locked to a shaft.
Do what you do, but I’m telling you, you’re much better off modding the stock pulley.