You might try a flat screwdriver on a leftover edge and hammer in the off direction .
Maybe apply some penetrating oil .
If it's really stuck , you might try a hacksaw blade in the hole to cut slots in the aluminum and then push the leftover chunks toward the center of the hole . Keep a needle nose pliers close to grab the loosened pieces .