Yeah.
The driver is sending an AC signal that needs to be caught by a matched load. If the load isn’t taking it all, some of that power gets reflected back at the amp.
It will also sound better.
It’s broke already. Don’t be shy about taking it apart and trying some trouble shooting.