Bret, that fan is certainly hold the engine back.
When I installed a new front sprocket a while ago, I rode it for a couple minutes without the fan... MAJOR difference.
You'd be amazed just how much drag that fan creates.
Without it, the bike was crazy responsive and fast.
Too bad I can't ride all the time without it...