I wonder if he's stuck in a paradox here.

He avoids fights because it can't be helped, the ride never ends.

However, that particular massacre might be just to lure him in, so things are actually worse if he keeps avoiding,

Still, he can't simply go in or risk things going rock bottom by Aku figuring out he lost his sword.

And to keep him from trying to balance those issues… the voices. He literally can't take five to eat a rat's ass without six million ghosts telling him he has forsaken them.

Time passes so fast, doesn't it?