It's worth it, I believe. At least it has paid off for me.

I think in part the pillage is based on 2 factors

-your wealth
-your rank

and btw how much money did you have when he attacked. If you didn't have much, that explains a lot.

I was ranked well, but not so much anymore. prob as low as 7,000