I have only 1 lime tree in the garden. It takes so long to grow to almost my height. Almost 3 years I guess...... It has been fighting the damage done by numerous caterpillars all the time.
I give up on caterpillar attack sometime ago and made agreement with them.....You can have the leaves and I will pluck the lime....sound strange but i have no choice.
I have try spraying pesticide in the past but they return after few weeks and since this year I'm trying to minimize pesticide in the garden.... I have to do some other arrangement....Sometimes I remove the fat caterpillars if they seems to appear in large quantity though......