I know the insects can be problem sometimes but this is part of bio-diversity. This is going to turn into beautiful butterflies soon. However, if you still want to remove, make a mixture of onion, garlic, turmeric and chilli. Boil these ingredients in water. (One onion, three garlic bulb, 1 teaspoon turmeric and 1 teaspoon chili)
After 10 minute boiling, cool it down and filter it.
Add water in the ratio of 1:10 to it and spray it over.
Caution: this solution is just to keep these beautiful creatures away from your plant and not to destroy them.