If they are doing no harm is there any need to kill them? Our insect populations are declining and without knowing what the insects are it would be difficult to know what to advise you. You could try making up a spray of garlic - boil cloves in water, liquidise, sieve and use diluted. There are lots of different recipes so it can't be critical! Lots of people have found that insects dislike the smell and stay away.