I confess that I like to grow cabbage/mustard family plants to attract cabbage moths...I believe they are actually moths. There are two types, cabbage whites and, I think, spotted whites, they're charming. They'd likely be finding your neighbor's plants without your help, they're prolific, and your contribution to their population is of little consequence, (or so I tell myself!) Enjoy them, but if you want to preserve some of your plants they're attracted to, use some Bt, bascillus thurengeinsis (dipel dust,) a bacterial, natural insecticide, it's non-toxic and allowed under organic gardening standards, affects only catterpillars and not beneficials like ladybugs, praying mantis, etc.
Unfortunately, many butterflies/moths require a host plant for their larva, so they are often "pests" of something or other. Some plants feed the larva, some provide pollen, expect to allow some crops to be eaten and protect others for your own use, I see it as a fair exchange! :)