Carpenter Bees

What is the best way to get rid of these things? I hate to kill them because we are short on polonators, but they are a damn nuisance. For me they really don't bother me but the wife freaks out every time ( traumatic bee encounter from years ago), so I need to do something. I just tried pouring vinegar over the railings and spindles and they took off fast. maybe this will do it maybe it won't. I am open to ideas. They are boring in to pressure treated 2x4's......
