How do you kill wasps that have burrowed into a porch post.?

They got in there from the half inch (or so) gap between the bottom of the post and the cement porch. Sprays wont work, we've tried, we cant get it to shoot upwards into the post. Just makes them mad. Will taping them in work?